-- Logs begin at Fri 2022-06-03 11:17:43 UTC, end at Fri 2022-06-03 12:26:32 UTC. -- Jun 03 11:43:51.046505 dv-cinder-844572-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 03 11:43:51.058985 dv-cinder-844572-1-iscsi devstack@keystone.service[80100]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 03 11:43:51.060970 dv-cinder-844572-1-iscsi devstack@keystone.service[80100]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 3 11:43:51 2022] *** Jun 03 11:43:51.060970 dv-cinder-844572-1-iscsi devstack@keystone.service[80100]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 03 11:43:51.060970 dv-cinder-844572-1-iscsi devstack@keystone.service[80100]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 03 11:43:51.060970 dv-cinder-844572-1-iscsi devstack@keystone.service[80100]: nodename: dv-cinder-844572-1-iscsi Jun 03 11:43:51.060970 dv-cinder-844572-1-iscsi devstack@keystone.service[80100]: machine: x86_64 Jun 03 11:43:51.060970 dv-cinder-844572-1-iscsi devstack@keystone.service[80100]: clock source: unix Jun 03 11:43:51.060970 dv-cinder-844572-1-iscsi devstack@keystone.service[80100]: pcre jit disabled Jun 03 11:43:51.060970 dv-cinder-844572-1-iscsi devstack@keystone.service[80100]: detected number of CPU cores: 4 Jun 03 11:43:51.060970 dv-cinder-844572-1-iscsi devstack@keystone.service[80100]: current working directory: / Jun 03 11:43:51.060970 dv-cinder-844572-1-iscsi devstack@keystone.service[80100]: detected binary path: /usr/bin/uwsgi-core Jun 03 11:43:51.061607 dv-cinder-844572-1-iscsi devstack@keystone.service[80100]: your processes number limit is 47680 Jun 03 11:43:51.061607 dv-cinder-844572-1-iscsi devstack@keystone.service[80100]: your memory page size is 4096 bytes Jun 03 11:43:51.061607 dv-cinder-844572-1-iscsi devstack@keystone.service[80100]: detected max file descriptor number: 2048 Jun 03 11:43:51.061607 dv-cinder-844572-1-iscsi devstack@keystone.service[80100]: lock engine: pthread robust mutexes Jun 03 11:43:51.061607 dv-cinder-844572-1-iscsi devstack@keystone.service[80100]: thunder lock: enabled Jun 03 11:43:51.061607 dv-cinder-844572-1-iscsi devstack@keystone.service[80100]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 03 11:43:51.061607 dv-cinder-844572-1-iscsi devstack@keystone.service[80100]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 03 11:43:51.105988 dv-cinder-844572-1-iscsi devstack@keystone.service[80100]: Python main interpreter initialized at 0x557801a1b9c0 Jun 03 11:43:51.105988 dv-cinder-844572-1-iscsi devstack@keystone.service[80100]: python threads support enabled Jun 03 11:43:51.105988 dv-cinder-844572-1-iscsi devstack@keystone.service[80100]: your server socket listen backlog is limited to 100 connections Jun 03 11:43:51.105988 dv-cinder-844572-1-iscsi devstack@keystone.service[80100]: your mercy for graceful operations on workers is 90 seconds Jun 03 11:43:51.106319 dv-cinder-844572-1-iscsi devstack@keystone.service[80100]: mapped 403077 bytes (393 KB) for 2 cores Jun 03 11:43:51.106403 dv-cinder-844572-1-iscsi devstack@keystone.service[80100]: *** Operational MODE: preforking *** Jun 03 11:43:51.106674 dv-cinder-844572-1-iscsi devstack@keystone.service[80100]: *** uWSGI is running in multiple interpreter mode *** Jun 03 11:43:51.106674 dv-cinder-844572-1-iscsi devstack@keystone.service[80100]: spawned uWSGI master process (pid: 80100) Jun 03 11:43:51.106851 dv-cinder-844572-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 03 11:43:51.107762 dv-cinder-844572-1-iscsi devstack@keystone.service[80100]: spawned uWSGI worker 1 (pid: 80110, cores: 1) Jun 03 11:43:51.107762 dv-cinder-844572-1-iscsi devstack@keystone.service[80100]: spawned uWSGI worker 2 (pid: 80111, cores: 1) Jun 03 11:43:51.109179 dv-cinder-844572-1-iscsi devstack@keystone.service[80100]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 03 11:43:56.761654 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 11:43:56.761654 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: from cryptography.utils import int_from_bytes Jun 03 11:43:56.762436 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 11:43:56.762436 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: from cryptography.utils import int_from_bytes Jun 03 11:43:56.762878 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 11:43:56.762878 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: from cryptography.utils import int_from_bytes Jun 03 11:43:56.763343 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 11:43:56.763343 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: from cryptography.utils import int_from_bytes Jun 03 11:43:56.812268 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 03 11:43:56.812457 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 03 11:43:56.812647 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] command line args: [] {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 03 11:43:56.812918 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 03 11:43:56.813093 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ================================================================================ {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 03 11:43:56.813343 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] admin_token = **** {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.813585 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] config_dir = [] {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.813697 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 03 11:43:56.813783 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.813897 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 03 11:43:56.813977 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] config_source = [] {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.814103 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] command line args: [] {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 03 11:43:56.814183 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] debug = True {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.814298 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.814551 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 03 11:43:56.814551 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ================================================================================ {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 03 11:43:56.814761 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.814844 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] admin_token = **** {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.814947 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.815062 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] config_dir = [] {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.815216 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.815337 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.815447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] config_source = [] {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.815580 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.815686 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] debug = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.815789 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] list_limit = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.815901 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.816034 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] log_config_append = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.816139 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.816250 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.816250 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] log_dir = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.816435 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.816539 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] log_file = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.816649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.816747 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.816862 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.816944 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.817071 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] list_limit = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.817195 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.817272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] log_config_append = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.817272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.817450 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.817571 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] log_dir = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.817645 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.817771 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] log_file = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.817852 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.817930 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.818054 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.818137 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.818214 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.818341 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.818425 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.818503 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.818618 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.818695 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.818811 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.818897 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.818976 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.819142 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.819231 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.819352 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.819446 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.819569 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.819686 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.819809 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.820048 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.820168 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.820289 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.820369 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] publish_errors = False {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.820541 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.820624 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.820779 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.820907 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.820983 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.821100 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.821182 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.821405 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.821531 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.821637 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] standard_threads = False {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.821716 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] publish_errors = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.821865 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.822006 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.822089 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.822162 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.822267 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.822346 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.822446 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] use_journal = False {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.822567 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.822645 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] use_json = False {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.822783 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] use_stderr = False {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.822860 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.822958 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] use_syslog = False {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.823045 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] standard_threads = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.823185 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.823265 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.823437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.823537 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.823681 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.823771 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.823866 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] use_journal = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.823951 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.824029 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] use_json = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.824168 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.824254 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] use_stderr = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.824376 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] use_syslog = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.824466 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.824610 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 11:43:56.824695 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.824869 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.824960 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.825099 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.825178 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.825344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.825424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.825588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.825743 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.825838 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.825927 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.826071 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.826150 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.826316 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.826406 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.826551 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.826630 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.826796 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.826875 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.827043 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.827134 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.827279 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.827369 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.827528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.827618 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.827795 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.827882 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.828034 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.828121 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.828268 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.828347 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.828515 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.828601 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.828756 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.828840 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.829013 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.829090 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.829261 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.829351 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.829492 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.829577 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.829721 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.829800 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.829949 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.830038 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.830181 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.830260 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.830450 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.830528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.830695 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.830784 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.830925 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.831003 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.831153 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.831230 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.831398 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.831577 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.831659 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.831731 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.831894 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.831974 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.832141 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.832220 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.832373 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.832450 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.832606 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.832694 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.832874 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.833005 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.833138 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.833264 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.833389 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.833514 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.833652 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.833779 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.833921 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.834056 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.834188 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.834314 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.834450 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.834578 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.834704 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.834837 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.834964 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.835091 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.835233 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.835364 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.835489 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.835743 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.835821 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.835880 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.835955 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.836016 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.836073 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.836136 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.836195 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.836252 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.836320 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.836380 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.836467 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.836534 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.836594 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.836863 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.837004 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.837124 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.837250 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.837374 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.837505 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.837629 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.837763 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.837887 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.838012 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.838143 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.838269 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.838401 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.838544 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.838677 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.838801 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.838937 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.839067 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.839192 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.839321 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.839452 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.839651 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.839788 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.839911 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.840039 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.840175 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.840313 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.840447 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.840570 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.840698 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.840820 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.840954 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.841079 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.841211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.841352 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.841477 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.841605 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.841733 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.841858 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.841994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.841994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.842244 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.842377 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.842498 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.842625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.842760 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.842887 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.843024 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.843155 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.843282 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.843485 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.843629 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.843758 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.843894 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.844023 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.844152 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.844288 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.844416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.844552 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.844678 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.844804 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.844931 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.845064 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.845193 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.845326 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.845452 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.845582 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.845717 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.846357 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.846483 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.846613 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.846743 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.846870 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.847004 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.847140 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.847275 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.847413 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.847600 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.847733 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.847832 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.847952 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.848090 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.848225 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.848352 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.848484 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.848612 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.848742 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.848868 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.849002 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.849131 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.849257 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.849387 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.849514 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.849640 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.849777 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] auth.external = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.849911 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.850040 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.850167 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.850295 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.850423 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.850558 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.850692 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.850820 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] auth.password = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.850946 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.851189 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] auth.token = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.851341 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.851511 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.851653 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.851800 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.851931 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] auth.external = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.852066 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.852196 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.852326 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.852326 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.852577 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.852577 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.852819 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.852948 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] auth.password = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.853084 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.853220 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] auth.token = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.853350 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] credential.caching = True {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.853487 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.853616 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.853749 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.853880 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.854019 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.854147 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.854276 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.854404 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.854532 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.854660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.854660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.854909 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.854909 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.855150 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.855288 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] credential.caching = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.855417 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.855575 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.855709 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.855839 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.855968 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.856097 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.856224 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.856363 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.856493 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.856621 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.856749 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.856920 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.857050 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.857200 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.857329 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.857457 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.857586 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] federation.caching = True {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.857714 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.857843 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.857978 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.858107 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.858107 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.858349 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.858476 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.858612 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.858748 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.858887 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.859015 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.859144 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.859274 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.859405 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.859707 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.859834 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] federation.caching = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.859971 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.860100 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.860227 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.860353 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.860486 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.860613 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.860739 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] identity.caching = True {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.860876 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.861003 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.861130 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.861265 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.861393 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.862163 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.862295 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.862424 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.862572 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.862717 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.862843 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.862970 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.863096 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.863232 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.863359 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.863494 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.863641 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] identity.caching = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.863771 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.863900 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.864027 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.864166 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.864303 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.864433 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.864563 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.864691 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.864819 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.864957 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.865104 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.865238 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.865366 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.865495 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.865623 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.865760 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.865889 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.866017 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.866144 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.866272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.866400 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.866538 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.866672 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.866811 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.866945 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.867073 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.867201 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.867336 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.867465 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.867612 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.867746 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.867746 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.867986 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.868120 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.868246 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.868373 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.868498 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.868635 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.868762 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.868896 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.869023 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.869149 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.869275 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.869401 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.869533 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.869668 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.869795 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.869922 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.870052 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.870178 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.870313 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.870448 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.870574 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.870700 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.870825 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.870952 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.871078 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.871210 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.871337 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.871462 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.871638 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.871761 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.871890 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.872031 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.872169 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.872298 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.872426 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.872559 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.872688 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.872826 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.872954 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.873093 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.873221 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.873356 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.873486 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.873626 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.873756 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.873886 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.874034 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.874162 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.874290 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.874426 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.874555 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.874681 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.user = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.874809 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.874939 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.875067 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.875203 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.875332 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.875465 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.875607 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.875752 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.875880 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.876015 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.876141 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.876268 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.876393 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.876519 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.876645 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.876778 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.876904 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.877031 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.877157 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.user = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.877284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.877417 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.877554 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.877554 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.877792 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.877924 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.878051 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.878185 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.878313 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.878439 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.878565 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.878690 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.878817 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.878954 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.879081 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.879217 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.879344 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.879471 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.879617 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.879758 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.879888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.880024 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.880153 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.880282 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.880411 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.880546 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.880676 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.880804 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.880932 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.881072 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.881202 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.881338 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.881468 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.881596 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.881725 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.881852 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.881981 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.882115 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.882244 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.882372 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.882501 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.882629 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.882756 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.882901 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.883030 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.883157 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.883285 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.883413 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.883559 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.883695 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.883827 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.883957 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.884093 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.884223 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] resource.caching = True {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.884350 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.884488 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.884620 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.884759 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.884890 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.885020 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.885150 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.885356 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.885490 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.885621 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.885753 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.885884 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.886014 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.886152 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.886283 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.886414 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.886555 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.886686 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.886818 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.886955 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] role.caching = True {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.887086 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] resource.caching = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.887216 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] role.driver = sql {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.887347 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.887477 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.887477 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.887749 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.887879 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.888007 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.888135 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.888265 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.888402 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.888539 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.888668 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.888796 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.888938 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.889073 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.889205 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.889346 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.889480 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.889614 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.889747 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.889885 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] role.caching = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.890028 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.890174 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] role.driver = sql {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.890318 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.890451 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.890583 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.890718 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.890857 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.890991 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.890991 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.891242 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.891375 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.891525 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.891681 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.891817 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.891950 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.892092 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.892225 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.892357 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.892497 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.892631 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.892764 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.892897 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.893029 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.893161 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.893301 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.893435 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.893568 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.893701 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.893701 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.893955 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.894092 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.894224 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.894355 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.894486 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.894616 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.894745 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.894892 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.895026 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.895159 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.895292 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.895425 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.895623 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.895775 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.895911 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.896045 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.896045 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] token.caching = True {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.896295 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.896427 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.896568 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.896701 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.896833 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.896966 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.897098 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.897230 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.897371 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.897518 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.897651 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.897783 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.898168 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.898314 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.898447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.898580 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.898712 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.898843 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.898975 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.899116 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.899251 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.900913 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.901044 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.901149 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.901240 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] token.caching = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.901470 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.901552 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.901640 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.901749 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.901867 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.902044 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.902166 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.902244 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.902317 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.902390 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.902462 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] database.connection = **** {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.902547 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.902629 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.902712 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.902785 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.902858 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.902929 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.903001 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.903072 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.903158 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.903233 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.903305 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.903377 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.903449 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.903543 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.903631 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.903706 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.903778 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.903850 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.903922 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.903993 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.904073 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.904147 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.904218 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.904290 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.904361 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] database.connection = **** {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.904441 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.904441 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.904589 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.904664 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.904736 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.904807 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.904878 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.904949 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.905028 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.905102 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.905173 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.905244 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 03 11:43:56.905316 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.905316 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.905316 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.905316 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.905316 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.905316 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.905316 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.905316 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.905316 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.905941 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.905941 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.905941 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.905941 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 11:43:56.905941 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 03 11:43:56.927777 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:56.928003 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:56.928226 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:56.929555 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:56.929792 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:56.930023 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:56.936717 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:56.938613 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:56.965150 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:56.965373 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:56.967096 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:56.967333 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:57.020552 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:57.020741 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:57.070032 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:57.070264 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:57.070764 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:57.070999 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:57.137629 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:57.137776 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:57.137858 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:57.137953 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:57.138066 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:57.138151 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:57.138287 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:57.138370 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:57.138506 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:57.138590 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:57.138725 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:57.138807 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:57.163163 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:57.163349 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:57.163437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:57.163608 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:57.163692 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:57.163825 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:57.163906 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:57.164038 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:57.164122 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:57.164249 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:57.164332 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:57.164460 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:57.164552 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:57.164671 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:57.175758 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:57.176107 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:57.188252 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:57.188483 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:57.188567 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:57.188709 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:57.188791 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:57.188931 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:57.189020 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:57.189144 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:57.189270 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:57.189353 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:57.189476 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:57.189553 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80111) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:57.189704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:57.189807 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80110) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 03 11:43:57.207191 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.207397 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 03 11:43:57.207672 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.207838 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.207917 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 03 11:43:57.207991 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 03 11:43:57.208195 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.208276 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.208400 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 03 11:43:57.208490 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.208672 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.208754 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.208932 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.209011 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.209189 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.209444 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.219958 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.220233 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.220499 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.220579 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.220778 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.220888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.221617 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.221897 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.229494 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80111) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 11:43:57.230105 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 11:43:57.232819 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80111) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 11:43:57.233097 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.233375 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.233456 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 11:43:57.233654 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.233739 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.233933 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.234015 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.234234 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.234315 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.234516 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.234600 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.234818 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.234898 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.235090 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.235179 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.235374 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.235455 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.235675 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.235758 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.235945 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.236214 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.262409 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.262991 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.264138 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80111) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 11:43:57.264416 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.264745 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 11:43:57.265026 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.270287 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80111) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 11:43:57.270607 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.270843 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.270933 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 11:43:57.271189 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.271468 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.278511 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80111) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 11:43:57.278790 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.279112 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 11:43:57.279392 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.283299 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80111) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 11:43:57.284387 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.284595 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 11:43:57.284678 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.284942 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.285024 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.285219 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.285300 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.285494 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.285585 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.285762 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.285845 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.286025 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.286107 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.286313 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.286583 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.304687 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.304959 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.305240 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.305515 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.309596 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80111) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 11:43:57.310153 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 11:43:57.313233 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.313525 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.313808 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.314104 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.318528 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80111) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 11:43:57.319128 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 11:43:57.322252 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80111) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 11:43:57.322738 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 11:43:57.327284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.327608 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.327800 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.327883 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.328102 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.328264 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.328392 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.328537 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.328672 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.328818 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.328946 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.329219 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.349566 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 11:43:57.349847 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.350112 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.350375 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.358416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.360170 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.360446 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.362407 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80111) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 11:43:57.362699 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.362968 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.363242 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.363575 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 11:43:57.363857 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.364145 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.364426 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.364716 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.371321 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.373076 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.373355 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.376431 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80111) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 11:43:57.376711 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.376990 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.377758 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.378053 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.378743 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 11:43:57.379021 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.379299 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.379599 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.379883 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.380157 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.380430 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.391595 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80111) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 11:43:57.391875 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.392155 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.392434 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.392715 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.393585 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.393876 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.399394 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 11:43:57.402678 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 11:43:57.406016 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.407644 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.409329 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 11:43:57.409605 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.409884 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.412330 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80111) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 11:43:57.415660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80111) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 11:43:57.417373 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.418987 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.419118 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 11:43:57.420628 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.422288 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80111) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 11:43:57.422434 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.422567 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.422698 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.422842 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.422974 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.423197 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.430318 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.432002 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80111) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 11:43:57.432466 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 11:43:57.432753 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.433135 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.435210 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.435518 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.435803 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.436079 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.441734 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80110) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 11:43:57.442011 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.442287 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.442558 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.442828 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.443130 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.443401 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.443699 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.443974 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.444240 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.444507 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.444769 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.445044 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.445300 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80110) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.445796 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80111) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 11:43:57.446079 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.446461 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.454509 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80111) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 03 11:43:57.454793 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.455098 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.455976 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.456251 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.456551 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.456825 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.457102 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.457379 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.457645 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.457914 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.458186 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.458455 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.458711 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80111) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 03 11:43:57.483754 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557801a1b9c0 pid: 80110 (default app) Jun 03 11:43:57.487020 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599bd00e-7047-4935-82ac-bc002381d9c1 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:43:57.487315 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599bd00e-7047-4935-82ac-bc002381d9c1 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:43:57.487620 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599bd00e-7047-4935-82ac-bc002381d9c1 None None] PATH_INFO: `/v3` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:43:57.491832 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 791 bytes} [Fri Jun 3 11:43:57 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:43:57.496896 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557801a1b9c0 pid: 80111 (default app) Jun 03 11:44:05.431800 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778fc11d-47ae-4e8c-9cea-2ca4d2a52700 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:05.432356 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778fc11d-47ae-4e8c-9cea-2ca4d2a52700 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:05.432356 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778fc11d-47ae-4e8c-9cea-2ca4d2a52700 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:05.433686 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 2/2] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 11:44:05.441533 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016b08d-3182-49d5-ae10-36bc8ea08d37 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:05.441949 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016b08d-3182-49d5-ae10-36bc8ea08d37 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:05.442094 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016b08d-3182-49d5-ae10-36bc8ea08d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:05.509377 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: INFO dbcounter [None req-e016b08d-3182-49d5-ae10-36bc8ea08d37 None None] Registered counter for database keystone Jun 03 11:44:05.530309 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG oslo_db.sqlalchemy.engines [None req-e016b08d-3182-49d5-ae10-36bc8ea08d37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80111) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 11:44:05.536589 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writer thread running {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 11:44:05.821539 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG passlib.handlers.bcrypt [None req-e016b08d-3182-49d5-ae10-36bc8ea08d37 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80111) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 03 11:44:05.822011 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG passlib.handlers.bcrypt [None req-e016b08d-3182-49d5-ae10-36bc8ea08d37 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80111) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 03 11:44:05.877174 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-e016b08d-3182-49d5-ae10-36bc8ea08d37 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:05.878802 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-e016b08d-3182-49d5-ae10-36bc8ea08d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:06.002485 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1/3] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 565 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 03 11:44:06.148947 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778fc11d-47ae-4e8c-9cea-2ca4d2a52700 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:06.219187 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: INFO dbcounter [None req-778fc11d-47ae-4e8c-9cea-2ca4d2a52700 None None] Registered counter for database keystone Jun 03 11:44:06.238712 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG oslo_db.sqlalchemy.engines [None req-778fc11d-47ae-4e8c-9cea-2ca4d2a52700 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80110) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 11:44:06.244836 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writer thread running {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 11:44:06.466136 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778fc11d-47ae-4e8c-9cea-2ca4d2a52700 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:06.470313 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf24cee-679b-47b8-b0de-8dd8376b31e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:06.470964 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf24cee-679b-47b8-b0de-8dd8376b31e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:06.471252 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf24cee-679b-47b8-b0de-8dd8376b31e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:06.471584 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf24cee-679b-47b8-b0de-8dd8376b31e0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:06.479641 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf24cee-679b-47b8-b0de-8dd8376b31e0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:06.532147 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fcf24cee-679b-47b8-b0de-8dd8376b31e0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 03 11:44:06.532491 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf24cee-679b-47b8-b0de-8dd8376b31e0 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:06.541865 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 3/4] 10.222.0.15 () {58 vars in 1324 bytes} [Fri Jun 3 11:44:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 11:44:06.547978 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016b08d-3182-49d5-ae10-36bc8ea08d37 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:06.562154 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016b08d-3182-49d5-ae10-36bc8ea08d37 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:06.567081 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd12eb-869a-469e-a358-84523f44df9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:06.568232 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd12eb-869a-469e-a358-84523f44df9e admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:06.568523 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd12eb-869a-469e-a358-84523f44df9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:06.568811 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd12eb-869a-469e-a358-84523f44df9e admin admin] PATH_INFO: `/v3/projects/6db62e59d8164100b9d96eb446461cfc` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:06.570426 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd12eb-869a-469e-a358-84523f44df9e admin admin] RBAC: Authorizing `identity:get_project(project_id=6db62e59d8164100b9d96eb446461cfc)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:06.622215 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: WARNING keystone.common.rbac_enforcer.enforcer [None req-82bd12eb-869a-469e-a358-84523f44df9e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 03 11:44:06.622563 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd12eb-869a-469e-a358-84523f44df9e admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:06.627081 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 2/5] 10.222.0.15 () {56 vars in 1207 bytes} [Fri Jun 3 11:44:06 2022] GET /identity/v3/projects/6db62e59d8164100b9d96eb446461cfc => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:44:08.816170 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa55b1-4c22-4f04-aa36-f6335e9dfd3b None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:08.816683 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa55b1-4c22-4f04-aa36-f6335e9dfd3b None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:08.816783 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa55b1-4c22-4f04-aa36-f6335e9dfd3b None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:08.820853 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 4/6] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 11:44:08.826485 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22dd764-0f00-4b99-8146-3558f68af176 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:08.826885 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22dd764-0f00-4b99-8146-3558f68af176 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:08.827124 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22dd764-0f00-4b99-8146-3558f68af176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:08.845735 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-f22dd764-0f00-4b99-8146-3558f68af176 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:08.847827 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-f22dd764-0f00-4b99-8146-3558f68af176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:08.855574 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 3/7] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 03 11:44:08.877871 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa55b1-4c22-4f04-aa36-f6335e9dfd3b None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:08.890070 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa55b1-4c22-4f04-aa36-f6335e9dfd3b None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:08.894354 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d12f54-6dc3-4313-b67e-19d463b1fc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:08.894990 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d12f54-6dc3-4313-b67e-19d463b1fc24 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:08.895282 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d12f54-6dc3-4313-b67e-19d463b1fc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:08.895593 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d12f54-6dc3-4313-b67e-19d463b1fc24 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:08.903861 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d12f54-6dc3-4313-b67e-19d463b1fc24 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:08.905641 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d12f54-6dc3-4313-b67e-19d463b1fc24 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:08.914939 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 5/8] 10.222.0.15 () {58 vars in 1324 bytes} [Fri Jun 3 11:44:08 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 11:44:08.920451 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22dd764-0f00-4b99-8146-3558f68af176 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:08.929963 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22dd764-0f00-4b99-8146-3558f68af176 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:08.934313 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf77ba-54e2-4d7b-ba59-ee5d7cf2cfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:08.935174 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf77ba-54e2-4d7b-ba59-ee5d7cf2cfd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:08.935456 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf77ba-54e2-4d7b-ba59-ee5d7cf2cfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:08.935770 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf77ba-54e2-4d7b-ba59-ee5d7cf2cfd7 admin admin] PATH_INFO: `/v3/users/0616a4eb01db4ae8ac6d10f710fd1630` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:08.937151 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf77ba-54e2-4d7b-ba59-ee5d7cf2cfd7 admin admin] RBAC: Authorizing `identity:get_user(user_id=0616a4eb01db4ae8ac6d10f710fd1630)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:08.938967 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf77ba-54e2-4d7b-ba59-ee5d7cf2cfd7 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:08.940560 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 4/9] 10.222.0.15 () {56 vars in 1198 bytes} [Fri Jun 3 11:44:08 2022] GET /identity/v3/users/0616a4eb01db4ae8ac6d10f710fd1630 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:11.188443 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bd11f-6190-413c-af02-7471cc4ec7e6 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:11.188944 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bd11f-6190-413c-af02-7471cc4ec7e6 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:11.188944 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bd11f-6190-413c-af02-7471cc4ec7e6 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:11.190791 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 6/10] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:44:11.196179 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e6533-3ff5-4e8c-8799-e00f73ee7f70 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:11.196603 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e6533-3ff5-4e8c-8799-e00f73ee7f70 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:11.196751 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e6533-3ff5-4e8c-8799-e00f73ee7f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:11.213822 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-fc1e6533-3ff5-4e8c-8799-e00f73ee7f70 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:11.214995 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-fc1e6533-3ff5-4e8c-8799-e00f73ee7f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:11.239831 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94125d7-70b4-4b90-b99d-cb89c03c5e6c None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:11.240118 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94125d7-70b4-4b90-b99d-cb89c03c5e6c None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:11.240395 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94125d7-70b4-4b90-b99d-cb89c03c5e6c None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:11.241725 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 7/11] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 11:44:11.246867 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677955a2-4c88-4550-9cb1-9ca1a69ab044 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:11.247155 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677955a2-4c88-4550-9cb1-9ca1a69ab044 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:11.247433 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677955a2-4c88-4550-9cb1-9ca1a69ab044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:11.287856 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG passlib.handlers.bcrypt [None req-677955a2-4c88-4550-9cb1-9ca1a69ab044 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80110) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 03 11:44:11.288295 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG passlib.handlers.bcrypt [None req-677955a2-4c88-4550-9cb1-9ca1a69ab044 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80110) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 03 11:44:11.294764 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 5/12] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 11:44:11.318358 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e6533-3ff5-4e8c-8799-e00f73ee7f70 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:11.335854 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-677955a2-4c88-4550-9cb1-9ca1a69ab044 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:11.337428 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-677955a2-4c88-4550-9cb1-9ca1a69ab044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:11.340843 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:11.420425 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e6533-3ff5-4e8c-8799-e00f73ee7f70 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:11.438005 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 8/13] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 11:44:11.455016 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168603f5-6788-41b0-a831-0a7e970db3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:11.455788 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168603f5-6788-41b0-a831-0a7e970db3e3 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:11.456076 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168603f5-6788-41b0-a831-0a7e970db3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:11.456355 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168603f5-6788-41b0-a831-0a7e970db3e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:11.460221 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677955a2-4c88-4550-9cb1-9ca1a69ab044 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:11.467995 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168603f5-6788-41b0-a831-0a7e970db3e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:44:11.479060 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-168603f5-6788-41b0-a831-0a7e970db3e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:44:11.479060 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:44:11.479060 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:44:11.479060 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:44:11.479060 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:44:11.479060 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:44:11.479060 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:44:11.479060 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:44:11.479060 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:44:11.479060 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:44:11.479060 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:44:11.479060 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:44:11.479060 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:44:11.479060 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:44:11.479060 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:44:11.479060 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:44:11.480245 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:44:11.480245 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:44:11.480245 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:44:11.480245 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:44:11.480245 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:44:11.480245 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:44:11.480245 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:44:11.480245 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:44:11.480245 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:44:11.480245 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:44:11.480245 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:44:11.480245 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:44:11.480245 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:44:11.480245 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:44:11.480245 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:44:11.480245 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:44:11.481077 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:44:11.481077 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:44:11.481077 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:44:11.481077 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:44:11.481077 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:44:11.481077 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:44:11.481077 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:44:11.481077 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:44:11.481077 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:44:11.481077 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:44:11.481077 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:44:11.481077 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:44:11.481077 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 6/14] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 3 11:44:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:44:11.485989 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168603f5-6788-41b0-a831-0a7e970db3e3 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:11.560682 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677955a2-4c88-4550-9cb1-9ca1a69ab044 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:11.563220 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:11.567451 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:11.585785 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168603f5-6788-41b0-a831-0a7e970db3e3 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:11.599252 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015fde4-5eba-422a-a2e0-8e5ee2193964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:11.600208 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015fde4-5eba-422a-a2e0-8e5ee2193964 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:11.600491 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015fde4-5eba-422a-a2e0-8e5ee2193964 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:11.600764 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015fde4-5eba-422a-a2e0-8e5ee2193964 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:11.619352 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a22667d-3ee1-4632-b073-c65d868d8408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:11.620122 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a22667d-3ee1-4632-b073-c65d868d8408 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:11.620401 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a22667d-3ee1-4632-b073-c65d868d8408 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:11.620676 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a22667d-3ee1-4632-b073-c65d868d8408 None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:11.621420 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a22667d-3ee1-4632-b073-c65d868d8408 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:11.621729 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a22667d-3ee1-4632-b073-c65d868d8408 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:11.623124 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a22667d-3ee1-4632-b073-c65d868d8408 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:11.635883 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 7/15] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:44:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:44:11.641289 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a22667d-3ee1-4632-b073-c65d868d8408 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:11.669129 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6015fde4-5eba-422a-a2e0-8e5ee2193964 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:11.670644 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6015fde4-5eba-422a-a2e0-8e5ee2193964 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:11.739916 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a22667d-3ee1-4632-b073-c65d868d8408 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:11.766079 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 9/16] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:44:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 03 11:44:11.771604 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015fde4-5eba-422a-a2e0-8e5ee2193964 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:11.772919 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf56499-65ad-4355-8104-7be752b0eeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:11.774054 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf56499-65ad-4355-8104-7be752b0eeac None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:11.774341 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf56499-65ad-4355-8104-7be752b0eeac None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:11.774630 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf56499-65ad-4355-8104-7be752b0eeac None admin] PATH_INFO: `/v3/users/0616a4eb01db4ae8ac6d10f710fd1630` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:11.774766 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:11.775901 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf56499-65ad-4355-8104-7be752b0eeac None admin] RBAC: Authorizing `identity:get_user(user_id=0616a4eb01db4ae8ac6d10f710fd1630)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:11.777487 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf56499-65ad-4355-8104-7be752b0eeac None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:11.779318 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 8/17] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:44:11 2022] GET /identity/v3/users/0616a4eb01db4ae8ac6d10f710fd1630 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:44:11.784940 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf56499-65ad-4355-8104-7be752b0eeac None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:11.798923 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:11.871017 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015fde4-5eba-422a-a2e0-8e5ee2193964 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:11.882739 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf56499-65ad-4355-8104-7be752b0eeac None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:11.906048 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed0933-713f-4217-9272-764771a48483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:11.906841 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed0933-713f-4217-9272-764771a48483 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:11.907126 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed0933-713f-4217-9272-764771a48483 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:11.907402 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed0933-713f-4217-9272-764771a48483 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:11.917016 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e6de25-41b9-42d8-9b2f-8a5180385006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:11.917803 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6de25-41b9-42d8-9b2f-8a5180385006 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:11.918083 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6de25-41b9-42d8-9b2f-8a5180385006 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:11.918353 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6de25-41b9-42d8-9b2f-8a5180385006 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:11.919543 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e6de25-41b9-42d8-9b2f-8a5180385006 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:11.920993 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e6de25-41b9-42d8-9b2f-8a5180385006 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:11.922567 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 9/18] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:44:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:44:11.926792 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed0933-713f-4217-9272-764771a48483 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:11.928288 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed0933-713f-4217-9272-764771a48483 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:11.928784 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e6de25-41b9-42d8-9b2f-8a5180385006 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:11.948812 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-53ed0933-713f-4217-9272-764771a48483 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:44:11.948812 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:44:11.948812 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:44:11.948812 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:44:11.948812 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:44:11.948812 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:44:11.948812 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:44:11.948812 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:44:11.948812 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:44:11.948812 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:44:11.948812 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:44:11.948812 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:44:11.948812 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:44:11.948812 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:44:11.948812 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:44:11.949607 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:44:11.949607 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:44:11.949607 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:44:11.949607 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:44:11.949607 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:44:11.949607 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:44:11.949607 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:44:11.949607 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:44:11.949607 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:44:11.949607 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:44:11.949607 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:44:11.949607 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:44:11.949607 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:44:11.949607 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:44:11.949607 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:44:11.949607 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:44:11.949607 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:44:11.950399 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:44:11.950399 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:44:11.950399 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:44:11.950399 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:44:11.950399 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 10/19] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:44:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:44:11.956567 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed0933-713f-4217-9272-764771a48483 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:12.010556 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:12.012640 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:12.031097 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e6de25-41b9-42d8-9b2f-8a5180385006 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:12.059248 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed0933-713f-4217-9272-764771a48483 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:12.064622 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407e699-9efc-4ad5-88ea-86f43e7f621d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:12.065306 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407e699-9efc-4ad5-88ea-86f43e7f621d None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:12.065608 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407e699-9efc-4ad5-88ea-86f43e7f621d None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:12.065884 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407e699-9efc-4ad5-88ea-86f43e7f621d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:12.066717 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407e699-9efc-4ad5-88ea-86f43e7f621d None admin] RBAC: Adding query filter params (role.id=c486e164840b41a59fd118dece2ce572, scope.domain.id=default, user.id=0616a4eb01db4ae8ac6d10f710fd1630) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:12.067027 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407e699-9efc-4ad5-88ea-86f43e7f621d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:12.068655 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407e699-9efc-4ad5-88ea-86f43e7f621d None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:12.075246 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 10/20] 10.222.0.15 () {56 vars in 1322 bytes} [Fri Jun 3 11:44:11 2022] GET /identity/v3/role_assignments?user.id=0616a4eb01db4ae8ac6d10f710fd1630&scope.domain.id=default&role.id=c486e164840b41a59fd118dece2ce572 => generated 233 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:44:12.093879 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231e229-8e41-4e84-b358-f1ddbc7346b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:12.094570 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231e229-8e41-4e84-b358-f1ddbc7346b6 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:12.094860 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231e229-8e41-4e84-b358-f1ddbc7346b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:12.095134 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231e229-8e41-4e84-b358-f1ddbc7346b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:12.095917 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0231e229-8e41-4e84-b358-f1ddbc7346b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:12.096227 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0231e229-8e41-4e84-b358-f1ddbc7346b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:12.098252 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0231e229-8e41-4e84-b358-f1ddbc7346b6 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:12.117975 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 11/21] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:44:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:44:14.634255 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5cdbbd-0ac2-4a92-98b2-b013b1a8b50b None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:14.635321 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5cdbbd-0ac2-4a92-98b2-b013b1a8b50b None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:14.635828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5cdbbd-0ac2-4a92-98b2-b013b1a8b50b None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:14.637410 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 11/22] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:44:14.642997 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c0e58-dcc9-4b20-8381-c643d6455bb4 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:14.643892 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c0e58-dcc9-4b20-8381-c643d6455bb4 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:14.644385 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c0e58-dcc9-4b20-8381-c643d6455bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:14.677375 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-8b8c0e58-dcc9-4b20-8381-c643d6455bb4 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:14.678895 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-8b8c0e58-dcc9-4b20-8381-c643d6455bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:14.765386 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 12/23] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:44:14.783804 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d2bfd-15d1-4ff1-9bd3-f4198dabc2ac None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:14.784457 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d2bfd-15d1-4ff1-9bd3-f4198dabc2ac None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:14.784935 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d2bfd-15d1-4ff1-9bd3-f4198dabc2ac None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:14.786486 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 12/24] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:44:14.791740 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af89f93-3c82-4926-910d-da8fb86dec11 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:14.792252 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af89f93-3c82-4926-910d-da8fb86dec11 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:14.792739 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af89f93-3c82-4926-910d-da8fb86dec11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:14.807117 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d2bfd-15d1-4ff1-9bd3-f4198dabc2ac None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:14.832656 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-1af89f93-3c82-4926-910d-da8fb86dec11 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:14.834318 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-1af89f93-3c82-4926-910d-da8fb86dec11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:14.917577 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:14.993435 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 13/25] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:44:15.008689 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d2bfd-15d1-4ff1-9bd3-f4198dabc2ac None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:15.026574 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af89f93-3c82-4926-910d-da8fb86dec11 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:15.067243 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9346e5f-4bfe-407b-ae82-795755df985b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:15.068557 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9346e5f-4bfe-407b-ae82-795755df985b None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:15.068847 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9346e5f-4bfe-407b-ae82-795755df985b None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:15.069126 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9346e5f-4bfe-407b-ae82-795755df985b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:15.091163 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9346e5f-4bfe-407b-ae82-795755df985b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:44:15.100298 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-d9346e5f-4bfe-407b-ae82-795755df985b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:44:15.100298 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:44:15.100298 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:44:15.100298 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:44:15.100298 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:44:15.100298 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:44:15.100298 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:44:15.100298 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:44:15.100298 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:44:15.100298 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:44:15.100298 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:44:15.100298 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:44:15.100298 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:44:15.100298 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:44:15.100298 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:44:15.100298 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:44:15.101154 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:44:15.101154 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:44:15.101154 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:44:15.101154 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:44:15.101154 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:44:15.101154 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:44:15.101154 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:44:15.101154 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:44:15.101154 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:44:15.101154 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:44:15.101154 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:44:15.101154 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:44:15.101154 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:44:15.101154 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:44:15.101154 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:44:15.101154 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:44:15.101909 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:44:15.101909 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:44:15.101909 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:44:15.101909 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:44:15.101909 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:44:15.101909 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:44:15.101909 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:44:15.101909 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:44:15.101909 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:44:15.101909 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:44:15.101909 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:44:15.101909 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:44:15.108919 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 13/26] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 3 11:44:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:44:15.115431 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9346e5f-4bfe-407b-ae82-795755df985b None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:15.135845 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:15.246141 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af89f93-3c82-4926-910d-da8fb86dec11 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:15.276250 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9346e5f-4bfe-407b-ae82-795755df985b None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:15.321404 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec4382-fc31-458a-82a8-9779b132cd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:15.322214 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec4382-fc31-458a-82a8-9779b132cd67 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:15.322496 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec4382-fc31-458a-82a8-9779b132cd67 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:15.322772 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec4382-fc31-458a-82a8-9779b132cd67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:15.323917 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e99bdc-74cc-4032-94b8-6ab7e3a12fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:15.324642 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e99bdc-74cc-4032-94b8-6ab7e3a12fb3 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:15.324923 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e99bdc-74cc-4032-94b8-6ab7e3a12fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:15.325191 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e99bdc-74cc-4032-94b8-6ab7e3a12fb3 None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:15.325965 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e99bdc-74cc-4032-94b8-6ab7e3a12fb3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:15.326268 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e99bdc-74cc-4032-94b8-6ab7e3a12fb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:15.327737 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e99bdc-74cc-4032-94b8-6ab7e3a12fb3 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:15.349420 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 14/27] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:44:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:44:15.350928 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec4382-fc31-458a-82a8-9779b132cd67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:15.352460 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec4382-fc31-458a-82a8-9779b132cd67 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:15.354203 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98010c50-11de-4663-ba74-c54bdf9686e7 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:15.354473 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98010c50-11de-4663-ba74-c54bdf9686e7 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:15.354751 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98010c50-11de-4663-ba74-c54bdf9686e7 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:15.356651 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 15/28] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:44:15.359544 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98010c50-11de-4663-ba74-c54bdf9686e7 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:15.378276 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-20ec4382-fc31-458a-82a8-9779b132cd67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:44:15.378276 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:44:15.378276 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:44:15.378276 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:44:15.378276 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:44:15.378276 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:44:15.378276 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:44:15.378276 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:44:15.378276 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:44:15.378276 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:44:15.378276 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:44:15.378276 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:44:15.378276 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:44:15.378276 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:44:15.378276 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:44:15.379229 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:44:15.379229 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:44:15.379229 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:44:15.379229 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:44:15.379229 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:44:15.379229 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:44:15.379229 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:44:15.379229 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:44:15.379229 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:44:15.379229 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:44:15.379229 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:44:15.379229 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:44:15.379229 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:44:15.379229 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:44:15.379229 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:44:15.379229 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:44:15.379229 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:44:15.380565 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:44:15.380565 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:44:15.380565 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:44:15.380565 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:44:15.380565 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 14/29] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:44:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:44:15.381182 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a9209-f42c-410c-bfe1-af310d02d51e None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:15.381182 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a9209-f42c-410c-bfe1-af310d02d51e None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:15.381463 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a9209-f42c-410c-bfe1-af310d02d51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:15.404756 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-063a9209-f42c-410c-bfe1-af310d02d51e None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:15.405989 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-063a9209-f42c-410c-bfe1-af310d02d51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:15.430621 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:15.478848 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 15/30] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:44:15.479964 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063a9209-f42c-410c-bfe1-af310d02d51e None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:15.542793 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:15.621712 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98010c50-11de-4663-ba74-c54bdf9686e7 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:15.625071 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063a9209-f42c-410c-bfe1-af310d02d51e None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:15.685812 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6f2d8-4f2e-4a6b-8698-8648dc9f8511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:15.687657 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6f2d8-4f2e-4a6b-8698-8648dc9f8511 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:15.688012 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6f2d8-4f2e-4a6b-8698-8648dc9f8511 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:15.688298 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6f2d8-4f2e-4a6b-8698-8648dc9f8511 None admin] PATH_INFO: `/v3/users/0616a4eb01db4ae8ac6d10f710fd1630` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:15.691584 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6f2d8-4f2e-4a6b-8698-8648dc9f8511 None admin] RBAC: Authorizing `identity:get_user(user_id=0616a4eb01db4ae8ac6d10f710fd1630)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:15.693066 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6f2d8-4f2e-4a6b-8698-8648dc9f8511 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:15.694873 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 16/31] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:44:15 2022] GET /identity/v3/users/0616a4eb01db4ae8ac6d10f710fd1630 => generated 247 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:15.695448 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6f2d8-4f2e-4a6b-8698-8648dc9f8511 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:15.699906 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d9c8b-b022-4ad0-b86b-545a0f8310e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:15.700582 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d9c8b-b022-4ad0-b86b-545a0f8310e5 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:15.700865 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d9c8b-b022-4ad0-b86b-545a0f8310e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:15.701147 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d9c8b-b022-4ad0-b86b-545a0f8310e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:15.701888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d9c8b-b022-4ad0-b86b-545a0f8310e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:15.702196 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d9c8b-b022-4ad0-b86b-545a0f8310e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:15.703620 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d9c8b-b022-4ad0-b86b-545a0f8310e5 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:15.727727 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 16/32] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:44:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:15.730063 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d9c8b-b022-4ad0-b86b-545a0f8310e5 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:15.762144 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:15.834990 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6f2d8-4f2e-4a6b-8698-8648dc9f8511 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:15.867401 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d9c8b-b022-4ad0-b86b-545a0f8310e5 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:15.870829 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f45a50-b9b0-49f5-ade6-41cd9f4d0007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:15.871527 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f45a50-b9b0-49f5-ade6-41cd9f4d0007 None admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:15.871884 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f45a50-b9b0-49f5-ade6-41cd9f4d0007 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:15.872167 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f45a50-b9b0-49f5-ade6-41cd9f4d0007 None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:15.872973 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f45a50-b9b0-49f5-ade6-41cd9f4d0007 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:15.874364 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f45a50-b9b0-49f5-ade6-41cd9f4d0007 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:15.876881 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:15.911721 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907e01a-d837-405d-a973-bbb972d2ee38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:15.912517 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907e01a-d837-405d-a973-bbb972d2ee38 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:15.912801 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907e01a-d837-405d-a973-bbb972d2ee38 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:15.913073 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907e01a-d837-405d-a973-bbb972d2ee38 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:15.914468 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9907e01a-d837-405d-a973-bbb972d2ee38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:15.915941 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9907e01a-d837-405d-a973-bbb972d2ee38 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:15.917697 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 17/33] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:44:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:15.918536 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907e01a-d837-405d-a973-bbb972d2ee38 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:16.007804 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 17/34] 10.222.0.15 () {60 vars in 1131 bytes} [Fri Jun 3 11:44:15 2022] POST /identity/v3/roles => generated 219 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:44:16.010731 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:16.013286 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c2a8f-5227-400e-a233-a3bc1cbe223e None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:16.013587 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c2a8f-5227-400e-a233-a3bc1cbe223e None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:16.013907 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c2a8f-5227-400e-a233-a3bc1cbe223e None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:16.019423 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 18/35] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:44:16.020000 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21646bfe-52d8-4cb9-9b55-ccdae303d05f None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:16.020336 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21646bfe-52d8-4cb9-9b55-ccdae303d05f None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:16.020956 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21646bfe-52d8-4cb9-9b55-ccdae303d05f None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:16.022882 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 19/36] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:44:16.024747 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21646bfe-52d8-4cb9-9b55-ccdae303d05f None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:16.037225 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907e01a-d837-405d-a973-bbb972d2ee38 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:16.076121 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51000ecd-e884-4076-9898-af760473280f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:16.076961 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51000ecd-e884-4076-9898-af760473280f None admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:16.077366 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51000ecd-e884-4076-9898-af760473280f None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:16.077743 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51000ecd-e884-4076-9898-af760473280f None admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:16.078575 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51000ecd-e884-4076-9898-af760473280f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:16.080230 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51000ecd-e884-4076-9898-af760473280f None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:16.169617 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21646bfe-52d8-4cb9-9b55-ccdae303d05f None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:16.209943 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922d87d-d4cc-4d78-9ff3-27aa3f9c19dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:16.210838 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922d87d-d4cc-4d78-9ff3-27aa3f9c19dd None admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:16.211129 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922d87d-d4cc-4d78-9ff3-27aa3f9c19dd None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:16.211409 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922d87d-d4cc-4d78-9ff3-27aa3f9c19dd None admin] PATH_INFO: `/v3/domains/default/users/0616a4eb01db4ae8ac6d10f710fd1630/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:16.213688 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922d87d-d4cc-4d78-9ff3-27aa3f9c19dd None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=0616a4eb01db4ae8ac6d10f710fd1630, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:16.215274 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922d87d-d4cc-4d78-9ff3-27aa3f9c19dd None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:16.232915 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 20/37] 10.222.0.15 () {58 vars in 1361 bytes} [Fri Jun 3 11:44:16 2022] PUT /identity/v3/domains/default/users/0616a4eb01db4ae8ac6d10f710fd1630/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:44:16.234353 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a4958-79d6-4ee0-8a79-ce7f596ab4da None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:16.234705 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a4958-79d6-4ee0-8a79-ce7f596ab4da None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:16.235039 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a4958-79d6-4ee0-8a79-ce7f596ab4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:16.247953 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 18/38] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Jun 3 11:44:15 2022] POST /identity/v3/projects => generated 301 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:44:16.249856 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da41b22-887c-4144-9609-a0d0e4f8f89a None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:16.250192 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da41b22-887c-4144-9609-a0d0e4f8f89a None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:16.250483 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da41b22-887c-4144-9609-a0d0e4f8f89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:16.255920 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-e90a4958-79d6-4ee0-8a79-ce7f596ab4da None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:16.257788 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-e90a4958-79d6-4ee0-8a79-ce7f596ab4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:16.282220 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-4da41b22-887c-4144-9609-a0d0e4f8f89a None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:16.283920 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-4da41b22-887c-4144-9609-a0d0e4f8f89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:16.325371 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:16.349760 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 21/39] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:44:16.373988 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a4958-79d6-4ee0-8a79-ce7f596ab4da None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:16.390282 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 19/40] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:44:16.428405 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da41b22-887c-4144-9609-a0d0e4f8f89a None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:16.490621 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a4958-79d6-4ee0-8a79-ce7f596ab4da None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:16.516986 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:16.529988 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26809e-2480-4bea-a421-4d71c80f91da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:16.530691 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26809e-2480-4bea-a421-4d71c80f91da None admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:16.530981 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26809e-2480-4bea-a421-4d71c80f91da None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:16.531260 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26809e-2480-4bea-a421-4d71c80f91da None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:16.532081 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26809e-2480-4bea-a421-4d71c80f91da None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:16.533526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26809e-2480-4bea-a421-4d71c80f91da None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:16.561884 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da41b22-887c-4144-9609-a0d0e4f8f89a None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:16.562395 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 22/41] 10.222.0.15 () {60 vars in 1131 bytes} [Fri Jun 3 11:44:16 2022] POST /identity/v3/roles => generated 225 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:44:16.563981 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe35629-9c3b-4695-b8f0-1849344543c4 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:16.564283 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe35629-9c3b-4695-b8f0-1849344543c4 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:16.564668 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe35629-9c3b-4695-b8f0-1849344543c4 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:16.566107 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 23/42] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:44:16.572238 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81496f12-ddd4-4e92-b5cd-8d9fb243801d None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:16.572551 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81496f12-ddd4-4e92-b5cd-8d9fb243801d None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:16.572906 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81496f12-ddd4-4e92-b5cd-8d9fb243801d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:16.594023 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-81496f12-ddd4-4e92-b5cd-8d9fb243801d None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:16.595581 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-81496f12-ddd4-4e92-b5cd-8d9fb243801d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:16.605964 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a047717-9827-451a-a23c-ac751bc41859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:16.606662 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a047717-9827-451a-a23c-ac751bc41859 None admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:16.606952 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a047717-9827-451a-a23c-ac751bc41859 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:16.607235 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a047717-9827-451a-a23c-ac751bc41859 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:16.608279 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a047717-9827-451a-a23c-ac751bc41859 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:16.610165 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a047717-9827-451a-a23c-ac751bc41859 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:16.632318 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 20/43] 10.222.0.15 () {60 vars in 1131 bytes} [Fri Jun 3 11:44:16 2022] POST /identity/v3/roles => generated 223 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 11:44:16.657252 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:16.697787 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 24/44] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:44:16.722837 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a047717-9827-451a-a23c-ac751bc41859 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:16.870976 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a047717-9827-451a-a23c-ac751bc41859 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:16.903361 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:16.912833 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad434b-1d62-4be5-ac42-4a6ee4bfd5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:16.914017 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad434b-1d62-4be5-ac42-4a6ee4bfd5b5 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:16.914814 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad434b-1d62-4be5-ac42-4a6ee4bfd5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:16.915115 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad434b-1d62-4be5-ac42-4a6ee4bfd5b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:16.916445 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad434b-1d62-4be5-ac42-4a6ee4bfd5b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:16.918083 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad434b-1d62-4be5-ac42-4a6ee4bfd5b5 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:16.920086 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 21/45] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:44:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:16.926207 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81496f12-ddd4-4e92-b5cd-8d9fb243801d None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:17.029716 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81496f12-ddd4-4e92-b5cd-8d9fb243801d None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:17.062720 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7568ae1-ffc0-4ba5-9cea-dcd897c4b5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:17.063391 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7568ae1-ffc0-4ba5-9cea-dcd897c4b5c6 None admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:17.063714 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7568ae1-ffc0-4ba5-9cea-dcd897c4b5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:17.063996 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7568ae1-ffc0-4ba5-9cea-dcd897c4b5c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:17.064730 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7568ae1-ffc0-4ba5-9cea-dcd897c4b5c6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:17.066751 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7568ae1-ffc0-4ba5-9cea-dcd897c4b5c6 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:17.092650 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 25/46] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Jun 3 11:44:16 2022] POST /identity/v3/projects => generated 312 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:44:18.688020 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b8b77-fa37-4eae-8fcc-2b720deda078 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:18.688541 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b8b77-fa37-4eae-8fcc-2b720deda078 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:18.688651 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b8b77-fa37-4eae-8fcc-2b720deda078 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:18.689950 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 22/47] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:44:18.695620 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4ca73-a587-4d52-b8eb-a179a47f1ac8 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:18.696050 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4ca73-a587-4d52-b8eb-a179a47f1ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:18.696177 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4ca73-a587-4d52-b8eb-a179a47f1ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:18.713114 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-8ba4ca73-a587-4d52-b8eb-a179a47f1ac8 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:18.714268 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-8ba4ca73-a587-4d52-b8eb-a179a47f1ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:18.733697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:18.781074 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 26/48] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:44:18.804033 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b8b77-fa37-4eae-8fcc-2b720deda078 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:18.907996 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b8b77-fa37-4eae-8fcc-2b720deda078 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:18.942035 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ba99d-b87c-43ce-b537-c1202a74857f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:18.942762 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ba99d-b87c-43ce-b537-c1202a74857f None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:18.943047 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ba99d-b87c-43ce-b537-c1202a74857f None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:18.943324 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ba99d-b87c-43ce-b537-c1202a74857f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:18.954272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697ba99d-b87c-43ce-b537-c1202a74857f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:44:18.962914 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-697ba99d-b87c-43ce-b537-c1202a74857f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:44:18.962914 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:44:18.962914 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:44:18.962914 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:44:18.962914 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:44:18.962914 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:44:18.962914 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:44:18.962914 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:44:18.962914 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:44:18.962914 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:44:18.962914 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:44:18.962914 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:44:18.962914 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:44:18.962914 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:44:18.962914 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:44:18.962914 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:44:18.963895 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:44:18.963895 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:44:18.963895 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:44:18.963895 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:44:18.963895 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:44:18.963895 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:44:18.963895 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:44:18.963895 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:44:18.963895 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:44:18.963895 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:44:18.963895 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:44:18.963895 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:44:18.963895 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:44:18.963895 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:44:18.963895 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:44:18.963895 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:44:18.969345 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:44:18.969345 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:44:18.969345 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:44:18.969345 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:44:18.969345 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:44:18.969345 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:44:18.969345 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:44:18.969345 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:44:18.969345 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:44:18.969345 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:44:18.969345 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:44:18.969345 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:44:18.969345 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 23/49] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 3 11:44:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:44:18.971194 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4ca73-a587-4d52-b8eb-a179a47f1ac8 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:19.071212 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4ca73-a587-4d52-b8eb-a179a47f1ac8 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:19.110391 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b6eff-80eb-4c75-8fd8-efc1854923e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:19.111069 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b6eff-80eb-4c75-8fd8-efc1854923e6 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:19.111351 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b6eff-80eb-4c75-8fd8-efc1854923e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:19.111655 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b6eff-80eb-4c75-8fd8-efc1854923e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:19.113022 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b6eff-80eb-4c75-8fd8-efc1854923e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:19.113328 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b6eff-80eb-4c75-8fd8-efc1854923e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:19.114721 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b6eff-80eb-4c75-8fd8-efc1854923e6 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:19.122864 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 27/50] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:44:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:19.128342 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ba99d-b87c-43ce-b537-c1202a74857f None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:19.184116 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:19.227367 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ba99d-b87c-43ce-b537-c1202a74857f None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:19.260435 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7299ae87-f574-49d6-8fdd-318f96e04b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:19.261315 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7299ae87-f574-49d6-8fdd-318f96e04b19 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:19.261603 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7299ae87-f574-49d6-8fdd-318f96e04b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:19.261886 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7299ae87-f574-49d6-8fdd-318f96e04b19 None admin] PATH_INFO: `/v3/users/0616a4eb01db4ae8ac6d10f710fd1630` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:19.263309 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7299ae87-f574-49d6-8fdd-318f96e04b19 None admin] RBAC: Authorizing `identity:get_user(user_id=0616a4eb01db4ae8ac6d10f710fd1630)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:19.264813 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7299ae87-f574-49d6-8fdd-318f96e04b19 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:19.266446 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 24/51] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:44:19 2022] GET /identity/v3/users/0616a4eb01db4ae8ac6d10f710fd1630 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:44:19.271906 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b6eff-80eb-4c75-8fd8-efc1854923e6 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:19.291458 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:19.322794 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760acffe-6e04-491c-b39b-4750dd079bce None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:19.323083 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760acffe-6e04-491c-b39b-4750dd079bce None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:19.323364 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760acffe-6e04-491c-b39b-4750dd079bce None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:19.324750 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 25/52] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 11:44:19.329500 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca257e87-43d5-40b7-ae67-be48f2bf3977 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:19.329791 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca257e87-43d5-40b7-ae67-be48f2bf3977 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:19.330071 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca257e87-43d5-40b7-ae67-be48f2bf3977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:19.346973 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-ca257e87-43d5-40b7-ae67-be48f2bf3977 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:19.348202 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-ca257e87-43d5-40b7-ae67-be48f2bf3977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:19.371637 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b6eff-80eb-4c75-8fd8-efc1854923e6 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:19.404648 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e556f561-b501-4335-9459-36db2c40df16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:19.405436 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556f561-b501-4335-9459-36db2c40df16 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:19.405726 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556f561-b501-4335-9459-36db2c40df16 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:19.406004 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556f561-b501-4335-9459-36db2c40df16 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:19.407287 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e556f561-b501-4335-9459-36db2c40df16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:19.408761 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e556f561-b501-4335-9459-36db2c40df16 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:19.410922 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 28/53] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:44:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:19.416465 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e556f561-b501-4335-9459-36db2c40df16 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:19.417367 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 26/54] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 11:44:19.440314 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca257e87-43d5-40b7-ae67-be48f2bf3977 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:19.494193 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:19.499203 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:19.513927 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e556f561-b501-4335-9459-36db2c40df16 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:19.539933 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca257e87-43d5-40b7-ae67-be48f2bf3977 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:19.547398 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0146cd-3a48-464f-a053-29f47c38ab85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:19.548153 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0146cd-3a48-464f-a053-29f47c38ab85 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:19.548442 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0146cd-3a48-464f-a053-29f47c38ab85 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:19.548718 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0146cd-3a48-464f-a053-29f47c38ab85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:19.549547 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0146cd-3a48-464f-a053-29f47c38ab85 None admin] RBAC: Adding query filter params (role.id=c486e164840b41a59fd118dece2ce572, scope.domain.id=default, user.id=0616a4eb01db4ae8ac6d10f710fd1630) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:19.549886 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0146cd-3a48-464f-a053-29f47c38ab85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:19.551344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0146cd-3a48-464f-a053-29f47c38ab85 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:19.557323 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 29/55] 10.222.0.15 () {56 vars in 1322 bytes} [Fri Jun 3 11:44:19 2022] GET /identity/v3/role_assignments?user.id=0616a4eb01db4ae8ac6d10f710fd1630&scope.domain.id=default&role.id=c486e164840b41a59fd118dece2ce572 => generated 530 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:44:19.574716 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9149c-c2cd-452d-b989-39e162b07696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:19.575557 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9149c-c2cd-452d-b989-39e162b07696 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:19.575846 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9149c-c2cd-452d-b989-39e162b07696 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:19.576124 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9149c-c2cd-452d-b989-39e162b07696 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:19.577406 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd9149c-c2cd-452d-b989-39e162b07696 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:19.578918 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd9149c-c2cd-452d-b989-39e162b07696 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:19.580654 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 27/56] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:44:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:44:19.587193 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0146cd-3a48-464f-a053-29f47c38ab85 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:19.699460 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0146cd-3a48-464f-a053-29f47c38ab85 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:19.733383 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1ac0f-406d-474b-9a0c-19dd37c8197f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:19.734056 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1ac0f-406d-474b-9a0c-19dd37c8197f None admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:19.734338 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1ac0f-406d-474b-9a0c-19dd37c8197f None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:19.734614 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1ac0f-406d-474b-9a0c-19dd37c8197f None admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:19.735336 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e1ac0f-406d-474b-9a0c-19dd37c8197f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:19.736826 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e1ac0f-406d-474b-9a0c-19dd37c8197f None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:19.764228 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 30/57] 10.222.0.15 () {60 vars in 1140 bytes} [Fri Jun 3 11:44:19 2022] POST /identity/v3/projects => generated 298 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:44:21.985956 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ee5ba-c619-41f6-8bc5-3388f917392e None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:21.986409 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ee5ba-c619-41f6-8bc5-3388f917392e None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:21.986492 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ee5ba-c619-41f6-8bc5-3388f917392e None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:21.988393 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 28/58] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:44:21.993627 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b13af5-420d-441f-9c9e-658b39c2b95a None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:21.994012 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b13af5-420d-441f-9c9e-658b39c2b95a None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:21.994191 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b13af5-420d-441f-9c9e-658b39c2b95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:21.999207 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:22.013349 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-92b13af5-420d-441f-9c9e-658b39c2b95a None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:22.014546 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-92b13af5-420d-441f-9c9e-658b39c2b95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:22.079159 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 31/59] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:44:22.103416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ee5ba-c619-41f6-8bc5-3388f917392e None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:22.201043 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ee5ba-c619-41f6-8bc5-3388f917392e None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:22.222927 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:22.238292 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d2813-6a19-4a84-a51d-53996df8cc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:22.239379 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d2813-6a19-4a84-a51d-53996df8cc85 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:22.239890 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d2813-6a19-4a84-a51d-53996df8cc85 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:22.240177 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d2813-6a19-4a84-a51d-53996df8cc85 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:22.241349 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d2813-6a19-4a84-a51d-53996df8cc85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:22.242788 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d2813-6a19-4a84-a51d-53996df8cc85 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:22.244436 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 29/60] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:44:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:22.249820 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b13af5-420d-441f-9c9e-658b39c2b95a None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:22.346942 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b13af5-420d-441f-9c9e-658b39c2b95a None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:22.375305 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:22.381143 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68c257-2037-434c-8f94-39eb59229d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:22.381811 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68c257-2037-434c-8f94-39eb59229d0d None admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:22.382097 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68c257-2037-434c-8f94-39eb59229d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:22.382380 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68c257-2037-434c-8f94-39eb59229d0d None admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:22.383096 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf68c257-2037-434c-8f94-39eb59229d0d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:22.384588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf68c257-2037-434c-8f94-39eb59229d0d None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:22.409614 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 32/61] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Jun 3 11:44:22 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:44:25.809917 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d70c2a-89ae-4599-9955-8b8df6c55dcb None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:25.810839 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d70c2a-89ae-4599-9955-8b8df6c55dcb None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:25.811293 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d70c2a-89ae-4599-9955-8b8df6c55dcb None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:25.812871 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 30/62] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:44:25.819036 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d36b64-f92f-4515-8b4e-98e6fe839bde None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:25.819860 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d36b64-f92f-4515-8b4e-98e6fe839bde None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:25.820315 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d36b64-f92f-4515-8b4e-98e6fe839bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:25.844526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-f8d36b64-f92f-4515-8b4e-98e6fe839bde None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:25.846051 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-f8d36b64-f92f-4515-8b4e-98e6fe839bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:25.900447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0844e-dfcc-40c2-a3eb-efb8c4aebe3f None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:25.900447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0844e-dfcc-40c2-a3eb-efb8c4aebe3f None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:25.900447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0844e-dfcc-40c2-a3eb-efb8c4aebe3f None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:25.902992 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 31/63] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:44:25.911514 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324c4a0-2f7f-49c6-8f86-32efcd371ada None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:25.911812 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324c4a0-2f7f-49c6-8f86-32efcd371ada None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:25.912101 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324c4a0-2f7f-49c6-8f86-32efcd371ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:25.935072 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-e324c4a0-2f7f-49c6-8f86-32efcd371ada None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:25.936338 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-e324c4a0-2f7f-49c6-8f86-32efcd371ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:25.968060 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 33/64] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:44:25.996548 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d36b64-f92f-4515-8b4e-98e6fe839bde None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:26.053211 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 32/65] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 11:44:26.091759 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324c4a0-2f7f-49c6-8f86-32efcd371ada None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:26.151722 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d36b64-f92f-4515-8b4e-98e6fe839bde None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:26.175251 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:26.201615 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f6736-eebd-4e7f-82c0-6fec4a62c1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:26.202682 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f6736-eebd-4e7f-82c0-6fec4a62c1fe None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:26.202969 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f6736-eebd-4e7f-82c0-6fec4a62c1fe None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:26.203248 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f6736-eebd-4e7f-82c0-6fec4a62c1fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:26.218014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355f6736-eebd-4e7f-82c0-6fec4a62c1fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:44:26.225276 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324c4a0-2f7f-49c6-8f86-32efcd371ada None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:26.229246 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-355f6736-eebd-4e7f-82c0-6fec4a62c1fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 11:44:26.229246 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:44:26.229246 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:44:26.229246 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:44:26.229246 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:44:26.229246 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:44:26.229246 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:44:26.229246 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:44:26.229246 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:44:26.229246 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:44:26.229246 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:44:26.229246 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:44:26.229246 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:44:26.229246 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:44:26.229246 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:44:26.229246 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:44:26.230132 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:44:26.230132 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:44:26.230132 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:44:26.230132 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:44:26.230132 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:44:26.230132 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:44:26.230132 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:44:26.230132 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:44:26.230132 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:44:26.230132 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:44:26.230132 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:44:26.230132 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:44:26.230132 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:44:26.230132 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:44:26.230132 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:44:26.230132 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:44:26.230893 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:44:26.230893 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:44:26.230893 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:44:26.230893 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:44:26.230893 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:44:26.230893 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:44:26.230893 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:44:26.230893 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:44:26.230893 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:44:26.230893 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:44:26.230893 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 11:44:26.230893 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:44:26.233318 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 34/66] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:44:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:44:26.235250 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ace459-01bf-49b5-928c-2f7918765952 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:26.236631 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ace459-01bf-49b5-928c-2f7918765952 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:26.237624 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ace459-01bf-49b5-928c-2f7918765952 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:26.240081 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 35/67] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:44:26.249344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c16113-0a9e-4c98-a087-b38a9655e31e None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:26.249843 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c16113-0a9e-4c98-a087-b38a9655e31e None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:26.250327 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c16113-0a9e-4c98-a087-b38a9655e31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:26.256455 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:26.269672 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-31c16113-0a9e-4c98-a087-b38a9655e31e None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:26.271218 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-31c16113-0a9e-4c98-a087-b38a9655e31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:26.276449 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b4718f-77c3-43ba-bb08-46d49bed0395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:26.277263 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4718f-77c3-43ba-bb08-46d49bed0395 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:26.277550 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4718f-77c3-43ba-bb08-46d49bed0395 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:26.277831 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4718f-77c3-43ba-bb08-46d49bed0395 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:26.291634 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b4718f-77c3-43ba-bb08-46d49bed0395 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:44:26.300828 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-f1b4718f-77c3-43ba-bb08-46d49bed0395 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:44:26.300828 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:44:26.300828 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:44:26.300828 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:44:26.300828 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:44:26.300828 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:44:26.300828 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:44:26.300828 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:44:26.300828 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:44:26.300828 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:44:26.300828 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:44:26.300828 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:44:26.300828 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:44:26.300828 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:44:26.300828 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:44:26.300828 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:44:26.301888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:44:26.301888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:44:26.301888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:44:26.301888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:44:26.301888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:44:26.301888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:44:26.301888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:44:26.301888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:44:26.301888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:44:26.301888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:44:26.301888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:44:26.301888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:44:26.301888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:44:26.301888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:44:26.301888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:44:26.301888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:44:26.302827 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:44:26.302827 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:44:26.302827 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:44:26.302827 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:44:26.302827 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:44:26.302827 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:44:26.302827 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:44:26.302827 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:44:26.302827 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:44:26.302827 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:44:26.302827 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:44:26.302827 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:44:26.305463 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 33/68] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 3 11:44:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:44:26.306883 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b4718f-77c3-43ba-bb08-46d49bed0395 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:26.350875 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 36/69] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:44:26.352292 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a578a-7454-4c19-a5fe-0a50e208405e None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:26.352582 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a578a-7454-4c19-a5fe-0a50e208405e None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:26.352858 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a578a-7454-4c19-a5fe-0a50e208405e None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:26.354102 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 37/70] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:44:26.356140 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a578a-7454-4c19-a5fe-0a50e208405e None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:26.421235 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b4718f-77c3-43ba-bb08-46d49bed0395 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:26.457460 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7baac-c04d-4320-a0ab-9d4c1a99cd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:26.458124 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7baac-c04d-4320-a0ab-9d4c1a99cd6c None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:26.458413 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7baac-c04d-4320-a0ab-9d4c1a99cd6c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:26.458697 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7baac-c04d-4320-a0ab-9d4c1a99cd6c None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:26.459440 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7baac-c04d-4320-a0ab-9d4c1a99cd6c None admin] RBAC: Adding query filter params (name=member) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:26.459778 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7baac-c04d-4320-a0ab-9d4c1a99cd6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:26.459876 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a578a-7454-4c19-a5fe-0a50e208405e None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:26.461208 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7baac-c04d-4320-a0ab-9d4c1a99cd6c None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:26.469074 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:26.473392 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 34/71] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 3 11:44:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:26.478075 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c9f9b-663d-43e9-8c47-dba40802528d None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:26.478075 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c9f9b-663d-43e9-8c47-dba40802528d None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:26.478075 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c9f9b-663d-43e9-8c47-dba40802528d None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:26.478075 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 35/72] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:44:26.478075 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115f4f7-2fb9-4087-bbef-6fc279f5abfa None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:26.478075 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115f4f7-2fb9-4087-bbef-6fc279f5abfa None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:26.478510 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115f4f7-2fb9-4087-bbef-6fc279f5abfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:26.494408 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-3115f4f7-2fb9-4087-bbef-6fc279f5abfa None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:26.495622 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-3115f4f7-2fb9-4087-bbef-6fc279f5abfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:26.497613 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b0e0f-98d7-4f4a-bd11-16448de1ed4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:26.498969 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b0e0f-98d7-4f4a-bd11-16448de1ed4d None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:26.499259 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b0e0f-98d7-4f4a-bd11-16448de1ed4d None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:26.499559 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b0e0f-98d7-4f4a-bd11-16448de1ed4d None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:26.500316 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b0e0f-98d7-4f4a-bd11-16448de1ed4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:26.500623 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b0e0f-98d7-4f4a-bd11-16448de1ed4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:26.502010 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b0e0f-98d7-4f4a-bd11-16448de1ed4d None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:26.511004 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 38/73] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:44:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:26.511857 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b0e0f-98d7-4f4a-bd11-16448de1ed4d None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:26.531229 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:26.562184 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 36/74] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:44:26.563182 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115f4f7-2fb9-4087-bbef-6fc279f5abfa None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:26.624674 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b0e0f-98d7-4f4a-bd11-16448de1ed4d None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:26.658499 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6829a-e51d-4d69-b1a4-f09742201fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:26.659313 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6829a-e51d-4d69-b1a4-f09742201fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:26.659631 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6829a-e51d-4d69-b1a4-f09742201fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:26.659915 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6829a-e51d-4d69-b1a4-f09742201fc4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:26.661494 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115f4f7-2fb9-4087-bbef-6fc279f5abfa None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:26.669930 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c6829a-e51d-4d69-b1a4-f09742201fc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:44:26.677980 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-80c6829a-e51d-4d69-b1a4-f09742201fc4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 11:44:26.677980 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:44:26.677980 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:44:26.677980 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:44:26.677980 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:44:26.677980 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:44:26.677980 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:44:26.677980 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:44:26.677980 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:44:26.677980 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:44:26.677980 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:44:26.677980 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:44:26.677980 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:44:26.677980 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:44:26.677980 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:44:26.677980 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:44:26.678839 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:44:26.678839 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:44:26.678839 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:44:26.678839 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:44:26.678839 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:44:26.678839 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:44:26.678839 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:44:26.678839 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:44:26.678839 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:44:26.678839 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:44:26.678839 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:44:26.678839 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:44:26.678839 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:44:26.678839 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:44:26.678839 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:44:26.678839 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:44:26.684576 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:44:26.684576 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:44:26.684576 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:44:26.684576 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:44:26.684576 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:44:26.684576 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:44:26.684576 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:44:26.684576 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:44:26.684576 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:44:26.684576 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:44:26.684576 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 11:44:26.684576 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:44:26.684576 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 39/75] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Jun 3 11:44:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:44:26.684576 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8a6a5-94ef-4737-a1f5-4b7ccad4d9e1 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:26.685242 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8a6a5-94ef-4737-a1f5-4b7ccad4d9e1 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:26.685242 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8a6a5-94ef-4737-a1f5-4b7ccad4d9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:26.695122 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf56a8-1912-4fbb-8159-c88981184691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:26.696025 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf56a8-1912-4fbb-8159-c88981184691 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:26.696310 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf56a8-1912-4fbb-8159-c88981184691 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:26.696593 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf56a8-1912-4fbb-8159-c88981184691 None admin] PATH_INFO: `/v3/users/54ceb1595a2943459ed05f05f288a335` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:26.697475 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-0bf8a6a5-94ef-4737-a1f5-4b7ccad4d9e1 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:26.698671 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-0bf8a6a5-94ef-4737-a1f5-4b7ccad4d9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:26.712302 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf56a8-1912-4fbb-8159-c88981184691 None admin] RBAC: Authorizing `identity:get_user(user_id=54ceb1595a2943459ed05f05f288a335)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:26.713772 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf56a8-1912-4fbb-8159-c88981184691 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:26.715448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 37/76] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:44:26 2022] GET /identity/v3/users/54ceb1595a2943459ed05f05f288a335 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:26.720462 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf56a8-1912-4fbb-8159-c88981184691 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:26.722229 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:26.749309 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:26.766083 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 40/77] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:44:26.766910 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8a6a5-94ef-4737-a1f5-4b7ccad4d9e1 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:26.833300 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf56a8-1912-4fbb-8159-c88981184691 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:26.863346 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8a6a5-94ef-4737-a1f5-4b7ccad4d9e1 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:26.866218 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41072882-761b-4918-9513-ebf04365e119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:26.867085 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41072882-761b-4918-9513-ebf04365e119 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:26.867365 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41072882-761b-4918-9513-ebf04365e119 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:26.867677 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41072882-761b-4918-9513-ebf04365e119 None admin] PATH_INFO: `/v3/users/0616a4eb01db4ae8ac6d10f710fd1630` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:26.868864 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41072882-761b-4918-9513-ebf04365e119 None admin] RBAC: Authorizing `identity:get_user(user_id=0616a4eb01db4ae8ac6d10f710fd1630)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:26.870302 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41072882-761b-4918-9513-ebf04365e119 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:26.871980 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 38/78] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:44:26 2022] GET /identity/v3/users/0616a4eb01db4ae8ac6d10f710fd1630 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:26.874165 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41072882-761b-4918-9513-ebf04365e119 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:26.899931 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26aa3e4-74c6-411e-8ff8-7e5e2a01c6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:26.900738 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26aa3e4-74c6-411e-8ff8-7e5e2a01c6dc None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:26.901025 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26aa3e4-74c6-411e-8ff8-7e5e2a01c6dc None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:26.901305 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26aa3e4-74c6-411e-8ff8-7e5e2a01c6dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:26.911633 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26aa3e4-74c6-411e-8ff8-7e5e2a01c6dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:44:26.919333 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-c26aa3e4-74c6-411e-8ff8-7e5e2a01c6dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 11:44:26.919333 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:44:26.919333 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:44:26.919333 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:44:26.919333 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:44:26.919333 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:44:26.919333 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:44:26.919333 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:44:26.919333 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:44:26.919333 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:44:26.919333 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:44:26.919333 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:44:26.919333 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:44:26.919333 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:44:26.919333 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:44:26.919333 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:44:26.920183 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:44:26.920183 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:44:26.920183 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:44:26.920183 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:44:26.920183 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:44:26.920183 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:44:26.920183 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:44:26.920183 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:44:26.920183 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:44:26.920183 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:44:26.920183 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:44:26.920183 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:44:26.920183 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:44:26.920183 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:44:26.920183 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:44:26.920183 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:44:26.920924 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:44:26.920924 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:44:26.920924 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:44:26.920924 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:44:26.920924 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:44:26.920924 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:44:26.920924 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:44:26.920924 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:44:26.920924 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:44:26.920924 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:44:26.920924 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 11:44:26.920924 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:44:26.920924 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 41/79] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:44:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:44:26.921528 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26aa3e4-74c6-411e-8ff8-7e5e2a01c6dc None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:26.944031 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:26.973131 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:26.977342 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41072882-761b-4918-9513-ebf04365e119 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:27.011450 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd491f3-2824-45d5-8cb8-83cf9af74d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:27.012153 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd491f3-2824-45d5-8cb8-83cf9af74d27 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:27.012862 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd491f3-2824-45d5-8cb8-83cf9af74d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:27.013154 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd491f3-2824-45d5-8cb8-83cf9af74d27 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:27.014068 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd491f3-2824-45d5-8cb8-83cf9af74d27 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:27.014390 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd491f3-2824-45d5-8cb8-83cf9af74d27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:27.015807 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd491f3-2824-45d5-8cb8-83cf9af74d27 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:27.023797 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 39/80] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:44:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:27.024160 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26aa3e4-74c6-411e-8ff8-7e5e2a01c6dc None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:27.024749 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd491f3-2824-45d5-8cb8-83cf9af74d27 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:27.059710 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bfde5a-6681-4947-ba80-c5f3fcf17a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:27.060364 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfde5a-6681-4947-ba80-c5f3fcf17a9d None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:27.060656 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfde5a-6681-4947-ba80-c5f3fcf17a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:27.060939 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfde5a-6681-4947-ba80-c5f3fcf17a9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:27.121547 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd491f3-2824-45d5-8cb8-83cf9af74d27 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:27.129304 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bfde5a-6681-4947-ba80-c5f3fcf17a9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:27.130787 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bfde5a-6681-4947-ba80-c5f3fcf17a9d None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:27.152173 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:27.154823 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea75e5e-d6c1-4574-9726-f2905ddcd0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:27.155691 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea75e5e-d6c1-4574-9726-f2905ddcd0c2 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:27.155974 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea75e5e-d6c1-4574-9726-f2905ddcd0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:27.156260 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea75e5e-d6c1-4574-9726-f2905ddcd0c2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:27.157465 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea75e5e-d6c1-4574-9726-f2905ddcd0c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:27.158947 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea75e5e-d6c1-4574-9726-f2905ddcd0c2 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:27.160580 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 40/81] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:44:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:27.165075 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea75e5e-d6c1-4574-9726-f2905ddcd0c2 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:27.189393 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:27.233999 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 42/82] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:44:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 11:44:27.234844 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bfde5a-6681-4947-ba80-c5f3fcf17a9d None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:27.261507 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea75e5e-d6c1-4574-9726-f2905ddcd0c2 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:27.294774 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b8cd6-b178-4148-9ff3-b77584a5b414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:27.295418 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b8cd6-b178-4148-9ff3-b77584a5b414 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:27.295738 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b8cd6-b178-4148-9ff3-b77584a5b414 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:27.296023 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b8cd6-b178-4148-9ff3-b77584a5b414 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:27.332702 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bfde5a-6681-4947-ba80-c5f3fcf17a9d None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:27.352472 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:27.365332 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b8cd6-b178-4148-9ff3-b77584a5b414 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:27.366808 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b8cd6-b178-4148-9ff3-b77584a5b414 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:27.367851 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e71dbb-d3d8-4922-b5b3-e03eeb31ad52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:27.368526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e71dbb-d3d8-4922-b5b3-e03eeb31ad52 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:27.368809 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e71dbb-d3d8-4922-b5b3-e03eeb31ad52 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:27.369084 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e71dbb-d3d8-4922-b5b3-e03eeb31ad52 None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:27.369835 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e71dbb-d3d8-4922-b5b3-e03eeb31ad52 None admin] RBAC: Adding query filter params (name=member) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:27.370143 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e71dbb-d3d8-4922-b5b3-e03eeb31ad52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:27.371524 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e71dbb-d3d8-4922-b5b3-e03eeb31ad52 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:27.379763 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 43/83] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 3 11:44:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:27.380318 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e71dbb-d3d8-4922-b5b3-e03eeb31ad52 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:27.395683 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:27.468817 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 41/84] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:44:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 11:44:27.469633 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b8cd6-b178-4148-9ff3-b77584a5b414 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:27.478751 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e71dbb-d3d8-4922-b5b3-e03eeb31ad52 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:27.511471 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360d91d-9d06-413e-bc60-33e0948b72b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:27.512363 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360d91d-9d06-413e-bc60-33e0948b72b0 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:27.512650 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360d91d-9d06-413e-bc60-33e0948b72b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:27.512923 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360d91d-9d06-413e-bc60-33e0948b72b0 None admin] PATH_INFO: `/v3/users/54ceb1595a2943459ed05f05f288a335` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:27.514133 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e360d91d-9d06-413e-bc60-33e0948b72b0 None admin] RBAC: Authorizing `identity:get_user(user_id=54ceb1595a2943459ed05f05f288a335)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:27.515594 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e360d91d-9d06-413e-bc60-33e0948b72b0 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:27.517197 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 44/85] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:44:27 2022] GET /identity/v3/users/54ceb1595a2943459ed05f05f288a335 => generated 275 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:27.517943 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360d91d-9d06-413e-bc60-33e0948b72b0 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:27.568153 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b8cd6-b178-4148-9ff3-b77584a5b414 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:27.570695 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:27.594581 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:27.603430 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629cc0f-8e6a-47a3-9238-cc02ef5e3654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:27.604122 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629cc0f-8e6a-47a3-9238-cc02ef5e3654 None admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:27.604411 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629cc0f-8e6a-47a3-9238-cc02ef5e3654 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:27.604691 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629cc0f-8e6a-47a3-9238-cc02ef5e3654 None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:27.605400 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629cc0f-8e6a-47a3-9238-cc02ef5e3654 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:27.606842 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629cc0f-8e6a-47a3-9238-cc02ef5e3654 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:27.620731 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360d91d-9d06-413e-bc60-33e0948b72b0 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:27.635422 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 42/86] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Jun 3 11:44:27 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:44:27.636275 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629cc0f-8e6a-47a3-9238-cc02ef5e3654 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:27.662675 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691e910-583b-4864-ad44-25cec674fa4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:27.663598 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691e910-583b-4864-ad44-25cec674fa4d None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:27.663889 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691e910-583b-4864-ad44-25cec674fa4d None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:27.664169 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691e910-583b-4864-ad44-25cec674fa4d None admin] PATH_INFO: `/v3/projects/437ab37ab6104629b1199c45fdd0b804` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:27.665471 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8691e910-583b-4864-ad44-25cec674fa4d None admin] RBAC: Authorizing `identity:get_project(project_id=437ab37ab6104629b1199c45fdd0b804)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:27.667001 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8691e910-583b-4864-ad44-25cec674fa4d None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:27.668884 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 45/87] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:44:27 2022] GET /identity/v3/projects/437ab37ab6104629b1199c45fdd0b804 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:27.669828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691e910-583b-4864-ad44-25cec674fa4d None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:27.766558 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629cc0f-8e6a-47a3-9238-cc02ef5e3654 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:27.781728 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691e910-583b-4864-ad44-25cec674fa4d None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:27.802481 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:27.810344 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd4731-11cb-4f5f-9b2c-a679d0612006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:27.811252 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd4731-11cb-4f5f-9b2c-a679d0612006 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:27.811744 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd4731-11cb-4f5f-9b2c-a679d0612006 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:27.812038 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd4731-11cb-4f5f-9b2c-a679d0612006 None admin] PATH_INFO: `/v3/users/54ceb1595a2943459ed05f05f288a335` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:27.813346 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd4731-11cb-4f5f-9b2c-a679d0612006 None admin] RBAC: Authorizing `identity:get_user(user_id=54ceb1595a2943459ed05f05f288a335)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:27.814847 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd4731-11cb-4f5f-9b2c-a679d0612006 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:27.821018 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 43/88] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:44:27 2022] GET /identity/v3/users/54ceb1595a2943459ed05f05f288a335 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:27.821018 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd4731-11cb-4f5f-9b2c-a679d0612006 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:27.827743 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be7ffe-3317-4fda-b4ba-ed7ea6f35144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:27.828629 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be7ffe-3317-4fda-b4ba-ed7ea6f35144 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:27.828912 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be7ffe-3317-4fda-b4ba-ed7ea6f35144 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:27.829188 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be7ffe-3317-4fda-b4ba-ed7ea6f35144 None admin] PATH_INFO: `/v3/projects/437ab37ab6104629b1199c45fdd0b804` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:27.831338 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be7ffe-3317-4fda-b4ba-ed7ea6f35144 None admin] RBAC: Authorizing `identity:get_project(project_id=437ab37ab6104629b1199c45fdd0b804)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:27.833272 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be7ffe-3317-4fda-b4ba-ed7ea6f35144 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:27.835306 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 46/89] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:44:27 2022] GET /identity/v3/projects/437ab37ab6104629b1199c45fdd0b804 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:27.836113 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be7ffe-3317-4fda-b4ba-ed7ea6f35144 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:27.879933 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:27.947966 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd4731-11cb-4f5f-9b2c-a679d0612006 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:27.974859 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be7ffe-3317-4fda-b4ba-ed7ea6f35144 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:27.999762 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9764d-9654-49e1-9aa1-12e0e99c3acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:28.000576 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9764d-9654-49e1-9aa1-12e0e99c3acb None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:28.001067 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9764d-9654-49e1-9aa1-12e0e99c3acb None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:28.001352 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9764d-9654-49e1-9aa1-12e0e99c3acb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:28.013071 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a690333-a87c-4187-b5db-70d67ba0ba10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:28.014167 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a690333-a87c-4187-b5db-70d67ba0ba10 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:28.015427 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a690333-a87c-4187-b5db-70d67ba0ba10 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:28.015427 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a690333-a87c-4187-b5db-70d67ba0ba10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:28.015687 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a690333-a87c-4187-b5db-70d67ba0ba10 None admin] RBAC: Adding query filter params (role.id=781e2d573ee94afaae05b3cc0bba8768, scope.project.id=437ab37ab6104629b1199c45fdd0b804, user.id=54ceb1595a2943459ed05f05f288a335) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:28.016290 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a690333-a87c-4187-b5db-70d67ba0ba10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:28.018159 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a690333-a87c-4187-b5db-70d67ba0ba10 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:28.026867 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 47/90] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:44:27 2022] GET /identity/v3/role_assignments?user.id=54ceb1595a2943459ed05f05f288a335&scope.project.id=437ab37ab6104629b1199c45fdd0b804&role.id=781e2d573ee94afaae05b3cc0bba8768 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:28.028035 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a690333-a87c-4187-b5db-70d67ba0ba10 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:28.138418 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9764d-9654-49e1-9aa1-12e0e99c3acb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:28.141402 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9764d-9654-49e1-9aa1-12e0e99c3acb None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:28.141525 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:28.214245 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a690333-a87c-4187-b5db-70d67ba0ba10 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:28.258358 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e4552-227e-4058-a79f-d1c9f5584a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:28.260011 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e4552-227e-4058-a79f-d1c9f5584a5e None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:28.260011 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e4552-227e-4058-a79f-d1c9f5584a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:28.260011 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e4552-227e-4058-a79f-d1c9f5584a5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:28.270737 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:28.352409 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 44/91] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:44:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 11:44:28.353274 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9764d-9654-49e1-9aa1-12e0e99c3acb None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:28.376580 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e4552-227e-4058-a79f-d1c9f5584a5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:28.378736 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e4552-227e-4058-a79f-d1c9f5584a5e None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:28.483972 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:28.532203 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9764d-9654-49e1-9aa1-12e0e99c3acb None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:28.587418 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 48/92] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:44:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 11:44:28.588557 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e4552-227e-4058-a79f-d1c9f5584a5e None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:28.602269 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34fef83-9ae5-44d6-ab6a-ef67234bf42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:28.602943 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fef83-9ae5-44d6-ab6a-ef67234bf42f None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:28.603225 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fef83-9ae5-44d6-ab6a-ef67234bf42f None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:28.603523 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fef83-9ae5-44d6-ab6a-ef67234bf42f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:28.604371 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34fef83-9ae5-44d6-ab6a-ef67234bf42f None admin] RBAC: Adding query filter params (role.id=c486e164840b41a59fd118dece2ce572, scope.project.id=437ab37ab6104629b1199c45fdd0b804, user.id=0616a4eb01db4ae8ac6d10f710fd1630) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:28.604690 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34fef83-9ae5-44d6-ab6a-ef67234bf42f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:28.606176 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34fef83-9ae5-44d6-ab6a-ef67234bf42f None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:28.621645 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 45/93] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:44:28 2022] GET /identity/v3/role_assignments?user.id=0616a4eb01db4ae8ac6d10f710fd1630&scope.project.id=437ab37ab6104629b1199c45fdd0b804&role.id=c486e164840b41a59fd118dece2ce572 => generated 259 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:28.624004 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34fef83-9ae5-44d6-ab6a-ef67234bf42f None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:28.650714 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:28.746788 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34fef83-9ae5-44d6-ab6a-ef67234bf42f None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:28.786989 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab66581-bed7-412b-add7-70fdee197bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:28.788993 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab66581-bed7-412b-add7-70fdee197bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:28.788993 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab66581-bed7-412b-add7-70fdee197bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:28.788993 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab66581-bed7-412b-add7-70fdee197bf5 None admin] PATH_INFO: `/v3/projects/ea51488356414c4bb3aa2c00cfc089e4` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:28.789993 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab66581-bed7-412b-add7-70fdee197bf5 None admin] RBAC: Authorizing `identity:get_project(project_id=ea51488356414c4bb3aa2c00cfc089e4)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:28.791718 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab66581-bed7-412b-add7-70fdee197bf5 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:28.793598 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 46/94] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:44:28 2022] GET /identity/v3/projects/ea51488356414c4bb3aa2c00cfc089e4 => generated 312 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:28.800389 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab66581-bed7-412b-add7-70fdee197bf5 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:28.823395 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e4552-227e-4058-a79f-d1c9f5584a5e None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:28.895428 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:28.912843 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56262123-5371-4606-bd12-09f28d0dac99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:28.913745 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56262123-5371-4606-bd12-09f28d0dac99 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:28.914035 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56262123-5371-4606-bd12-09f28d0dac99 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:28.914210 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab66581-bed7-412b-add7-70fdee197bf5 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:28.914313 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56262123-5371-4606-bd12-09f28d0dac99 None admin] PATH_INFO: `/v3/projects/437ab37ab6104629b1199c45fdd0b804` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:28.915554 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56262123-5371-4606-bd12-09f28d0dac99 None admin] RBAC: Authorizing `identity:get_project(project_id=437ab37ab6104629b1199c45fdd0b804)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:28.917130 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56262123-5371-4606-bd12-09f28d0dac99 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:28.918960 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 49/95] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:44:28 2022] GET /identity/v3/projects/437ab37ab6104629b1199c45fdd0b804 => generated 298 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:28.928574 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56262123-5371-4606-bd12-09f28d0dac99 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:28.952760 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc05a8-b26b-44f2-b936-93563ec33f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:28.953547 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc05a8-b26b-44f2-b936-93563ec33f6b None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:28.953841 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc05a8-b26b-44f2-b936-93563ec33f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:28.954121 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc05a8-b26b-44f2-b936-93563ec33f6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:28.954975 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc05a8-b26b-44f2-b936-93563ec33f6b None admin] RBAC: Adding query filter params (role.id=781e2d573ee94afaae05b3cc0bba8768, scope.project.id=ea51488356414c4bb3aa2c00cfc089e4, user.id=54ceb1595a2943459ed05f05f288a335) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:28.955295 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc05a8-b26b-44f2-b936-93563ec33f6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:28.957073 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc05a8-b26b-44f2-b936-93563ec33f6b None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:28.961897 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:28.972074 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 47/96] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:44:28 2022] GET /identity/v3/role_assignments?user.id=54ceb1595a2943459ed05f05f288a335&scope.project.id=ea51488356414c4bb3aa2c00cfc089e4&role.id=781e2d573ee94afaae05b3cc0bba8768 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:29.178543 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56262123-5371-4606-bd12-09f28d0dac99 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:29.228348 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf6cbc-58af-4659-a98d-d7c3a51c4288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:29.229023 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf6cbc-58af-4659-a98d-d7c3a51c4288 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:29.229313 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf6cbc-58af-4659-a98d-d7c3a51c4288 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:29.229594 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf6cbc-58af-4659-a98d-d7c3a51c4288 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:29.230443 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf6cbc-58af-4659-a98d-d7c3a51c4288 None admin] RBAC: Adding query filter params (role.id=5d1199580aaa485bb120b35e6f771ff9, scope.project.id=437ab37ab6104629b1199c45fdd0b804, user.id=54ceb1595a2943459ed05f05f288a335) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:29.230759 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf6cbc-58af-4659-a98d-d7c3a51c4288 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:29.232295 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf6cbc-58af-4659-a98d-d7c3a51c4288 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:29.243756 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 50/97] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:44:28 2022] GET /identity/v3/role_assignments?user.id=54ceb1595a2943459ed05f05f288a335&scope.project.id=437ab37ab6104629b1199c45fdd0b804&role.id=5d1199580aaa485bb120b35e6f771ff9 => generated 259 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:30.386746 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f8f2c-4b96-41a6-88b7-391e5c88fc1b None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:30.387260 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f8f2c-4b96-41a6-88b7-391e5c88fc1b None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:30.387333 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f8f2c-4b96-41a6-88b7-391e5c88fc1b None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:30.388704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 48/98] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:44:30.394050 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9c1e3-8da5-4765-9c79-1a59bdb781bc None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:30.394888 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9c1e3-8da5-4765-9c79-1a59bdb781bc None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:30.395375 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9c1e3-8da5-4765-9c79-1a59bdb781bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:30.428536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-68e9c1e3-8da5-4765-9c79-1a59bdb781bc None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:30.430090 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-68e9c1e3-8da5-4765-9c79-1a59bdb781bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:30.517468 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 51/99] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 11:44:30.548705 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f8f2c-4b96-41a6-88b7-391e5c88fc1b None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:30.672105 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f8f2c-4b96-41a6-88b7-391e5c88fc1b None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:30.711574 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee7ddf-f3f0-4860-8684-aed9bec036a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:30.712767 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee7ddf-f3f0-4860-8684-aed9bec036a2 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:30.713254 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee7ddf-f3f0-4860-8684-aed9bec036a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:30.713741 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee7ddf-f3f0-4860-8684-aed9bec036a2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:30.726181 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee7ddf-f3f0-4860-8684-aed9bec036a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:44:30.734280 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-66ee7ddf-f3f0-4860-8684-aed9bec036a2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 11:44:30.734280 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:44:30.734280 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:44:30.734280 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:44:30.734280 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:44:30.734280 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:44:30.734280 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:44:30.734280 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:44:30.734280 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:44:30.734280 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:44:30.734280 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:44:30.734280 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:44:30.734280 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:44:30.734280 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:44:30.734280 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:44:30.734280 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:44:30.735268 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:44:30.735268 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:44:30.735268 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:44:30.735268 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:44:30.735268 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:44:30.735268 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:44:30.735268 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:44:30.735268 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:44:30.735268 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:44:30.735268 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:44:30.735268 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:44:30.735268 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:44:30.735268 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:44:30.735268 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:44:30.735268 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:44:30.735268 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:44:30.736066 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:44:30.736066 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:44:30.736066 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:44:30.736066 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:44:30.736066 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:44:30.736066 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:44:30.736066 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:44:30.736066 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:44:30.736066 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:44:30.736066 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:44:30.736066 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 11:44:30.736066 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:44:30.738972 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 49/100] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:44:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:44:30.744733 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9c1e3-8da5-4765-9c79-1a59bdb781bc None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:30.759943 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:30.871590 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9c1e3-8da5-4765-9c79-1a59bdb781bc None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:30.910179 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580dee8b-c67b-4eb0-9b3a-cf1f3f17a1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:30.911040 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dee8b-c67b-4eb0-9b3a-cf1f3f17a1dc None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:30.911473 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dee8b-c67b-4eb0-9b3a-cf1f3f17a1dc None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:30.911946 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dee8b-c67b-4eb0-9b3a-cf1f3f17a1dc None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:30.912850 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580dee8b-c67b-4eb0-9b3a-cf1f3f17a1dc None admin] RBAC: Adding query filter params (name=reader) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:30.913304 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580dee8b-c67b-4eb0-9b3a-cf1f3f17a1dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:30.914839 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580dee8b-c67b-4eb0-9b3a-cf1f3f17a1dc None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:30.923630 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 52/101] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 3 11:44:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:30.932862 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee7ddf-f3f0-4860-8684-aed9bec036a2 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:30.945859 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:31.085849 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee7ddf-f3f0-4860-8684-aed9bec036a2 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:31.134608 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5024826-a20d-4b33-9753-bf91b3dbe813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:31.135752 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5024826-a20d-4b33-9753-bf91b3dbe813 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:31.136189 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5024826-a20d-4b33-9753-bf91b3dbe813 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:31.136651 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5024826-a20d-4b33-9753-bf91b3dbe813 None admin] PATH_INFO: `/v3/users/46738e3728ba4d518b8b9b13756a8440` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:31.154645 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92651c49-c615-44ed-9610-6e132fc13603 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:31.155262 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92651c49-c615-44ed-9610-6e132fc13603 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:31.155789 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92651c49-c615-44ed-9610-6e132fc13603 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:31.157239 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5024826-a20d-4b33-9753-bf91b3dbe813 None admin] RBAC: Authorizing `identity:get_user(user_id=46738e3728ba4d518b8b9b13756a8440)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:31.157623 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 53/102] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 11:44:31.159563 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5024826-a20d-4b33-9753-bf91b3dbe813 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:31.160964 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 50/103] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:44:30 2022] GET /identity/v3/users/46738e3728ba4d518b8b9b13756a8440 => generated 289 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:31.163639 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266ce0e-2062-4ee2-9cb3-82681c933aec None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:31.164145 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266ce0e-2062-4ee2-9cb3-82681c933aec None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:31.164653 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266ce0e-2062-4ee2-9cb3-82681c933aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:31.165834 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5024826-a20d-4b33-9753-bf91b3dbe813 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:31.195727 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-9266ce0e-2062-4ee2-9cb3-82681c933aec None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:31.197252 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-9266ce0e-2062-4ee2-9cb3-82681c933aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:31.254313 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:31.312053 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 54/104] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 11:44:31.316730 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5024826-a20d-4b33-9753-bf91b3dbe813 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:31.350571 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266ce0e-2062-4ee2-9cb3-82681c933aec None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:31.356808 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:31.374022 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40313374-a3e4-4197-8224-9f1ed5e851cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:31.374687 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40313374-a3e4-4197-8224-9f1ed5e851cd None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:31.374971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40313374-a3e4-4197-8224-9f1ed5e851cd None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:31.375247 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40313374-a3e4-4197-8224-9f1ed5e851cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:31.471629 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40313374-a3e4-4197-8224-9f1ed5e851cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:31.472702 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40313374-a3e4-4197-8224-9f1ed5e851cd None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:31.548064 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:31.589075 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 51/105] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:44:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 03 11:44:31.595802 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747e973-b505-4be7-a815-9156fbb449e5 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:31.596256 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747e973-b505-4be7-a815-9156fbb449e5 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:31.596733 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747e973-b505-4be7-a815-9156fbb449e5 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:31.598443 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 52/106] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:44:31.599610 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747e973-b505-4be7-a815-9156fbb449e5 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:31.672120 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266ce0e-2062-4ee2-9cb3-82681c933aec None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:31.716327 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747e973-b505-4be7-a815-9156fbb449e5 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:31.755828 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bced9f9-31ae-4b08-ab5e-da9f77c18cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:31.757158 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bced9f9-31ae-4b08-ab5e-da9f77c18cda None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:31.757592 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bced9f9-31ae-4b08-ab5e-da9f77c18cda None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:31.758033 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bced9f9-31ae-4b08-ab5e-da9f77c18cda None admin] PATH_INFO: `/v3/projects/437ab37ab6104629b1199c45fdd0b804` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:31.759374 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bced9f9-31ae-4b08-ab5e-da9f77c18cda None admin] RBAC: Authorizing `identity:get_project(project_id=437ab37ab6104629b1199c45fdd0b804)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:31.762601 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bced9f9-31ae-4b08-ab5e-da9f77c18cda None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:31.764957 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 53/107] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:44:31 2022] GET /identity/v3/projects/437ab37ab6104629b1199c45fdd0b804 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:31.771090 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b57b66-a3c7-4b26-84d5-a56c92b32a14 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:31.772063 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b57b66-a3c7-4b26-84d5-a56c92b32a14 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:31.772557 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b57b66-a3c7-4b26-84d5-a56c92b32a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:31.789791 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-f3b57b66-a3c7-4b26-84d5-a56c92b32a14 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:31.790594 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead81b4-cc1a-41e3-a0e0-ff6439f7c0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:31.791533 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead81b4-cc1a-41e3-a0e0-ff6439f7c0e2 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:31.791786 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-f3b57b66-a3c7-4b26-84d5-a56c92b32a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:31.791889 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead81b4-cc1a-41e3-a0e0-ff6439f7c0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:31.792113 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead81b4-cc1a-41e3-a0e0-ff6439f7c0e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:31.796235 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead81b4-cc1a-41e3-a0e0-ff6439f7c0e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:31.797788 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead81b4-cc1a-41e3-a0e0-ff6439f7c0e2 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:31.800053 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 55/108] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:44:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 449 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:31.805210 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead81b4-cc1a-41e3-a0e0-ff6439f7c0e2 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:31.828499 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:31.871742 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 54/109] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:44:31.873565 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b57b66-a3c7-4b26-84d5-a56c92b32a14 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:31.963174 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:31.997639 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b57b66-a3c7-4b26-84d5-a56c92b32a14 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:31.999281 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead81b4-cc1a-41e3-a0e0-ff6439f7c0e2 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:32.039323 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb441e6d-5883-4886-b97c-ee3bba52ccde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:32.040076 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb441e6d-5883-4886-b97c-ee3bba52ccde None admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:32.040370 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb441e6d-5883-4886-b97c-ee3bba52ccde None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:32.040655 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb441e6d-5883-4886-b97c-ee3bba52ccde None admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:32.041483 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb441e6d-5883-4886-b97c-ee3bba52ccde None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:32.043260 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb441e6d-5883-4886-b97c-ee3bba52ccde None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:32.043939 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddfd339-ab58-489d-b74f-10c69bd220d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:32.044835 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddfd339-ab58-489d-b74f-10c69bd220d2 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:32.045314 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddfd339-ab58-489d-b74f-10c69bd220d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:32.045783 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddfd339-ab58-489d-b74f-10c69bd220d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:32.047111 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddfd339-ab58-489d-b74f-10c69bd220d2 None admin] RBAC: Adding query filter params (role.id=c2a1a291255141b3b6eee6132725bfff, scope.project.id=437ab37ab6104629b1199c45fdd0b804, user.id=46738e3728ba4d518b8b9b13756a8440) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:32.048175 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddfd339-ab58-489d-b74f-10c69bd220d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:32.050404 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddfd339-ab58-489d-b74f-10c69bd220d2 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:32.057644 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 56/110] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:44:31 2022] GET /identity/v3/role_assignments?user.id=46738e3728ba4d518b8b9b13756a8440&scope.project.id=437ab37ab6104629b1199c45fdd0b804&role.id=c2a1a291255141b3b6eee6132725bfff => generated 259 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:32.059567 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddfd339-ab58-489d-b74f-10c69bd220d2 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:32.074150 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 55/111] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Jun 3 11:44:31 2022] POST /identity/v3/projects => generated 302 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:44:32.080667 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3ce50-87ed-4e7f-b88c-94141fdf4476 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:32.081079 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3ce50-87ed-4e7f-b88c-94141fdf4476 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:32.081376 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3ce50-87ed-4e7f-b88c-94141fdf4476 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:32.083434 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 56/112] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:44:32.098246 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be7779-d403-44db-b1fe-be1afb2e9857 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:32.098588 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be7779-d403-44db-b1fe-be1afb2e9857 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:32.098825 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be7779-d403-44db-b1fe-be1afb2e9857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:32.131220 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-f0be7779-d403-44db-b1fe-be1afb2e9857 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:32.132675 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-f0be7779-d403-44db-b1fe-be1afb2e9857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:32.150778 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:32.182274 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddfd339-ab58-489d-b74f-10c69bd220d2 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:32.220858 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582b78c-1723-43f1-94b2-f8974cac2fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:32.222569 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582b78c-1723-43f1-94b2-f8974cac2fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:32.223056 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582b78c-1723-43f1-94b2-f8974cac2fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:32.223602 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582b78c-1723-43f1-94b2-f8974cac2fc3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:32.230897 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:32.242021 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1582b78c-1723-43f1-94b2-f8974cac2fc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:44:32.260294 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-1582b78c-1723-43f1-94b2-f8974cac2fc3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 11:44:32.260294 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:44:32.260294 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:44:32.260294 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:44:32.260294 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:44:32.260294 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:44:32.260294 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:44:32.260294 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:44:32.260294 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:44:32.260294 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:44:32.260294 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:44:32.260294 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:44:32.260294 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:44:32.260294 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:44:32.260294 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:44:32.260294 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:44:32.261211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:44:32.261211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:44:32.261211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:44:32.261211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:44:32.261211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:44:32.261211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:44:32.261211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:44:32.261211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:44:32.261211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:44:32.261211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:44:32.261211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:44:32.261211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:44:32.261211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:44:32.261211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:44:32.261211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:44:32.261211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:44:32.262007 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:44:32.262007 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:44:32.262007 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:44:32.262007 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:44:32.262007 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:44:32.262007 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:44:32.262007 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:44:32.262007 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:44:32.262007 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:44:32.262007 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:44:32.262007 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 11:44:32.262007 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:44:32.264683 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 57/113] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:44:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:44:32.275190 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582b78c-1723-43f1-94b2-f8974cac2fc3 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:32.323623 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 57/114] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 03 11:44:32.360654 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be7779-d403-44db-b1fe-be1afb2e9857 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:32.423647 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582b78c-1723-43f1-94b2-f8974cac2fc3 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:32.461755 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a913cd9-e758-4941-8d4e-933d11c0e77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:32.462802 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a913cd9-e758-4941-8d4e-933d11c0e77e None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:32.463293 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a913cd9-e758-4941-8d4e-933d11c0e77e None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:32.463830 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a913cd9-e758-4941-8d4e-933d11c0e77e None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:32.464800 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a913cd9-e758-4941-8d4e-933d11c0e77e None admin] RBAC: Adding query filter params (name=member) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:32.465323 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a913cd9-e758-4941-8d4e-933d11c0e77e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:32.466926 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a913cd9-e758-4941-8d4e-933d11c0e77e None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:32.476507 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 58/115] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 3 11:44:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:32.478193 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b3828-d201-4c51-be7c-9420bbbd0329 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:32.478684 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b3828-d201-4c51-be7c-9420bbbd0329 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:32.479161 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b3828-d201-4c51-be7c-9420bbbd0329 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:32.480641 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 59/116] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:44:32.481661 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b3828-d201-4c51-be7c-9420bbbd0329 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:32.545473 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:32.553067 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be7779-d403-44db-b1fe-be1afb2e9857 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:32.590025 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31379f02-e4bc-497b-a883-5b36152821ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:32.590833 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31379f02-e4bc-497b-a883-5b36152821ae None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:32.591123 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31379f02-e4bc-497b-a883-5b36152821ae None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:32.591406 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31379f02-e4bc-497b-a883-5b36152821ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:32.593774 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b3828-d201-4c51-be7c-9420bbbd0329 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:32.604404 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31379f02-e4bc-497b-a883-5b36152821ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:44:32.613557 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-31379f02-e4bc-497b-a883-5b36152821ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:44:32.613557 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:44:32.613557 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:44:32.613557 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:44:32.613557 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:44:32.613557 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:44:32.613557 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:44:32.613557 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:44:32.613557 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:44:32.613557 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:44:32.613557 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:44:32.613557 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:44:32.613557 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:44:32.613557 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:44:32.613557 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:44:32.613557 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:44:32.614396 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:44:32.614396 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:44:32.614396 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:44:32.614396 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:44:32.614396 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:44:32.614396 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:44:32.614396 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:44:32.614396 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:44:32.614396 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:44:32.614396 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:44:32.614396 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:44:32.614396 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:44:32.614396 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:44:32.614396 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:44:32.614396 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:44:32.614396 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:44:32.615159 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:44:32.615159 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:44:32.615159 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:44:32.615159 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:44:32.615159 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:44:32.615159 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:44:32.615159 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:44:32.615159 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:44:32.615159 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:44:32.615159 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:44:32.615159 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:44:32.615159 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:44:32.616230 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 58/117] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 3 11:44:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:44:32.617323 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3152869-dab0-49b4-93ea-46ffe4816d0e None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:32.623568 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3152869-dab0-49b4-93ea-46ffe4816d0e None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:32.623707 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3152869-dab0-49b4-93ea-46ffe4816d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:32.634609 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b61b29-00a7-4d1c-b4ee-1a36cd84ceac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:32.635865 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b61b29-00a7-4d1c-b4ee-1a36cd84ceac None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:32.636322 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:32.637238 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b61b29-00a7-4d1c-b4ee-1a36cd84ceac None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:32.637735 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b61b29-00a7-4d1c-b4ee-1a36cd84ceac None admin] PATH_INFO: `/v3/users/54ceb1595a2943459ed05f05f288a335` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:32.639267 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b61b29-00a7-4d1c-b4ee-1a36cd84ceac None admin] RBAC: Authorizing `identity:get_user(user_id=54ceb1595a2943459ed05f05f288a335)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:32.641000 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b61b29-00a7-4d1c-b4ee-1a36cd84ceac None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:32.642420 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-a3152869-dab0-49b4-93ea-46ffe4816d0e None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:32.643068 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 60/118] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:44:32 2022] GET /identity/v3/users/54ceb1595a2943459ed05f05f288a335 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:44:32.643882 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-a3152869-dab0-49b4-93ea-46ffe4816d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:32.645093 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b61b29-00a7-4d1c-b4ee-1a36cd84ceac None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:32.723654 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 59/119] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:44:32.723654 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3152869-dab0-49b4-93ea-46ffe4816d0e None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:32.807731 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b61b29-00a7-4d1c-b4ee-1a36cd84ceac None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:32.834888 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:32.844432 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338486a5-d73b-4696-968d-929a38272d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:32.845356 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338486a5-d73b-4696-968d-929a38272d31 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:32.847220 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338486a5-d73b-4696-968d-929a38272d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:32.847683 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338486a5-d73b-4696-968d-929a38272d31 None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:32.848684 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338486a5-d73b-4696-968d-929a38272d31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:32.849156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338486a5-d73b-4696-968d-929a38272d31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:32.850398 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3152869-dab0-49b4-93ea-46ffe4816d0e None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:32.850940 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338486a5-d73b-4696-968d-929a38272d31 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:32.860110 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 61/120] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:44:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:32.861185 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338486a5-d73b-4696-968d-929a38272d31 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:32.887141 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c120a-ab2f-4e10-a6f8-95468ab704d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:32.888042 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c120a-ab2f-4e10-a6f8-95468ab704d0 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:32.888326 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c120a-ab2f-4e10-a6f8-95468ab704d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:32.888599 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c120a-ab2f-4e10-a6f8-95468ab704d0 None admin] PATH_INFO: `/v3/projects/437ab37ab6104629b1199c45fdd0b804` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:32.889782 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c120a-ab2f-4e10-a6f8-95468ab704d0 None admin] RBAC: Authorizing `identity:get_project(project_id=437ab37ab6104629b1199c45fdd0b804)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:32.891250 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c120a-ab2f-4e10-a6f8-95468ab704d0 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:32.892966 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 60/121] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:44:32 2022] GET /identity/v3/projects/437ab37ab6104629b1199c45fdd0b804 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:32.894195 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14140dbe-8ddd-42ec-ae05-3b2aff4e9389 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:32.894484 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14140dbe-8ddd-42ec-ae05-3b2aff4e9389 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:32.894759 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14140dbe-8ddd-42ec-ae05-3b2aff4e9389 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:32.896034 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 61/122] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:44:32.896945 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14140dbe-8ddd-42ec-ae05-3b2aff4e9389 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:32.901010 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:32.973200 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338486a5-d73b-4696-968d-929a38272d31 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:33.007995 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14140dbe-8ddd-42ec-ae05-3b2aff4e9389 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:33.009758 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2eff02-81ae-4863-80ce-698bfbcbb13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:33.010760 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2eff02-81ae-4863-80ce-698bfbcbb13a None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:33.011288 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2eff02-81ae-4863-80ce-698bfbcbb13a None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:33.011769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2eff02-81ae-4863-80ce-698bfbcbb13a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:33.024324 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2eff02-81ae-4863-80ce-698bfbcbb13a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:44:33.033053 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-cc2eff02-81ae-4863-80ce-698bfbcbb13a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 11:44:33.033053 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:44:33.033053 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:44:33.033053 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:44:33.033053 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:44:33.033053 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:44:33.033053 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:44:33.033053 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:44:33.033053 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:44:33.033053 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:44:33.033053 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:44:33.033053 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:44:33.033053 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:44:33.033053 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:44:33.033053 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:44:33.033053 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:44:33.034022 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:44:33.034022 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:44:33.034022 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:44:33.034022 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:44:33.034022 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:44:33.034022 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:44:33.034022 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:44:33.034022 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:44:33.034022 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:44:33.034022 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:44:33.034022 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:44:33.034022 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:44:33.034022 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:44:33.034022 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:44:33.034022 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:44:33.034022 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:44:33.035283 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:44:33.035283 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:44:33.035283 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:44:33.035283 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:44:33.035283 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:44:33.035283 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:44:33.035283 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:44:33.035283 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:44:33.035283 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:44:33.035283 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:44:33.035283 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 11:44:33.035283 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:44:33.037581 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 62/123] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:44:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:44:33.038568 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2eff02-81ae-4863-80ce-698bfbcbb13a None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:33.049689 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356d148-9990-429d-bd34-8d57bceba95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:33.051104 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356d148-9990-429d-bd34-8d57bceba95f None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:33.051753 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356d148-9990-429d-bd34-8d57bceba95f None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:33.051883 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356d148-9990-429d-bd34-8d57bceba95f None admin] PATH_INFO: `/v3/users/0616a4eb01db4ae8ac6d10f710fd1630` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:33.053102 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356d148-9990-429d-bd34-8d57bceba95f None admin] RBAC: Authorizing `identity:get_user(user_id=0616a4eb01db4ae8ac6d10f710fd1630)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:33.054605 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356d148-9990-429d-bd34-8d57bceba95f None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:33.056495 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 62/124] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:44:32 2022] GET /identity/v3/users/0616a4eb01db4ae8ac6d10f710fd1630 => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:33.057956 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889a1c9-f384-45f5-9964-8c64729f7e71 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:33.057956 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889a1c9-f384-45f5-9964-8c64729f7e71 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:33.058241 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889a1c9-f384-45f5-9964-8c64729f7e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:33.074612 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-a889a1c9-f384-45f5-9964-8c64729f7e71 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:33.075948 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-a889a1c9-f384-45f5-9964-8c64729f7e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:33.096079 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:33.146038 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 63/125] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:44:33.146729 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889a1c9-f384-45f5-9964-8c64729f7e71 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:33.150079 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:33.156951 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2eff02-81ae-4863-80ce-698bfbcbb13a None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:33.195689 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80ad14-cbee-4dfc-83af-a2f9db755842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:33.196961 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80ad14-cbee-4dfc-83af-a2f9db755842 None admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:33.197474 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80ad14-cbee-4dfc-83af-a2f9db755842 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:33.198048 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80ad14-cbee-4dfc-83af-a2f9db755842 None admin] PATH_INFO: `/v3/projects/437ab37ab6104629b1199c45fdd0b804/users/54ceb1595a2943459ed05f05f288a335/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:33.200446 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a80ad14-cbee-4dfc-83af-a2f9db755842 None admin] RBAC: Authorizing `identity:create_grant(project_id=437ab37ab6104629b1199c45fdd0b804, user_id=54ceb1595a2943459ed05f05f288a335, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:33.202355 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a80ad14-cbee-4dfc-83af-a2f9db755842 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:33.219204 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 63/126] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Jun 3 11:44:33 2022] PUT /identity/v3/projects/437ab37ab6104629b1199c45fdd0b804/users/54ceb1595a2943459ed05f05f288a335/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:44:33.219859 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80ad14-cbee-4dfc-83af-a2f9db755842 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:33.270754 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889a1c9-f384-45f5-9964-8c64729f7e71 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:33.311085 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dde9f1-e5ee-44a4-bdfd-de91e378e45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:33.312242 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dde9f1-e5ee-44a4-bdfd-de91e378e45d None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:33.312762 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dde9f1-e5ee-44a4-bdfd-de91e378e45d None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:33.313235 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dde9f1-e5ee-44a4-bdfd-de91e378e45d None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:33.314322 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dde9f1-e5ee-44a4-bdfd-de91e378e45d None admin] RBAC: Adding query filter params (name=member) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:33.314827 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dde9f1-e5ee-44a4-bdfd-de91e378e45d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:33.316628 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dde9f1-e5ee-44a4-bdfd-de91e378e45d None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:33.326398 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 64/127] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 3 11:44:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:33.327597 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dde9f1-e5ee-44a4-bdfd-de91e378e45d None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:33.336829 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80ad14-cbee-4dfc-83af-a2f9db755842 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:33.348269 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:33.379515 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3c8f3-74af-4676-8398-22580f540028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:33.380529 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3c8f3-74af-4676-8398-22580f540028 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:33.380811 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3c8f3-74af-4676-8398-22580f540028 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:33.381220 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3c8f3-74af-4676-8398-22580f540028 None admin] PATH_INFO: `/v3/projects/437ab37ab6104629b1199c45fdd0b804` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:33.382915 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a3c8f3-74af-4676-8398-22580f540028 None admin] RBAC: Authorizing `identity:get_project(project_id=437ab37ab6104629b1199c45fdd0b804)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:33.384585 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a3c8f3-74af-4676-8398-22580f540028 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:33.386379 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 64/128] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:44:33 2022] GET /identity/v3/projects/437ab37ab6104629b1199c45fdd0b804 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:33.387243 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3c8f3-74af-4676-8398-22580f540028 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:33.405983 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:33.451120 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dde9f1-e5ee-44a4-bdfd-de91e378e45d None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:33.489971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b40a631-da68-4131-b0d5-1df7af9a89a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:33.491167 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40a631-da68-4131-b0d5-1df7af9a89a1 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:33.491704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40a631-da68-4131-b0d5-1df7af9a89a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:33.492317 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40a631-da68-4131-b0d5-1df7af9a89a1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:33.499114 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3c8f3-74af-4676-8398-22580f540028 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:33.506003 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b40a631-da68-4131-b0d5-1df7af9a89a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:44:33.515047 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-1b40a631-da68-4131-b0d5-1df7af9a89a1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 11:44:33.515047 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:44:33.515047 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:44:33.515047 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:44:33.515047 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:44:33.515047 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:44:33.515047 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:44:33.515047 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:44:33.515047 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:44:33.515047 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:44:33.515047 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:44:33.515047 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:44:33.515047 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:44:33.515047 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:44:33.515047 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:44:33.515047 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:44:33.516067 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:44:33.516067 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:44:33.516067 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:44:33.516067 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:44:33.516067 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:44:33.516067 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:44:33.516067 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:44:33.516067 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:44:33.516067 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:44:33.516067 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:44:33.516067 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:44:33.516067 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:44:33.516067 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:44:33.516067 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:44:33.516067 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:44:33.516067 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:44:33.516847 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:44:33.516847 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:44:33.516847 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:44:33.516847 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:44:33.516847 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:44:33.516847 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:44:33.516847 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:44:33.516847 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:44:33.516847 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:44:33.516847 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:44:33.516847 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 11:44:33.516847 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:44:33.519934 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 65/129] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Jun 3 11:44:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:44:33.520979 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b40a631-da68-4131-b0d5-1df7af9a89a1 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:33.535638 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e7c56-a8cb-4081-8f82-ee61dfabca51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:33.536559 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e7c56-a8cb-4081-8f82-ee61dfabca51 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:33.536849 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e7c56-a8cb-4081-8f82-ee61dfabca51 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:33.537083 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e7c56-a8cb-4081-8f82-ee61dfabca51 None admin] PATH_INFO: `/v3/users/54ceb1595a2943459ed05f05f288a335` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:33.538329 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764e7c56-a8cb-4081-8f82-ee61dfabca51 None admin] RBAC: Authorizing `identity:get_user(user_id=54ceb1595a2943459ed05f05f288a335)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:33.540849 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764e7c56-a8cb-4081-8f82-ee61dfabca51 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:33.544676 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 65/130] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:44:33 2022] GET /identity/v3/users/54ceb1595a2943459ed05f05f288a335 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:33.545547 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e7c56-a8cb-4081-8f82-ee61dfabca51 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:33.594164 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:33.642915 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b40a631-da68-4131-b0d5-1df7af9a89a1 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:33.656363 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e7c56-a8cb-4081-8f82-ee61dfabca51 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:33.672595 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:33.686745 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a54798-365d-4816-b8be-3204dc56390b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:33.688147 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a54798-365d-4816-b8be-3204dc56390b None admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:33.688633 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a54798-365d-4816-b8be-3204dc56390b None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:33.689071 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a54798-365d-4816-b8be-3204dc56390b None admin] PATH_INFO: `/v3/projects/437ab37ab6104629b1199c45fdd0b804/users/0616a4eb01db4ae8ac6d10f710fd1630/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:33.694568 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a54798-365d-4816-b8be-3204dc56390b None admin] RBAC: Authorizing `identity:create_grant(project_id=437ab37ab6104629b1199c45fdd0b804, user_id=0616a4eb01db4ae8ac6d10f710fd1630, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:33.696263 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a54798-365d-4816-b8be-3204dc56390b None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:33.697105 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e722a5-dca8-410b-b93f-aef4d21f60fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:33.697789 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e722a5-dca8-410b-b93f-aef4d21f60fc None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:33.698073 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e722a5-dca8-410b-b93f-aef4d21f60fc None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:33.698348 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e722a5-dca8-410b-b93f-aef4d21f60fc None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:33.699113 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e722a5-dca8-410b-b93f-aef4d21f60fc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:33.699417 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e722a5-dca8-410b-b93f-aef4d21f60fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:33.700818 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e722a5-dca8-410b-b93f-aef4d21f60fc None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:33.714292 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 66/131] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:44:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:33.715194 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 66/132] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Jun 3 11:44:33 2022] PUT /identity/v3/projects/437ab37ab6104629b1199c45fdd0b804/users/0616a4eb01db4ae8ac6d10f710fd1630/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:44:33.715451 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e722a5-dca8-410b-b93f-aef4d21f60fc None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:33.720392 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a54798-365d-4816-b8be-3204dc56390b None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:33.825279 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e722a5-dca8-410b-b93f-aef4d21f60fc None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:33.833354 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:33.863766 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8110f6-c1ae-495c-b3e0-60c8526dfc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:33.864699 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8110f6-c1ae-495c-b3e0-60c8526dfc1f None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:33.865039 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8110f6-c1ae-495c-b3e0-60c8526dfc1f None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:33.865319 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8110f6-c1ae-495c-b3e0-60c8526dfc1f None admin] PATH_INFO: `/v3/projects/ea51488356414c4bb3aa2c00cfc089e4` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:33.866534 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8110f6-c1ae-495c-b3e0-60c8526dfc1f None admin] RBAC: Authorizing `identity:get_project(project_id=ea51488356414c4bb3aa2c00cfc089e4)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:33.868040 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8110f6-c1ae-495c-b3e0-60c8526dfc1f None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:33.870042 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 67/133] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:44:33 2022] GET /identity/v3/projects/ea51488356414c4bb3aa2c00cfc089e4 => generated 312 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:33.875726 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8110f6-c1ae-495c-b3e0-60c8526dfc1f None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:33.920480 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a54798-365d-4816-b8be-3204dc56390b None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:33.983284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8110f6-c1ae-495c-b3e0-60c8526dfc1f None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:33.989156 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c5d62-8589-47b7-9d0a-b90b59ae3ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:33.990071 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c5d62-8589-47b7-9d0a-b90b59ae3ffa None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:33.990362 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c5d62-8589-47b7-9d0a-b90b59ae3ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:33.990646 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c5d62-8589-47b7-9d0a-b90b59ae3ffa None admin] PATH_INFO: `/v3/users/54ceb1595a2943459ed05f05f288a335` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:33.992244 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c5d62-8589-47b7-9d0a-b90b59ae3ffa None admin] RBAC: Authorizing `identity:get_user(user_id=54ceb1595a2943459ed05f05f288a335)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:33.993768 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c5d62-8589-47b7-9d0a-b90b59ae3ffa None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:33.995704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 67/134] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:44:33 2022] GET /identity/v3/users/54ceb1595a2943459ed05f05f288a335 => generated 275 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:34.004441 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c5d62-8589-47b7-9d0a-b90b59ae3ffa None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:34.022584 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522acda-45c6-4252-9a1c-e8fc78e7266d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:34.023546 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522acda-45c6-4252-9a1c-e8fc78e7266d None admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:34.023839 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522acda-45c6-4252-9a1c-e8fc78e7266d None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:34.024379 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522acda-45c6-4252-9a1c-e8fc78e7266d None admin] PATH_INFO: `/v3/projects/ea51488356414c4bb3aa2c00cfc089e4/users/54ceb1595a2943459ed05f05f288a335/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:34.026983 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3522acda-45c6-4252-9a1c-e8fc78e7266d None admin] RBAC: Authorizing `identity:create_grant(project_id=ea51488356414c4bb3aa2c00cfc089e4, user_id=54ceb1595a2943459ed05f05f288a335, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:34.029005 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3522acda-45c6-4252-9a1c-e8fc78e7266d None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:34.044743 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 68/135] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Jun 3 11:44:33 2022] PUT /identity/v3/projects/ea51488356414c4bb3aa2c00cfc089e4/users/54ceb1595a2943459ed05f05f288a335/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 11:44:34.120365 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:34.184117 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c5d62-8589-47b7-9d0a-b90b59ae3ffa None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:34.224730 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165ff63-0515-45c6-8391-9c9970fae617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:34.225619 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165ff63-0515-45c6-8391-9c9970fae617 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:34.225906 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165ff63-0515-45c6-8391-9c9970fae617 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:34.226188 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165ff63-0515-45c6-8391-9c9970fae617 None admin] PATH_INFO: `/v3/projects/437ab37ab6104629b1199c45fdd0b804` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:34.227460 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5165ff63-0515-45c6-8391-9c9970fae617 None admin] RBAC: Authorizing `identity:get_project(project_id=437ab37ab6104629b1199c45fdd0b804)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:34.228978 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5165ff63-0515-45c6-8391-9c9970fae617 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:34.230732 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 68/136] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:44:34 2022] GET /identity/v3/projects/437ab37ab6104629b1199c45fdd0b804 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:34.236721 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522acda-45c6-4252-9a1c-e8fc78e7266d None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:34.282894 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:34.353339 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522acda-45c6-4252-9a1c-e8fc78e7266d None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:34.388999 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd42297c-77ed-4852-aafd-cf5768def39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:34.389967 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42297c-77ed-4852-aafd-cf5768def39c None admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:34.390255 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42297c-77ed-4852-aafd-cf5768def39c None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:34.390635 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42297c-77ed-4852-aafd-cf5768def39c None admin] PATH_INFO: `/v3/projects/437ab37ab6104629b1199c45fdd0b804/users/54ceb1595a2943459ed05f05f288a335/roles/5d1199580aaa485bb120b35e6f771ff9` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:34.392937 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd42297c-77ed-4852-aafd-cf5768def39c None admin] RBAC: Authorizing `identity:create_grant(project_id=437ab37ab6104629b1199c45fdd0b804, user_id=54ceb1595a2943459ed05f05f288a335, role_id=5d1199580aaa485bb120b35e6f771ff9)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:34.394478 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd42297c-77ed-4852-aafd-cf5768def39c None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:34.414893 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 69/137] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Jun 3 11:44:34 2022] PUT /identity/v3/projects/437ab37ab6104629b1199c45fdd0b804/users/54ceb1595a2943459ed05f05f288a335/roles/5d1199580aaa485bb120b35e6f771ff9 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:44:35.299307 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485db1ab-e4d7-4585-b673-be8e0ada3525 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:35.300408 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485db1ab-e4d7-4585-b673-be8e0ada3525 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:35.300408 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485db1ab-e4d7-4585-b673-be8e0ada3525 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:35.301857 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 69/138] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:44:35.317891 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae18ab2-8ac1-4261-a1b4-ae308ebb4718 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:35.318414 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae18ab2-8ac1-4261-a1b4-ae308ebb4718 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:35.318494 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae18ab2-8ac1-4261-a1b4-ae308ebb4718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:35.340564 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-8ae18ab2-8ac1-4261-a1b4-ae308ebb4718 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:35.341775 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-8ae18ab2-8ac1-4261-a1b4-ae308ebb4718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:35.429160 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 70/139] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:44:35.472791 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485db1ab-e4d7-4585-b673-be8e0ada3525 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:35.597779 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485db1ab-e4d7-4585-b673-be8e0ada3525 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:35.622671 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:35.643242 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41e8fc-182f-4446-9b1c-cdb04b473065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:35.644078 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41e8fc-182f-4446-9b1c-cdb04b473065 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:35.644362 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41e8fc-182f-4446-9b1c-cdb04b473065 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:35.644637 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41e8fc-182f-4446-9b1c-cdb04b473065 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:35.645805 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41e8fc-182f-4446-9b1c-cdb04b473065 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:35.647255 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41e8fc-182f-4446-9b1c-cdb04b473065 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:35.649517 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 70/140] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:44:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:35.654843 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae18ab2-8ac1-4261-a1b4-ae308ebb4718 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:35.690427 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:35.807476 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae18ab2-8ac1-4261-a1b4-ae308ebb4718 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:35.861184 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2437326c-1e9a-444e-a09f-6e97adeb3c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:35.861802 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437326c-1e9a-444e-a09f-6e97adeb3c38 None admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:35.862117 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437326c-1e9a-444e-a09f-6e97adeb3c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:35.862398 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437326c-1e9a-444e-a09f-6e97adeb3c38 None admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:35.863116 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2437326c-1e9a-444e-a09f-6e97adeb3c38 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:35.864616 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2437326c-1e9a-444e-a09f-6e97adeb3c38 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:35.911980 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 71/141] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Jun 3 11:44:35 2022] POST /identity/v3/users => generated 283 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:44:36.071133 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53793e47-a084-4788-9213-bb4fc51c612f None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:36.071457 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53793e47-a084-4788-9213-bb4fc51c612f None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:36.071743 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53793e47-a084-4788-9213-bb4fc51c612f None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:36.073473 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 71/142] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:44:36.078811 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742ace7-3c6c-487e-a48d-f960c4c7137b None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:36.079374 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742ace7-3c6c-487e-a48d-f960c4c7137b None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:36.079880 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742ace7-3c6c-487e-a48d-f960c4c7137b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:36.100798 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-5742ace7-3c6c-487e-a48d-f960c4c7137b None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:36.102438 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-5742ace7-3c6c-487e-a48d-f960c4c7137b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:36.196534 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 72/143] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:44:36.221069 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53793e47-a084-4788-9213-bb4fc51c612f None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:36.337763 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53793e47-a084-4788-9213-bb4fc51c612f None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:36.358567 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd4a09-101e-4cad-a23a-edf992bbb0d5 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:36.359541 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd4a09-101e-4cad-a23a-edf992bbb0d5 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:36.360041 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd4a09-101e-4cad-a23a-edf992bbb0d5 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:36.361616 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 73/144] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 11:44:36.367479 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd152dae-3665-4a6e-b323-ea09067bd804 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:36.368056 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd152dae-3665-4a6e-b323-ea09067bd804 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:36.368530 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd152dae-3665-4a6e-b323-ea09067bd804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:36.388725 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849d474-f943-4e75-a088-81a8fb3d1366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:36.389873 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849d474-f943-4e75-a088-81a8fb3d1366 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:36.390350 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849d474-f943-4e75-a088-81a8fb3d1366 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:36.390830 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849d474-f943-4e75-a088-81a8fb3d1366 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:36.394326 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-cd152dae-3665-4a6e-b323-ea09067bd804 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:36.397141 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-cd152dae-3665-4a6e-b323-ea09067bd804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:36.405661 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:36.420432 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b849d474-f943-4e75-a088-81a8fb3d1366 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:44:36.430558 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-b849d474-f943-4e75-a088-81a8fb3d1366 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 11:44:36.430558 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:44:36.430558 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:44:36.430558 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:44:36.430558 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:44:36.430558 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:44:36.430558 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:44:36.430558 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:44:36.430558 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:44:36.430558 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:44:36.430558 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:44:36.430558 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:44:36.430558 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:44:36.430558 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:44:36.430558 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:44:36.430558 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:44:36.431482 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:44:36.431482 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:44:36.431482 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:44:36.431482 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:44:36.431482 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:44:36.431482 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:44:36.431482 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:44:36.431482 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:44:36.431482 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:44:36.431482 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:44:36.431482 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:44:36.431482 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:44:36.431482 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:44:36.431482 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:44:36.431482 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:44:36.431482 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:44:36.432331 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:44:36.432331 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:44:36.432331 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:44:36.432331 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:44:36.432331 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:44:36.432331 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:44:36.432331 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:44:36.432331 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:44:36.432331 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:44:36.432331 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:44:36.432331 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 11:44:36.432331 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:44:36.434386 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 72/145] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:44:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:44:36.440530 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849d474-f943-4e75-a088-81a8fb3d1366 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:36.522885 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 74/146] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 11:44:36.550372 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd152dae-3665-4a6e-b323-ea09067bd804 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:36.575529 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:36.637303 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849d474-f943-4e75-a088-81a8fb3d1366 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:36.679097 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24935c64-8c5e-46de-a142-4353d797411e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:36.679820 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24935c64-8c5e-46de-a142-4353d797411e None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:36.680114 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24935c64-8c5e-46de-a142-4353d797411e None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:36.680392 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24935c64-8c5e-46de-a142-4353d797411e None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:36.681212 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24935c64-8c5e-46de-a142-4353d797411e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:36.681523 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24935c64-8c5e-46de-a142-4353d797411e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:36.683098 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24935c64-8c5e-46de-a142-4353d797411e None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:36.697563 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 73/147] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 3 11:44:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:36.700351 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24935c64-8c5e-46de-a142-4353d797411e None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:36.739068 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd152dae-3665-4a6e-b323-ea09067bd804 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:36.801365 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f0182a-73ce-4136-bd3e-8fb8625bd56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:36.802112 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0182a-73ce-4136-bd3e-8fb8625bd56d None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:36.802403 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0182a-73ce-4136-bd3e-8fb8625bd56d None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:36.802677 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0182a-73ce-4136-bd3e-8fb8625bd56d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:36.811236 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:36.818919 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f0182a-73ce-4136-bd3e-8fb8625bd56d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:44:36.821228 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24935c64-8c5e-46de-a142-4353d797411e None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:36.827791 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-14f0182a-73ce-4136-bd3e-8fb8625bd56d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 11:44:36.827791 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:44:36.827791 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:44:36.827791 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:44:36.827791 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:44:36.827791 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:44:36.827791 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:44:36.827791 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:44:36.827791 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:44:36.827791 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:44:36.827791 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:44:36.827791 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:44:36.827791 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:44:36.827791 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:44:36.827791 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:44:36.827791 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:44:36.828679 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:44:36.828679 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:44:36.828679 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:44:36.828679 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:44:36.828679 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:44:36.828679 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:44:36.828679 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:44:36.828679 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:44:36.828679 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:44:36.828679 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:44:36.828679 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:44:36.828679 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:44:36.828679 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:44:36.828679 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:44:36.828679 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:44:36.828679 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:44:36.829437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:44:36.829437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:44:36.829437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:44:36.829437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:44:36.829437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:44:36.829437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:44:36.829437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:44:36.829437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:44:36.829437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:44:36.829437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:44:36.829437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 11:44:36.829437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:44:36.830196 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 75/148] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:44:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:44:36.842822 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:36.850018 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f0182a-73ce-4136-bd3e-8fb8625bd56d None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:36.878041 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15852547-f518-48a7-808d-ddd3c3711973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:36.878928 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15852547-f518-48a7-808d-ddd3c3711973 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:36.879315 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15852547-f518-48a7-808d-ddd3c3711973 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:36.879615 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15852547-f518-48a7-808d-ddd3c3711973 None admin] PATH_INFO: `/v3/users/46738e3728ba4d518b8b9b13756a8440` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:36.880960 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15852547-f518-48a7-808d-ddd3c3711973 None admin] RBAC: Authorizing `identity:get_user(user_id=46738e3728ba4d518b8b9b13756a8440)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:36.882537 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15852547-f518-48a7-808d-ddd3c3711973 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:36.884614 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 74/149] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:44:36 2022] GET /identity/v3/users/46738e3728ba4d518b8b9b13756a8440 => generated 289 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:36.889966 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15852547-f518-48a7-808d-ddd3c3711973 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:36.968837 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f0182a-73ce-4136-bd3e-8fb8625bd56d None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:37.019337 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f781b70-b423-4e4b-8564-a1dfbacee314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:37.020050 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f781b70-b423-4e4b-8564-a1dfbacee314 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:37.020329 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f781b70-b423-4e4b-8564-a1dfbacee314 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:37.020601 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f781b70-b423-4e4b-8564-a1dfbacee314 None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:37.021365 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f781b70-b423-4e4b-8564-a1dfbacee314 None admin] RBAC: Adding query filter params (name=member) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:37.021670 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f781b70-b423-4e4b-8564-a1dfbacee314 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:37.023073 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f781b70-b423-4e4b-8564-a1dfbacee314 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:37.029275 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15852547-f518-48a7-808d-ddd3c3711973 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:37.044945 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 76/150] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 3 11:44:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:44:37.069319 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f781b70-b423-4e4b-8564-a1dfbacee314 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:37.071628 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137bea66-2784-4564-ad8f-0d2bfad724e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:37.072603 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bea66-2784-4564-ad8f-0d2bfad724e4 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:37.072890 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bea66-2784-4564-ad8f-0d2bfad724e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:37.073161 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bea66-2784-4564-ad8f-0d2bfad724e4 None admin] PATH_INFO: `/v3/projects/437ab37ab6104629b1199c45fdd0b804` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:37.074468 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137bea66-2784-4564-ad8f-0d2bfad724e4 None admin] RBAC: Authorizing `identity:get_project(project_id=437ab37ab6104629b1199c45fdd0b804)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:37.075951 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137bea66-2784-4564-ad8f-0d2bfad724e4 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:37.078184 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 75/151] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:44:36 2022] GET /identity/v3/projects/437ab37ab6104629b1199c45fdd0b804 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:37.084037 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137bea66-2784-4564-ad8f-0d2bfad724e4 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:37.139894 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:37.185235 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:37.197442 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137bea66-2784-4564-ad8f-0d2bfad724e4 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:37.235086 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad37195-86e5-4ce2-9b37-1f167e1a90cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:37.236381 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad37195-86e5-4ce2-9b37-1f167e1a90cc None admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:37.236875 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad37195-86e5-4ce2-9b37-1f167e1a90cc None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:37.237377 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad37195-86e5-4ce2-9b37-1f167e1a90cc None admin] PATH_INFO: `/v3/projects/437ab37ab6104629b1199c45fdd0b804/users/46738e3728ba4d518b8b9b13756a8440/roles/c2a1a291255141b3b6eee6132725bfff` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:37.239966 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad37195-86e5-4ce2-9b37-1f167e1a90cc None admin] RBAC: Authorizing `identity:create_grant(project_id=437ab37ab6104629b1199c45fdd0b804, user_id=46738e3728ba4d518b8b9b13756a8440, role_id=c2a1a291255141b3b6eee6132725bfff)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:37.241828 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad37195-86e5-4ce2-9b37-1f167e1a90cc None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:37.253120 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f781b70-b423-4e4b-8564-a1dfbacee314 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:37.262755 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 76/152] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Jun 3 11:44:37 2022] PUT /identity/v3/projects/437ab37ab6104629b1199c45fdd0b804/users/46738e3728ba4d518b8b9b13756a8440/roles/c2a1a291255141b3b6eee6132725bfff => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 11:44:37.304411 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc5b49-980f-4fbf-9c4f-aa742451d89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:37.305751 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc5b49-980f-4fbf-9c4f-aa742451d89d None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:37.306335 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc5b49-980f-4fbf-9c4f-aa742451d89d None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:37.306801 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc5b49-980f-4fbf-9c4f-aa742451d89d None admin] PATH_INFO: `/v3/users/54ceb1595a2943459ed05f05f288a335` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:37.308606 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc5b49-980f-4fbf-9c4f-aa742451d89d None admin] RBAC: Authorizing `identity:get_user(user_id=54ceb1595a2943459ed05f05f288a335)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:37.310524 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc5b49-980f-4fbf-9c4f-aa742451d89d None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:37.312732 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 77/153] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:44:37 2022] GET /identity/v3/users/54ceb1595a2943459ed05f05f288a335 => generated 275 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:37.319138 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad37195-86e5-4ce2-9b37-1f167e1a90cc None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:37.435867 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad37195-86e5-4ce2-9b37-1f167e1a90cc None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:37.440877 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9de697-4d20-4262-87d0-dc7e3ac840eb None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:37.441746 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9de697-4d20-4262-87d0-dc7e3ac840eb None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:37.442237 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9de697-4d20-4262-87d0-dc7e3ac840eb None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:37.443988 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 78/154] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 11:44:37.449867 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81783f-3778-456e-9fe2-f6b90a1f86e5 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:37.450164 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81783f-3778-456e-9fe2-f6b90a1f86e5 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:37.450438 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e81783f-3778-456e-9fe2-f6b90a1f86e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:37.452193 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:37.483555 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-2e81783f-3778-456e-9fe2-f6b90a1f86e5 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:37.484780 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-2e81783f-3778-456e-9fe2-f6b90a1f86e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:37.487925 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c04e64c-2c96-4b10-9804-bc2e94310aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:37.488905 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04e64c-2c96-4b10-9804-bc2e94310aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:37.489472 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04e64c-2c96-4b10-9804-bc2e94310aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:37.489950 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04e64c-2c96-4b10-9804-bc2e94310aa2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:37.568839 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c04e64c-2c96-4b10-9804-bc2e94310aa2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:37.570736 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c04e64c-2c96-4b10-9804-bc2e94310aa2 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:37.601275 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 79/155] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:44:37.628450 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e81783f-3778-456e-9fe2-f6b90a1f86e5 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:37.694296 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 77/156] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:44:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 03 11:44:37.709436 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c04e64c-2c96-4b10-9804-bc2e94310aa2 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:37.718522 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:37.741041 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:37.807552 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e81783f-3778-456e-9fe2-f6b90a1f86e5 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:37.827317 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c04e64c-2c96-4b10-9804-bc2e94310aa2 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:37.865390 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643fb18a-32fe-4ebd-9088-fe3402f3bfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:37.866626 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fb18a-32fe-4ebd-9088-fe3402f3bfd1 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:37.867109 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fb18a-32fe-4ebd-9088-fe3402f3bfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:37.867624 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fb18a-32fe-4ebd-9088-fe3402f3bfd1 None admin] PATH_INFO: `/v3/projects/437ab37ab6104629b1199c45fdd0b804` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:37.869375 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643fb18a-32fe-4ebd-9088-fe3402f3bfd1 None admin] RBAC: Authorizing `identity:get_project(project_id=437ab37ab6104629b1199c45fdd0b804)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:37.871178 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643fb18a-32fe-4ebd-9088-fe3402f3bfd1 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:37.873132 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 78/157] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:44:37 2022] GET /identity/v3/projects/437ab37ab6104629b1199c45fdd0b804 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:44:37.874821 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b1023-6223-4404-8f1e-0a503a2a41a0 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:37.874999 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e52e41-451c-4b38-8525-36c9c701bc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:37.875523 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b1023-6223-4404-8f1e-0a503a2a41a0 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:37.875825 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e52e41-451c-4b38-8525-36c9c701bc41 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:37.876111 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e52e41-451c-4b38-8525-36c9c701bc41 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:37.876395 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e52e41-451c-4b38-8525-36c9c701bc41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:37.876662 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b1023-6223-4404-8f1e-0a503a2a41a0 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:37.878151 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 79/158] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:44:37.885115 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b1023-6223-4404-8f1e-0a503a2a41a0 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:37.912255 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e52e41-451c-4b38-8525-36c9c701bc41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:44:37.924285 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-a4e52e41-451c-4b38-8525-36c9c701bc41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:44:37.924285 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:44:37.924285 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:44:37.924285 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:44:37.924285 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:44:37.924285 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:44:37.924285 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:44:37.924285 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:44:37.924285 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:44:37.924285 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:44:37.924285 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:44:37.924285 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:44:37.924285 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:44:37.924285 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:44:37.924285 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:44:37.924285 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:44:37.925877 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:44:37.925877 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:44:37.925877 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:44:37.925877 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:44:37.925877 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:44:37.925877 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:44:37.925877 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:44:37.925877 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:44:37.925877 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:44:37.925877 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:44:37.925877 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:44:37.925877 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:44:37.925877 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:44:37.925877 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:44:37.925877 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:44:37.925877 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:44:37.926644 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:44:37.926644 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:44:37.926644 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:44:37.926644 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:44:37.926644 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:44:37.926644 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:44:37.926644 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:44:37.926644 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:44:37.926644 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:44:37.926644 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:44:37.926644 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:44:37.926644 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:44:37.926644 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 80/159] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 3 11:44:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:44:37.927860 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6cac13-d10e-40bf-9e9d-6659a6e6a332 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:37.928038 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6cac13-d10e-40bf-9e9d-6659a6e6a332 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:37.928299 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6cac13-d10e-40bf-9e9d-6659a6e6a332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:37.961410 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-fe6cac13-d10e-40bf-9e9d-6659a6e6a332 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:37.962533 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-fe6cac13-d10e-40bf-9e9d-6659a6e6a332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:37.980165 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:38.004816 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b1023-6223-4404-8f1e-0a503a2a41a0 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:38.042224 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a6e41-3760-472f-9768-fc488de961a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:38.043293 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a6e41-3760-472f-9768-fc488de961a8 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:38.043825 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a6e41-3760-472f-9768-fc488de961a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:38.044361 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a6e41-3760-472f-9768-fc488de961a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:38.045430 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a6e41-3760-472f-9768-fc488de961a8 None admin] RBAC: Adding query filter params (role.id=781e2d573ee94afaae05b3cc0bba8768, scope.project.id=437ab37ab6104629b1199c45fdd0b804, user.id=54ceb1595a2943459ed05f05f288a335) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:38.045962 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a6e41-3760-472f-9768-fc488de961a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:38.047854 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a6e41-3760-472f-9768-fc488de961a8 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:38.055925 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 80/160] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:44:37 2022] GET /identity/v3/role_assignments?user.id=54ceb1595a2943459ed05f05f288a335&scope.project.id=437ab37ab6104629b1199c45fdd0b804&role.id=781e2d573ee94afaae05b3cc0bba8768 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:38.057009 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a6e41-3760-472f-9768-fc488de961a8 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:38.100032 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 81/161] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:44:38.125219 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6cac13-d10e-40bf-9e9d-6659a6e6a332 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:38.210270 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a6e41-3760-472f-9768-fc488de961a8 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:38.254100 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c9995-c470-4e54-a3dd-0c35365f416d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:38.255197 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c9995-c470-4e54-a3dd-0c35365f416d None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:38.255708 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c9995-c470-4e54-a3dd-0c35365f416d None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:38.256184 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c9995-c470-4e54-a3dd-0c35365f416d None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:38.257158 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c9995-c470-4e54-a3dd-0c35365f416d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:38.257659 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c9995-c470-4e54-a3dd-0c35365f416d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:38.259343 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c9995-c470-4e54-a3dd-0c35365f416d None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:38.263254 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:38.265737 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:38.269969 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 81/162] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:44:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:38.279812 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c9995-c470-4e54-a3dd-0c35365f416d None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:38.408724 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6cac13-d10e-40bf-9e9d-6659a6e6a332 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:38.476861 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d4c1d-5640-47ce-bafe-4a39d7e3af05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:38.477465 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d4c1d-5640-47ce-bafe-4a39d7e3af05 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:38.477538 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d4c1d-5640-47ce-bafe-4a39d7e3af05 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:38.477817 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d4c1d-5640-47ce-bafe-4a39d7e3af05 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:38.501891 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9d4c1d-5640-47ce-bafe-4a39d7e3af05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:44:38.511109 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-ca9d4c1d-5640-47ce-bafe-4a39d7e3af05 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 11:44:38.511109 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:44:38.511109 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:44:38.511109 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:44:38.511109 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:44:38.511109 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:44:38.511109 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:44:38.511109 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:44:38.511109 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:44:38.511109 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:44:38.511109 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:44:38.511109 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:44:38.511109 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:44:38.511109 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:44:38.511109 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:44:38.511109 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:44:38.512014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:44:38.512014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:44:38.512014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:44:38.512014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:44:38.512014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:44:38.512014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:44:38.512014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:44:38.512014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:44:38.512014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:44:38.512014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:44:38.512014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:44:38.512014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:44:38.512014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:44:38.512014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:44:38.512014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:44:38.512014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:44:38.512796 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:44:38.512796 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:44:38.512796 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:44:38.512796 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:44:38.512796 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:44:38.512796 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:44:38.512796 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:44:38.512796 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:44:38.512796 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:44:38.512796 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:44:38.512796 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 11:44:38.512796 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:44:38.516726 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 82/163] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Jun 3 11:44:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:44:38.517980 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5dc46-2fb1-4418-b9ca-157710276534 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:38.518281 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5dc46-2fb1-4418-b9ca-157710276534 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:38.518561 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5dc46-2fb1-4418-b9ca-157710276534 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:38.525045 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 83/164] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:44:38.526875 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5dc46-2fb1-4418-b9ca-157710276534 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:38.585544 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c9995-c470-4e54-a3dd-0c35365f416d None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:38.651234 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2231eab-fa32-40d4-b2dd-dedd27f30d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:38.652668 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2231eab-fa32-40d4-b2dd-dedd27f30d34 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:38.653137 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2231eab-fa32-40d4-b2dd-dedd27f30d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:38.653621 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2231eab-fa32-40d4-b2dd-dedd27f30d34 None admin] PATH_INFO: `/v3/users/0616a4eb01db4ae8ac6d10f710fd1630` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:38.655060 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2231eab-fa32-40d4-b2dd-dedd27f30d34 None admin] RBAC: Authorizing `identity:get_user(user_id=0616a4eb01db4ae8ac6d10f710fd1630)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:38.657394 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2231eab-fa32-40d4-b2dd-dedd27f30d34 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:38.663457 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 82/165] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:44:38 2022] GET /identity/v3/users/0616a4eb01db4ae8ac6d10f710fd1630 => generated 247 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:38.665335 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673fad0-b340-418e-bf1f-e38313019b58 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:38.665817 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673fad0-b340-418e-bf1f-e38313019b58 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:38.666270 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673fad0-b340-418e-bf1f-e38313019b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:38.690729 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-3673fad0-b340-418e-bf1f-e38313019b58 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:38.692375 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-3673fad0-b340-418e-bf1f-e38313019b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:38.735027 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5dc46-2fb1-4418-b9ca-157710276534 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:38.751581 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:38.800858 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724fd8b-abce-4778-a49c-817cd09d6bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:38.801544 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724fd8b-abce-4778-a49c-817cd09d6bf3 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:38.801899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724fd8b-abce-4778-a49c-817cd09d6bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:38.802247 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724fd8b-abce-4778-a49c-817cd09d6bf3 None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:38.803081 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724fd8b-abce-4778-a49c-817cd09d6bf3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:38.804675 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724fd8b-abce-4778-a49c-817cd09d6bf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:38.804996 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724fd8b-abce-4778-a49c-817cd09d6bf3 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:38.811842 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:38.817979 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 83/166] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:44:38.818950 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3673fad0-b340-418e-bf1f-e38313019b58 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:38.829730 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 84/167] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:44:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:44:38.836569 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724fd8b-abce-4778-a49c-817cd09d6bf3 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:39.016682 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3673fad0-b340-418e-bf1f-e38313019b58 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:39.081035 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d00b8-7d74-407a-b4c1-63961314895b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:39.082225 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d00b8-7d74-407a-b4c1-63961314895b None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:39.083481 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d00b8-7d74-407a-b4c1-63961314895b None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:39.084851 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d00b8-7d74-407a-b4c1-63961314895b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:39.100455 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724fd8b-abce-4778-a49c-817cd09d6bf3 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:39.172778 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a7a09-67d6-4e11-9275-c71c85da46fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:39.173705 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a7a09-67d6-4e11-9275-c71c85da46fc None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:39.173992 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a7a09-67d6-4e11-9275-c71c85da46fc None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:39.174271 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a7a09-67d6-4e11-9275-c71c85da46fc None admin] PATH_INFO: `/v3/users/54ceb1595a2943459ed05f05f288a335` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:39.180322 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538a7a09-67d6-4e11-9275-c71c85da46fc None admin] RBAC: Authorizing `identity:get_user(user_id=54ceb1595a2943459ed05f05f288a335)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:39.181831 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538a7a09-67d6-4e11-9275-c71c85da46fc None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:39.186984 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 85/168] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:44:38 2022] GET /identity/v3/users/54ceb1595a2943459ed05f05f288a335 => generated 275 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:39.186984 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a7a09-67d6-4e11-9275-c71c85da46fc None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:39.212369 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d00b8-7d74-407a-b4c1-63961314895b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:39.213970 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d00b8-7d74-407a-b4c1-63961314895b None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:39.216002 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:39.271925 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:39.402296 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a7a09-67d6-4e11-9275-c71c85da46fc None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:39.435886 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 84/169] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:44:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 11:44:39.436756 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d00b8-7d74-407a-b4c1-63961314895b None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:39.551842 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8feeae-0311-4d81-9dae-086088790d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:39.553382 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8feeae-0311-4d81-9dae-086088790d6a None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:39.553874 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8feeae-0311-4d81-9dae-086088790d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:39.554348 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8feeae-0311-4d81-9dae-086088790d6a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:39.591032 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d00b8-7d74-407a-b4c1-63961314895b None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:39.597187 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:39.601125 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8feeae-0311-4d81-9dae-086088790d6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:44:39.615526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-8f8feeae-0311-4d81-9dae-086088790d6a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 11:44:39.615526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:44:39.615526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:44:39.615526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:44:39.615526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:44:39.615526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:44:39.615526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:44:39.615526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:44:39.615526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:44:39.615526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:44:39.615526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:44:39.615526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:44:39.615526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:44:39.615526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:44:39.615526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:44:39.615526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:44:39.616426 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:44:39.616426 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:44:39.616426 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:44:39.616426 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:44:39.616426 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:44:39.616426 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:44:39.616426 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:44:39.616426 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:44:39.616426 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:44:39.616426 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:44:39.616426 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:44:39.616426 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:44:39.616426 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:44:39.616426 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:44:39.616426 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:44:39.616426 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:44:39.617202 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:44:39.617202 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:44:39.617202 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:44:39.617202 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:44:39.617202 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:44:39.617202 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:44:39.617202 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:44:39.617202 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:44:39.617202 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:44:39.617202 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:44:39.617202 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 11:44:39.617202 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:44:39.619753 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 86/170] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:44:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 435 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:44:39.620802 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8feeae-0311-4d81-9dae-086088790d6a None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:39.684308 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dae3f7-f33c-4ba7-acd9-f4f1e51a1253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:39.684897 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dae3f7-f33c-4ba7-acd9-f4f1e51a1253 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:39.685182 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dae3f7-f33c-4ba7-acd9-f4f1e51a1253 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:39.685454 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dae3f7-f33c-4ba7-acd9-f4f1e51a1253 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:39.808553 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:39.813015 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dae3f7-f33c-4ba7-acd9-f4f1e51a1253 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:39.814820 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dae3f7-f33c-4ba7-acd9-f4f1e51a1253 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:39.817725 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8feeae-0311-4d81-9dae-086088790d6a None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:39.870206 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d21f73-43b1-44c8-ae4f-99cdd1f0935e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:39.871071 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d21f73-43b1-44c8-ae4f-99cdd1f0935e None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:39.871355 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d21f73-43b1-44c8-ae4f-99cdd1f0935e None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:39.872415 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d21f73-43b1-44c8-ae4f-99cdd1f0935e None admin] PATH_INFO: `/v3/projects/437ab37ab6104629b1199c45fdd0b804` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:39.874179 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d21f73-43b1-44c8-ae4f-99cdd1f0935e None admin] RBAC: Authorizing `identity:get_project(project_id=437ab37ab6104629b1199c45fdd0b804)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:39.875709 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d21f73-43b1-44c8-ae4f-99cdd1f0935e None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:39.880740 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 87/171] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:44:39 2022] GET /identity/v3/projects/437ab37ab6104629b1199c45fdd0b804 => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:39.881559 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d21f73-43b1-44c8-ae4f-99cdd1f0935e None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:40.009343 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d21f73-43b1-44c8-ae4f-99cdd1f0935e None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:40.026044 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 85/172] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:44:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 11:44:40.031204 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dae3f7-f33c-4ba7-acd9-f4f1e51a1253 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:40.047663 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:40.076211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ef707-e380-4d2b-ad4d-cfdf97b64f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:40.076903 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ef707-e380-4d2b-ad4d-cfdf97b64f91 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:40.077193 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ef707-e380-4d2b-ad4d-cfdf97b64f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:40.077477 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ef707-e380-4d2b-ad4d-cfdf97b64f91 None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:40.078244 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ef707-e380-4d2b-ad4d-cfdf97b64f91 None admin] RBAC: Adding query filter params (name=member) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:40.078555 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ef707-e380-4d2b-ad4d-cfdf97b64f91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:40.079988 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ef707-e380-4d2b-ad4d-cfdf97b64f91 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:40.095529 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 88/173] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 3 11:44:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:40.096458 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ef707-e380-4d2b-ad4d-cfdf97b64f91 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:40.152603 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:40.189532 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dae3f7-f33c-4ba7-acd9-f4f1e51a1253 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:40.235314 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397c63c-3ada-40b1-9f69-5b0a7da6678f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:40.236026 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397c63c-3ada-40b1-9f69-5b0a7da6678f None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:40.236430 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397c63c-3ada-40b1-9f69-5b0a7da6678f None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:40.236720 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397c63c-3ada-40b1-9f69-5b0a7da6678f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:40.237586 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c397c63c-3ada-40b1-9f69-5b0a7da6678f None admin] RBAC: Adding query filter params (role.id=c486e164840b41a59fd118dece2ce572, scope.project.id=437ab37ab6104629b1199c45fdd0b804, user.id=0616a4eb01db4ae8ac6d10f710fd1630) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:40.243957 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c397c63c-3ada-40b1-9f69-5b0a7da6678f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:40.245432 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c397c63c-3ada-40b1-9f69-5b0a7da6678f None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:40.251722 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 86/174] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:44:40 2022] GET /identity/v3/role_assignments?user.id=0616a4eb01db4ae8ac6d10f710fd1630&scope.project.id=437ab37ab6104629b1199c45fdd0b804&role.id=c486e164840b41a59fd118dece2ce572 => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:40.260687 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397c63c-3ada-40b1-9f69-5b0a7da6678f None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:40.274561 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ef707-e380-4d2b-ad4d-cfdf97b64f91 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:40.341792 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553edcaa-60f9-4a7a-8124-7954be67f285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:40.342685 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553edcaa-60f9-4a7a-8124-7954be67f285 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:40.342971 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553edcaa-60f9-4a7a-8124-7954be67f285 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:40.343250 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553edcaa-60f9-4a7a-8124-7954be67f285 None admin] PATH_INFO: `/v3/projects/437ab37ab6104629b1199c45fdd0b804` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:40.348396 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553edcaa-60f9-4a7a-8124-7954be67f285 None admin] RBAC: Authorizing `identity:get_project(project_id=437ab37ab6104629b1199c45fdd0b804)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:40.349919 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553edcaa-60f9-4a7a-8124-7954be67f285 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:40.351759 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 89/175] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:44:40 2022] GET /identity/v3/projects/437ab37ab6104629b1199c45fdd0b804 => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:40.362402 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553edcaa-60f9-4a7a-8124-7954be67f285 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:40.433740 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:40.552472 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553edcaa-60f9-4a7a-8124-7954be67f285 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:40.555899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:40.574424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397c63c-3ada-40b1-9f69-5b0a7da6678f None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:40.599516 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1215fc-c762-475d-8cea-a732c66a3cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:40.600588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1215fc-c762-475d-8cea-a732c66a3cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:40.601096 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1215fc-c762-475d-8cea-a732c66a3cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:40.601660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1215fc-c762-475d-8cea-a732c66a3cc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:40.602813 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1215fc-c762-475d-8cea-a732c66a3cc0 None admin] RBAC: Adding query filter params (role.id=5d1199580aaa485bb120b35e6f771ff9, scope.project.id=437ab37ab6104629b1199c45fdd0b804, user.id=54ceb1595a2943459ed05f05f288a335) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:40.603326 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1215fc-c762-475d-8cea-a732c66a3cc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:40.605093 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1215fc-c762-475d-8cea-a732c66a3cc0 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:40.612814 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 90/176] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:44:40 2022] GET /identity/v3/role_assignments?user.id=54ceb1595a2943459ed05f05f288a335&scope.project.id=437ab37ab6104629b1199c45fdd0b804&role.id=5d1199580aaa485bb120b35e6f771ff9 => generated 608 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:44:40.614632 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55257a21-141f-49e7-97d7-43971f59b596 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:40.615121 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55257a21-141f-49e7-97d7-43971f59b596 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:40.615657 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55257a21-141f-49e7-97d7-43971f59b596 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:40.617313 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 91/177] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:44:40.623304 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b56d1d-4e80-4035-b3f3-f4cc037e4a8b None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:40.624015 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b56d1d-4e80-4035-b3f3-f4cc037e4a8b None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:40.624496 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b56d1d-4e80-4035-b3f3-f4cc037e4a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:40.641604 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933aefd0-4053-4f7a-80cc-43a2ed935958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:40.642497 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933aefd0-4053-4f7a-80cc-43a2ed935958 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:40.642772 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933aefd0-4053-4f7a-80cc-43a2ed935958 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:40.643053 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933aefd0-4053-4f7a-80cc-43a2ed935958 None admin] PATH_INFO: `/v3/users/54ceb1595a2943459ed05f05f288a335` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:40.646018 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-e7b56d1d-4e80-4035-b3f3-f4cc037e4a8b None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:40.647563 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-e7b56d1d-4e80-4035-b3f3-f4cc037e4a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:40.648449 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933aefd0-4053-4f7a-80cc-43a2ed935958 None admin] RBAC: Authorizing `identity:get_user(user_id=54ceb1595a2943459ed05f05f288a335)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:40.650269 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933aefd0-4053-4f7a-80cc-43a2ed935958 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:40.652409 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 87/178] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:44:40 2022] GET /identity/v3/users/54ceb1595a2943459ed05f05f288a335 => generated 275 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:40.657823 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933aefd0-4053-4f7a-80cc-43a2ed935958 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:40.750873 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 92/179] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:44:40.760901 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874faa3b-a566-4095-bee6-27c93ab4af8d None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:40.761514 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874faa3b-a566-4095-bee6-27c93ab4af8d None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:40.762011 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874faa3b-a566-4095-bee6-27c93ab4af8d None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:40.764050 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 93/180] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:44:40.770126 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5febe99-c20e-4b24-9d45-05e1cacbd6a7 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:40.770720 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5febe99-c20e-4b24-9d45-05e1cacbd6a7 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:40.771320 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5febe99-c20e-4b24-9d45-05e1cacbd6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:40.790788 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-a5febe99-c20e-4b24-9d45-05e1cacbd6a7 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:40.792396 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-a5febe99-c20e-4b24-9d45-05e1cacbd6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:40.814105 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933aefd0-4053-4f7a-80cc-43a2ed935958 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:40.845602 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:40.854127 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d01dd-b3e9-490a-b94b-c9c2278f2720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:40.855061 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d01dd-b3e9-490a-b94b-c9c2278f2720 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:40.855061 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d01dd-b3e9-490a-b94b-c9c2278f2720 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:40.855328 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d01dd-b3e9-490a-b94b-c9c2278f2720 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:40.877492 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 94/181] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 11:44:40.878721 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5febe99-c20e-4b24-9d45-05e1cacbd6a7 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:40.919223 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:40.930807 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876d01dd-b3e9-490a-b94b-c9c2278f2720 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:40.932363 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876d01dd-b3e9-490a-b94b-c9c2278f2720 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:41.023077 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5febe99-c20e-4b24-9d45-05e1cacbd6a7 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:41.042176 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 88/182] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:44:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 11:44:41.043062 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d01dd-b3e9-490a-b94b-c9c2278f2720 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:41.062614 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8c924-19fa-4e5d-aa41-1d3e74c08658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:41.063567 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8c924-19fa-4e5d-aa41-1d3e74c08658 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:41.063960 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8c924-19fa-4e5d-aa41-1d3e74c08658 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:41.064300 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8c924-19fa-4e5d-aa41-1d3e74c08658 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:41.075883 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af8c924-19fa-4e5d-aa41-1d3e74c08658 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:44:41.079447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:41.085625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-0af8c924-19fa-4e5d-aa41-1d3e74c08658 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:44:41.085625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:44:41.085625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:44:41.085625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:44:41.085625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:44:41.085625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:44:41.085625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:44:41.085625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:44:41.085625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:44:41.085625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:44:41.085625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:44:41.085625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:44:41.085625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:44:41.085625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:44:41.085625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:44:41.085625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:44:41.086535 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:44:41.086535 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:44:41.086535 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:44:41.086535 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:44:41.086535 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:44:41.086535 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:44:41.086535 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:44:41.086535 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:44:41.086535 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:44:41.086535 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:44:41.086535 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:44:41.086535 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:44:41.086535 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:44:41.086535 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:44:41.086535 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:44:41.086535 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:44:41.087469 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:44:41.087469 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:44:41.087469 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:44:41.087469 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:44:41.087469 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:44:41.087469 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:44:41.087469 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:44:41.087469 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:44:41.087469 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:44:41.087469 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:44:41.087469 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:44:41.087469 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:44:41.087469 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 95/183] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 3 11:44:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:44:41.088172 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8c924-19fa-4e5d-aa41-1d3e74c08658 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:41.157847 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d01dd-b3e9-490a-b94b-c9c2278f2720 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:41.199222 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc7829-2a57-46a2-b389-f0d5484bbb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:41.200169 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc7829-2a57-46a2-b389-f0d5484bbb83 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:41.200451 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc7829-2a57-46a2-b389-f0d5484bbb83 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:41.200772 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc7829-2a57-46a2-b389-f0d5484bbb83 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:41.209208 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8c924-19fa-4e5d-aa41-1d3e74c08658 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:41.211909 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:41.217553 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc7829-2a57-46a2-b389-f0d5484bbb83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:44:41.227370 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-c3fc7829-2a57-46a2-b389-f0d5484bbb83 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 11:44:41.227370 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:44:41.227370 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:44:41.227370 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:44:41.227370 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:44:41.227370 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:44:41.227370 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:44:41.227370 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:44:41.227370 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:44:41.227370 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:44:41.227370 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:44:41.227370 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:44:41.227370 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:44:41.227370 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:44:41.227370 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:44:41.227370 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:44:41.229543 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:44:41.229543 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:44:41.229543 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:44:41.229543 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:44:41.229543 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:44:41.229543 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:44:41.229543 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:44:41.229543 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:44:41.229543 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:44:41.229543 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:44:41.229543 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:44:41.229543 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:44:41.229543 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:44:41.229543 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:44:41.229543 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:44:41.229543 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:44:41.231601 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:44:41.231601 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:44:41.231601 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:44:41.231601 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:44:41.231601 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:44:41.231601 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:44:41.231601 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:44:41.231601 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:44:41.231601 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:44:41.231601 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:44:41.231601 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 11:44:41.231601 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:44:41.231601 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 89/184] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Jun 3 11:44:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:44:41.231601 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc7829-2a57-46a2-b389-f0d5484bbb83 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:41.253281 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2287d1-df2a-4dfd-9e9a-301acf5bd85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:41.254259 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2287d1-df2a-4dfd-9e9a-301acf5bd85b None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:41.254546 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2287d1-df2a-4dfd-9e9a-301acf5bd85b None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:41.254823 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2287d1-df2a-4dfd-9e9a-301acf5bd85b None admin] PATH_INFO: `/v3/projects/ea51488356414c4bb3aa2c00cfc089e4` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:41.256082 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2287d1-df2a-4dfd-9e9a-301acf5bd85b None admin] RBAC: Authorizing `identity:get_project(project_id=ea51488356414c4bb3aa2c00cfc089e4)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:41.257785 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2287d1-df2a-4dfd-9e9a-301acf5bd85b None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:41.259480 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 96/185] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:44:41 2022] GET /identity/v3/projects/ea51488356414c4bb3aa2c00cfc089e4 => generated 312 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:41.260288 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2287d1-df2a-4dfd-9e9a-301acf5bd85b None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:41.337457 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:41.348014 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc7829-2a57-46a2-b389-f0d5484bbb83 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:41.377100 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2287d1-df2a-4dfd-9e9a-301acf5bd85b None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:41.382810 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda8026-7097-4507-9718-facc0d138f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:41.383482 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda8026-7097-4507-9718-facc0d138f15 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:41.383799 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda8026-7097-4507-9718-facc0d138f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:41.384079 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda8026-7097-4507-9718-facc0d138f15 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:41.384827 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda8026-7097-4507-9718-facc0d138f15 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:41.385136 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda8026-7097-4507-9718-facc0d138f15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:41.386523 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda8026-7097-4507-9718-facc0d138f15 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:41.394570 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 90/186] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:44:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:41.395351 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda8026-7097-4507-9718-facc0d138f15 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:41.413298 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f3cd58-1dd2-41e9-a856-c0d31919e6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:41.413970 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3cd58-1dd2-41e9-a856-c0d31919e6bd None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:41.414256 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3cd58-1dd2-41e9-a856-c0d31919e6bd None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:41.414531 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3cd58-1dd2-41e9-a856-c0d31919e6bd None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:41.415274 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f3cd58-1dd2-41e9-a856-c0d31919e6bd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:41.415617 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f3cd58-1dd2-41e9-a856-c0d31919e6bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:41.417010 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f3cd58-1dd2-41e9-a856-c0d31919e6bd None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:41.425501 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 97/187] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:44:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:41.426529 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0e1af-d7be-44fa-a8e1-79562c3bb431 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:41.426816 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0e1af-d7be-44fa-a8e1-79562c3bb431 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:41.427092 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0e1af-d7be-44fa-a8e1-79562c3bb431 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:41.428332 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 98/188] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:44:41.429386 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f907d7-4019-4c75-a136-9743081e807a None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:41.429669 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f907d7-4019-4c75-a136-9743081e807a None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:41.430046 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f907d7-4019-4c75-a136-9743081e807a None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:41.435103 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 99/189] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:44:41.435103 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f907d7-4019-4c75-a136-9743081e807a None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:41.447308 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:41.500084 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda8026-7097-4507-9718-facc0d138f15 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:41.532299 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f907d7-4019-4c75-a136-9743081e807a None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:41.533450 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8145bfe8-2d69-4bee-99da-98b572e7a76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:41.534129 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145bfe8-2d69-4bee-99da-98b572e7a76f None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:41.534422 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145bfe8-2d69-4bee-99da-98b572e7a76f None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:41.534703 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145bfe8-2d69-4bee-99da-98b572e7a76f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:41.535561 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8145bfe8-2d69-4bee-99da-98b572e7a76f None admin] RBAC: Adding query filter params (role.id=781e2d573ee94afaae05b3cc0bba8768, scope.project.id=ea51488356414c4bb3aa2c00cfc089e4, user.id=54ceb1595a2943459ed05f05f288a335) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:41.535884 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8145bfe8-2d69-4bee-99da-98b572e7a76f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:41.537326 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8145bfe8-2d69-4bee-99da-98b572e7a76f None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:41.543525 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 91/190] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:44:41 2022] GET /identity/v3/role_assignments?user.id=54ceb1595a2943459ed05f05f288a335&scope.project.id=ea51488356414c4bb3aa2c00cfc089e4&role.id=781e2d573ee94afaae05b3cc0bba8768 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:41.544259 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8145bfe8-2d69-4bee-99da-98b572e7a76f None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:41.568779 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f2e75-bf1c-4de1-8ff7-c769086be288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:41.569688 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f2e75-bf1c-4de1-8ff7-c769086be288 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:41.569971 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f2e75-bf1c-4de1-8ff7-c769086be288 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:41.570244 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f2e75-bf1c-4de1-8ff7-c769086be288 None admin] PATH_INFO: `/v3/users/f12b1c7197be485395ef47860829f1b2` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:41.580286 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:41.586892 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806f2e75-bf1c-4de1-8ff7-c769086be288 None admin] RBAC: Authorizing `identity:get_user(user_id=f12b1c7197be485395ef47860829f1b2)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:41.588497 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806f2e75-bf1c-4de1-8ff7-c769086be288 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:41.590536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 100/191] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:44:41 2022] GET /identity/v3/users/f12b1c7197be485395ef47860829f1b2 => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:41.591831 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb49eb0-e77c-4d60-b5f8-7bdda2b254f7 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:41.592119 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb49eb0-e77c-4d60-b5f8-7bdda2b254f7 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:41.592396 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb49eb0-e77c-4d60-b5f8-7bdda2b254f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:41.610409 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-9bb49eb0-e77c-4d60-b5f8-7bdda2b254f7 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:41.611670 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-9bb49eb0-e77c-4d60-b5f8-7bdda2b254f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:41.677540 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8145bfe8-2d69-4bee-99da-98b572e7a76f None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:41.686497 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:41.692239 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 101/192] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:44:41.701545 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead9e98-ca83-4611-97fd-efff701e1de6 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:41.702156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead9e98-ca83-4611-97fd-efff701e1de6 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:41.702621 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead9e98-ca83-4611-97fd-efff701e1de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:41.721067 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-4ead9e98-ca83-4611-97fd-efff701e1de6 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:41.723168 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-4ead9e98-ca83-4611-97fd-efff701e1de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:41.727280 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df521ed-eb8e-4ae5-9547-35d98c62b539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:41.728227 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df521ed-eb8e-4ae5-9547-35d98c62b539 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:41.728512 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df521ed-eb8e-4ae5-9547-35d98c62b539 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:41.728799 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df521ed-eb8e-4ae5-9547-35d98c62b539 None admin] PATH_INFO: `/v3/users/f12b1c7197be485395ef47860829f1b2` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:41.730066 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df521ed-eb8e-4ae5-9547-35d98c62b539 None admin] RBAC: Authorizing `identity:get_user(user_id=f12b1c7197be485395ef47860829f1b2)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:41.731550 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df521ed-eb8e-4ae5-9547-35d98c62b539 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:41.733850 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 92/193] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:44:41 2022] GET /identity/v3/users/f12b1c7197be485395ef47860829f1b2 => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:41.734535 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df521ed-eb8e-4ae5-9547-35d98c62b539 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:41.800726 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 102/194] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:44:41.801397 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead9e98-ca83-4611-97fd-efff701e1de6 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:41.834938 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:41.851050 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df521ed-eb8e-4ae5-9547-35d98c62b539 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:41.884548 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a18aa5-5816-428f-985e-b1bf375101ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:41.885548 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a18aa5-5816-428f-985e-b1bf375101ad None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:41.885834 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a18aa5-5816-428f-985e-b1bf375101ad None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:41.886421 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a18aa5-5816-428f-985e-b1bf375101ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:41.908480 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead9e98-ca83-4611-97fd-efff701e1de6 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:41.935488 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:41.941955 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113b605-1bf5-479f-8fa1-929d0a14515c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:41.942762 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113b605-1bf5-479f-8fa1-929d0a14515c None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:41.943043 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113b605-1bf5-479f-8fa1-929d0a14515c None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:41.943317 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113b605-1bf5-479f-8fa1-929d0a14515c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:41.944508 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e113b605-1bf5-479f-8fa1-929d0a14515c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:41.945951 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e113b605-1bf5-479f-8fa1-929d0a14515c None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:41.947570 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 103/195] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:44:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:41.948498 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113b605-1bf5-479f-8fa1-929d0a14515c None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:41.953600 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a18aa5-5816-428f-985e-b1bf375101ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:41.955047 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a18aa5-5816-428f-985e-b1bf375101ad None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:42.039877 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:42.049126 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113b605-1bf5-479f-8fa1-929d0a14515c None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:42.056424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 93/196] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:44:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 11:44:42.057227 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a18aa5-5816-428f-985e-b1bf375101ad None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:42.086418 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86890b-65d5-4e1c-bc0c-136b5c396279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:42.087068 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86890b-65d5-4e1c-bc0c-136b5c396279 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:42.087381 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86890b-65d5-4e1c-bc0c-136b5c396279 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:42.087686 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86890b-65d5-4e1c-bc0c-136b5c396279 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:42.150708 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:42.154203 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a18aa5-5816-428f-985e-b1bf375101ad None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:42.154328 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86890b-65d5-4e1c-bc0c-136b5c396279 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:42.156009 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86890b-65d5-4e1c-bc0c-136b5c396279 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:42.188711 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05fee42-da80-4a8d-b2f4-0b9039f70f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:42.189489 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05fee42-da80-4a8d-b2f4-0b9039f70f42 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:42.189764 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05fee42-da80-4a8d-b2f4-0b9039f70f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:42.190059 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05fee42-da80-4a8d-b2f4-0b9039f70f42 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:42.200650 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05fee42-da80-4a8d-b2f4-0b9039f70f42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:44:42.208277 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-f05fee42-da80-4a8d-b2f4-0b9039f70f42 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 11:44:42.208277 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:44:42.208277 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:44:42.208277 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:44:42.208277 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:44:42.208277 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:44:42.208277 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:44:42.208277 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:44:42.208277 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:44:42.208277 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:44:42.208277 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:44:42.208277 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:44:42.208277 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:44:42.208277 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:44:42.208277 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:44:42.208277 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:44:42.209175 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:44:42.209175 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:44:42.209175 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:44:42.209175 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:44:42.209175 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:44:42.209175 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:44:42.209175 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:44:42.209175 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:44:42.209175 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:44:42.209175 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:44:42.209175 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:44:42.209175 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:44:42.209175 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:44:42.209175 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:44:42.209175 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:44:42.209175 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:44:42.210154 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:44:42.210154 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:44:42.210154 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:44:42.210154 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:44:42.210154 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:44:42.210154 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:44:42.210154 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:44:42.210154 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:44:42.210154 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:44:42.210154 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:44:42.210154 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 11:44:42.210154 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:44:42.210154 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 94/197] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:44:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:44:42.210154 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05fee42-da80-4a8d-b2f4-0b9039f70f42 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:42.254840 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:42.255412 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 104/198] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:44:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 11:44:42.256332 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86890b-65d5-4e1c-bc0c-136b5c396279 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:42.310580 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05fee42-da80-4a8d-b2f4-0b9039f70f42 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:42.343832 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ac522-bb79-4aa7-8911-de7ad7a4de6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:42.344505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ac522-bb79-4aa7-8911-de7ad7a4de6c None admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:42.344788 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ac522-bb79-4aa7-8911-de7ad7a4de6c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:42.345062 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ac522-bb79-4aa7-8911-de7ad7a4de6c None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:42.345764 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ac522-bb79-4aa7-8911-de7ad7a4de6c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:42.347774 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ac522-bb79-4aa7-8911-de7ad7a4de6c None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:42.352737 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:42.357883 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86890b-65d5-4e1c-bc0c-136b5c396279 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:42.370438 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 95/199] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Jun 3 11:44:42 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:44:42.372757 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ac522-bb79-4aa7-8911-de7ad7a4de6c None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:42.401949 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b36b3-a3d7-4df9-99d9-d81826699e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:42.402764 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b36b3-a3d7-4df9-99d9-d81826699e73 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:42.403051 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b36b3-a3d7-4df9-99d9-d81826699e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:42.403325 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b36b3-a3d7-4df9-99d9-d81826699e73 None admin] PATH_INFO: `/v3/projects/deb1496445dd47a6ba9ad9fb02737115` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:42.404649 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9b36b3-a3d7-4df9-99d9-d81826699e73 None admin] RBAC: Authorizing `identity:get_project(project_id=deb1496445dd47a6ba9ad9fb02737115)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:42.406321 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9b36b3-a3d7-4df9-99d9-d81826699e73 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:42.408129 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 105/200] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:44:42 2022] GET /identity/v3/projects/deb1496445dd47a6ba9ad9fb02737115 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:42.409441 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b36b3-a3d7-4df9-99d9-d81826699e73 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:42.494786 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:42.498355 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ac522-bb79-4aa7-8911-de7ad7a4de6c None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:42.530301 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b36b3-a3d7-4df9-99d9-d81826699e73 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:42.543214 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c649eb6-dd01-4fce-9d5e-501ee4f089ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:42.544371 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c649eb6-dd01-4fce-9d5e-501ee4f089ca None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:42.544805 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c649eb6-dd01-4fce-9d5e-501ee4f089ca None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:42.545345 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c649eb6-dd01-4fce-9d5e-501ee4f089ca None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:42.546373 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c649eb6-dd01-4fce-9d5e-501ee4f089ca None admin] RBAC: Adding query filter params (name=reader) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:42.546829 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c649eb6-dd01-4fce-9d5e-501ee4f089ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:42.548554 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c649eb6-dd01-4fce-9d5e-501ee4f089ca None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:42.562710 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 96/201] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 3 11:44:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:42.562710 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c649eb6-dd01-4fce-9d5e-501ee4f089ca None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:42.573926 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da896206-63d3-41f6-b64b-4a5488b6ce57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:42.574784 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da896206-63d3-41f6-b64b-4a5488b6ce57 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:42.575061 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da896206-63d3-41f6-b64b-4a5488b6ce57 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:42.575332 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da896206-63d3-41f6-b64b-4a5488b6ce57 None admin] PATH_INFO: `/v3/projects/deb1496445dd47a6ba9ad9fb02737115` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:42.576545 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da896206-63d3-41f6-b64b-4a5488b6ce57 None admin] RBAC: Authorizing `identity:get_project(project_id=deb1496445dd47a6ba9ad9fb02737115)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:42.578003 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da896206-63d3-41f6-b64b-4a5488b6ce57 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:42.584395 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 106/202] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:44:42 2022] GET /identity/v3/projects/deb1496445dd47a6ba9ad9fb02737115 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:42.584395 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da896206-63d3-41f6-b64b-4a5488b6ce57 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:42.622351 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:42.689040 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c649eb6-dd01-4fce-9d5e-501ee4f089ca None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:42.705585 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da896206-63d3-41f6-b64b-4a5488b6ce57 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:42.727154 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c8f9c-9c52-470d-8267-356440dd0f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:42.728143 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c8f9c-9c52-470d-8267-356440dd0f01 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:42.728251 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c8f9c-9c52-470d-8267-356440dd0f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:42.728471 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c8f9c-9c52-470d-8267-356440dd0f01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:42.729370 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963c8f9c-9c52-470d-8267-356440dd0f01 None admin] RBAC: Adding query filter params (role.id=c486e164840b41a59fd118dece2ce572, scope.project.id=deb1496445dd47a6ba9ad9fb02737115, user.id=f12b1c7197be485395ef47860829f1b2) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:42.730065 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963c8f9c-9c52-470d-8267-356440dd0f01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:42.731308 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963c8f9c-9c52-470d-8267-356440dd0f01 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:42.737598 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 97/203] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:44:42 2022] GET /identity/v3/role_assignments?user.id=f12b1c7197be485395ef47860829f1b2&scope.project.id=deb1496445dd47a6ba9ad9fb02737115&role.id=c486e164840b41a59fd118dece2ce572 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:42.740183 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c8f9c-9c52-470d-8267-356440dd0f01 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:42.749911 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673505fb-e637-47b8-b9bd-0d1d1445d90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:42.751062 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673505fb-e637-47b8-b9bd-0d1d1445d90c None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:42.751550 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673505fb-e637-47b8-b9bd-0d1d1445d90c None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:42.752032 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673505fb-e637-47b8-b9bd-0d1d1445d90c None admin] PATH_INFO: `/v3/users/46738e3728ba4d518b8b9b13756a8440` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:42.754126 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673505fb-e637-47b8-b9bd-0d1d1445d90c None admin] RBAC: Authorizing `identity:get_user(user_id=46738e3728ba4d518b8b9b13756a8440)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:42.755818 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673505fb-e637-47b8-b9bd-0d1d1445d90c None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:42.758298 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 107/204] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:44:42 2022] GET /identity/v3/users/46738e3728ba4d518b8b9b13756a8440 => generated 289 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:42.763413 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673505fb-e637-47b8-b9bd-0d1d1445d90c None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:42.773600 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:42.879847 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963c8f9c-9c52-470d-8267-356440dd0f01 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:42.909754 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673505fb-e637-47b8-b9bd-0d1d1445d90c None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:42.912468 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:42.928449 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ca25a-a5b2-4470-ae8d-345dbf4080e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:42.929291 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ca25a-a5b2-4470-ae8d-345dbf4080e3 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:42.929724 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ca25a-a5b2-4470-ae8d-345dbf4080e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:42.930017 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ca25a-a5b2-4470-ae8d-345dbf4080e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:42.930891 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997ca25a-a5b2-4470-ae8d-345dbf4080e3 None admin] RBAC: Adding query filter params (role.id=5d1199580aaa485bb120b35e6f771ff9, scope.project.id=deb1496445dd47a6ba9ad9fb02737115, user.id=f12b1c7197be485395ef47860829f1b2) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:42.931213 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997ca25a-a5b2-4470-ae8d-345dbf4080e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:42.933006 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997ca25a-a5b2-4470-ae8d-345dbf4080e3 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:42.941361 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 98/205] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:44:42 2022] GET /identity/v3/role_assignments?user.id=f12b1c7197be485395ef47860829f1b2&scope.project.id=deb1496445dd47a6ba9ad9fb02737115&role.id=5d1199580aaa485bb120b35e6f771ff9 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:42.985484 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2b2ae-254b-4d5f-a1cb-62c970fca296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:42.986541 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2b2ae-254b-4d5f-a1cb-62c970fca296 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:42.987623 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2b2ae-254b-4d5f-a1cb-62c970fca296 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:42.988101 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2b2ae-254b-4d5f-a1cb-62c970fca296 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:43.104777 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd2b2ae-254b-4d5f-a1cb-62c970fca296 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:43.106661 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd2b2ae-254b-4d5f-a1cb-62c970fca296 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:43.236104 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 108/206] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:44:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 03 11:44:43.244829 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ca25a-a5b2-4470-ae8d-345dbf4080e3 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:43.378752 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:43.389075 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ca25a-a5b2-4470-ae8d-345dbf4080e3 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:43.437158 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54e841-83c0-457e-8caf-f7220fb8cda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:43.438035 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54e841-83c0-457e-8caf-f7220fb8cda1 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:43.438321 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54e841-83c0-457e-8caf-f7220fb8cda1 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:43.438597 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54e841-83c0-457e-8caf-f7220fb8cda1 None admin] PATH_INFO: `/v3/projects/437ab37ab6104629b1199c45fdd0b804` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:43.439845 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed54e841-83c0-457e-8caf-f7220fb8cda1 None admin] RBAC: Authorizing `identity:get_project(project_id=437ab37ab6104629b1199c45fdd0b804)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:43.441862 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed54e841-83c0-457e-8caf-f7220fb8cda1 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:43.443899 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 99/207] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:44:43 2022] GET /identity/v3/projects/437ab37ab6104629b1199c45fdd0b804 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:43.449294 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2b2ae-254b-4d5f-a1cb-62c970fca296 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:43.451511 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:43.568465 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2b2ae-254b-4d5f-a1cb-62c970fca296 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:43.617108 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a26783-565a-414d-89e0-60bd7781d429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:43.618543 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a26783-565a-414d-89e0-60bd7781d429 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:43.619049 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a26783-565a-414d-89e0-60bd7781d429 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:43.619539 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a26783-565a-414d-89e0-60bd7781d429 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:43.620577 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a26783-565a-414d-89e0-60bd7781d429 None admin] RBAC: Adding query filter params (role.id=c2a1a291255141b3b6eee6132725bfff, scope.project.id=437ab37ab6104629b1199c45fdd0b804, user.id=46738e3728ba4d518b8b9b13756a8440) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:43.621090 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a26783-565a-414d-89e0-60bd7781d429 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:43.622724 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a26783-565a-414d-89e0-60bd7781d429 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:43.632573 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 109/208] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:44:43 2022] GET /identity/v3/role_assignments?user.id=46738e3728ba4d518b8b9b13756a8440&scope.project.id=437ab37ab6104629b1199c45fdd0b804&role.id=c2a1a291255141b3b6eee6132725bfff => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:44.876427 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc75d8-cfd5-4484-82eb-9a2908f5a57e None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:44.876943 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc75d8-cfd5-4484-82eb-9a2908f5a57e None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:44.877018 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc75d8-cfd5-4484-82eb-9a2908f5a57e None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:44.878887 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 100/209] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:44:44.884158 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4310d92-769a-475a-8bee-a51d324c30b3 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:44.884555 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4310d92-769a-475a-8bee-a51d324c30b3 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:44.884719 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4310d92-769a-475a-8bee-a51d324c30b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:44.910337 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-a4310d92-769a-475a-8bee-a51d324c30b3 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:44.911754 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-a4310d92-769a-475a-8bee-a51d324c30b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:44.973400 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:44.981983 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 110/210] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:44:45.006131 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc75d8-cfd5-4484-82eb-9a2908f5a57e None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:45.056332 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e377211-aa4d-42ee-b1e1-6584d7c77e94 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:45.056660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e377211-aa4d-42ee-b1e1-6584d7c77e94 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:45.056889 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e377211-aa4d-42ee-b1e1-6584d7c77e94 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:45.058578 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 111/211] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:44:45.063653 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf9d24-2999-4b8f-9ef0-c6c1a4d632da None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:45.063941 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf9d24-2999-4b8f-9ef0-c6c1a4d632da None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:45.064221 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf9d24-2999-4b8f-9ef0-c6c1a4d632da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:45.083843 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-dbdf9d24-2999-4b8f-9ef0-c6c1a4d632da None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:45.085046 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-dbdf9d24-2999-4b8f-9ef0-c6c1a4d632da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:45.123489 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc75d8-cfd5-4484-82eb-9a2908f5a57e None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:45.159752 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d2fb8-318d-456f-922b-15eb638834c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:45.159931 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 112/212] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 11:44:45.164249 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d2fb8-318d-456f-922b-15eb638834c4 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:45.164533 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d2fb8-318d-456f-922b-15eb638834c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:45.164810 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d2fb8-318d-456f-922b-15eb638834c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:45.177481 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2d2fb8-318d-456f-922b-15eb638834c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:44:45.186211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf9d24-2999-4b8f-9ef0-c6c1a4d632da None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:45.187892 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-7d2d2fb8-318d-456f-922b-15eb638834c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 11:44:45.187892 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:44:45.187892 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:44:45.187892 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:44:45.187892 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:44:45.187892 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:44:45.187892 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:44:45.187892 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:44:45.187892 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:44:45.187892 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:44:45.187892 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:44:45.187892 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:44:45.187892 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:44:45.187892 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:44:45.187892 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:44:45.187892 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:44:45.188729 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:44:45.188729 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:44:45.188729 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:44:45.188729 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:44:45.188729 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:44:45.188729 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:44:45.188729 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:44:45.188729 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:44:45.188729 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:44:45.188729 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:44:45.188729 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:44:45.188729 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:44:45.188729 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:44:45.188729 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:44:45.188729 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:44:45.188729 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:44:45.189516 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:44:45.189516 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:44:45.189516 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:44:45.189516 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:44:45.189516 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:44:45.189516 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:44:45.189516 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:44:45.189516 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:44:45.189516 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:44:45.189516 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:44:45.189516 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 11:44:45.189516 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:44:45.192157 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 101/213] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:44:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:44:45.200424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d2fb8-318d-456f-922b-15eb638834c4 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:45.220092 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:45.309681 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d2fb8-318d-456f-922b-15eb638834c4 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:45.311612 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf9d24-2999-4b8f-9ef0-c6c1a4d632da None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:45.346184 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc1bb5-9734-449d-856a-01cc54242641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:45.347406 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc1bb5-9734-449d-856a-01cc54242641 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:45.347733 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc1bb5-9734-449d-856a-01cc54242641 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:45.348013 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc1bb5-9734-449d-856a-01cc54242641 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:45.348290 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:45.348763 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc1bb5-9734-449d-856a-01cc54242641 None admin] RBAC: Adding query filter params (name=member) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:45.349071 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc1bb5-9734-449d-856a-01cc54242641 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:45.350684 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc1bb5-9734-449d-856a-01cc54242641 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:45.359119 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b5067-d5c8-4889-9008-efc3767f84f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:45.360033 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b5067-d5c8-4889-9008-efc3767f84f6 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:45.360386 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b5067-d5c8-4889-9008-efc3767f84f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:45.360748 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 102/214] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 3 11:44:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:44:45.363738 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b5067-d5c8-4889-9008-efc3767f84f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:45.365913 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc1bb5-9734-449d-856a-01cc54242641 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:45.366924 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b5067-d5c8-4889-9008-efc3767f84f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:45.368437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b5067-d5c8-4889-9008-efc3767f84f6 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:45.370449 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 113/215] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:44:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:44:45.375437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b5067-d5c8-4889-9008-efc3767f84f6 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:45.461287 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:45.483211 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc1bb5-9734-449d-856a-01cc54242641 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:45.491283 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b5067-d5c8-4889-9008-efc3767f84f6 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:45.521299 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d59d0a-7665-475b-9052-5f1bcd65251c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:45.522443 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d59d0a-7665-475b-9052-5f1bcd65251c None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:45.522871 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d59d0a-7665-475b-9052-5f1bcd65251c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:45.523410 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d59d0a-7665-475b-9052-5f1bcd65251c None admin] PATH_INFO: `/v3/users/14dcc2ad41c44f4684faee72ef37206c` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:45.526429 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31362956-8c2d-4c14-bd54-17b097eb16aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:45.527098 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31362956-8c2d-4c14-bd54-17b097eb16aa None admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:45.527378 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31362956-8c2d-4c14-bd54-17b097eb16aa None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:45.527683 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31362956-8c2d-4c14-bd54-17b097eb16aa None admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:45.528396 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31362956-8c2d-4c14-bd54-17b097eb16aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:45.529872 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31362956-8c2d-4c14-bd54-17b097eb16aa None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:45.539268 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d59d0a-7665-475b-9052-5f1bcd65251c None admin] RBAC: Authorizing `identity:get_user(user_id=14dcc2ad41c44f4684faee72ef37206c)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:45.540943 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d59d0a-7665-475b-9052-5f1bcd65251c None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:45.542830 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 103/216] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:44:45 2022] GET /identity/v3/users/14dcc2ad41c44f4684faee72ef37206c => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:45.548636 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766fce4-5701-47e9-a90a-691e98758523 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:45.548930 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766fce4-5701-47e9-a90a-691e98758523 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:45.549212 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766fce4-5701-47e9-a90a-691e98758523 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:45.550289 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 114/217] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Jun 3 11:44:45 2022] POST /identity/v3/users => generated 297 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:44:45.550523 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 104/218] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:44:45.555896 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31362956-8c2d-4c14-bd54-17b097eb16aa None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:45.556474 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d117ccc-05cd-460a-a3a2-ba0f0d7dc69a None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:45.556964 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d117ccc-05cd-460a-a3a2-ba0f0d7dc69a None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:45.557439 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d117ccc-05cd-460a-a3a2-ba0f0d7dc69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:45.582408 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-9d117ccc-05cd-460a-a3a2-ba0f0d7dc69a None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:45.583751 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-9d117ccc-05cd-460a-a3a2-ba0f0d7dc69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:45.623042 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:45.679300 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 105/219] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:44:45.696016 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31362956-8c2d-4c14-bd54-17b097eb16aa None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:45.706470 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d117ccc-05cd-460a-a3a2-ba0f0d7dc69a None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:45.741891 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55f51c-88be-4e01-81b3-414190aaf0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:45.742967 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55f51c-88be-4e01-81b3-414190aaf0a8 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:45.743446 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55f51c-88be-4e01-81b3-414190aaf0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:45.743980 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55f51c-88be-4e01-81b3-414190aaf0a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:45.787663 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:45.825981 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c55f51c-88be-4e01-81b3-414190aaf0a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:45.827421 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c55f51c-88be-4e01-81b3-414190aaf0a8 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:45.828205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d117ccc-05cd-460a-a3a2-ba0f0d7dc69a None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:45.870239 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856800db-24f0-4769-98ea-5082096ef668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:45.870575 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856800db-24f0-4769-98ea-5082096ef668 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:45.870952 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856800db-24f0-4769-98ea-5082096ef668 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:45.871139 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856800db-24f0-4769-98ea-5082096ef668 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:45.886980 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856800db-24f0-4769-98ea-5082096ef668 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:44:45.892876 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:45.897940 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-856800db-24f0-4769-98ea-5082096ef668 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:44:45.897940 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:44:45.897940 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:44:45.897940 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:44:45.897940 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:44:45.897940 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:44:45.897940 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:44:45.897940 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:44:45.897940 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:44:45.897940 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:44:45.897940 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:44:45.897940 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:44:45.897940 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:44:45.897940 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:44:45.897940 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:44:45.897940 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:44:45.898829 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:44:45.898829 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:44:45.898829 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:44:45.898829 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:44:45.898829 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:44:45.898829 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:44:45.898829 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:44:45.898829 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:44:45.898829 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:44:45.898829 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:44:45.898829 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:44:45.898829 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:44:45.898829 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:44:45.898829 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:44:45.898829 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:44:45.898829 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:44:45.900014 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:44:45.900014 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:44:45.900014 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:44:45.900014 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:44:45.900014 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:44:45.900014 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:44:45.900014 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:44:45.900014 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:44:45.900014 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:44:45.900014 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:44:45.900014 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:44:45.900014 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:44:45.900014 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 106/220] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 3 11:44:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:44:45.907522 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025175d7-8ef3-4db0-8e7d-d7d03fd319d3 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:45.907522 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025175d7-8ef3-4db0-8e7d-d7d03fd319d3 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:45.907522 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025175d7-8ef3-4db0-8e7d-d7d03fd319d3 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:45.907522 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 107/221] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:44:45.908330 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025175d7-8ef3-4db0-8e7d-d7d03fd319d3 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:45.951339 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 115/222] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:44:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 11:44:45.953616 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938725f-3200-4897-b238-5ac5120e7cc8 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:45.953905 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938725f-3200-4897-b238-5ac5120e7cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:45.954177 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938725f-3200-4897-b238-5ac5120e7cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:45.971165 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-a938725f-3200-4897-b238-5ac5120e7cc8 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:45.972948 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-a938725f-3200-4897-b238-5ac5120e7cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:46.046122 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025175d7-8ef3-4db0-8e7d-d7d03fd319d3 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:46.050151 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 116/223] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:44:46.050470 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a938725f-3200-4897-b238-5ac5120e7cc8 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:46.082610 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:46.093447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f8332-cd0d-4048-b361-c99a8b35732b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:46.094388 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f8332-cd0d-4048-b361-c99a8b35732b None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:46.094843 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f8332-cd0d-4048-b361-c99a8b35732b None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:46.095765 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f8332-cd0d-4048-b361-c99a8b35732b None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:46.098865 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f8332-cd0d-4048-b361-c99a8b35732b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:46.099067 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f8332-cd0d-4048-b361-c99a8b35732b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:46.100534 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f8332-cd0d-4048-b361-c99a8b35732b None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:46.109441 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 108/224] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:44:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:44:46.110325 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f8332-cd0d-4048-b361-c99a8b35732b None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:46.155227 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:46.177445 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a938725f-3200-4897-b238-5ac5120e7cc8 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:46.215593 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275781d8-c14a-408d-ba9b-63060084b8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:46.216509 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275781d8-c14a-408d-ba9b-63060084b8e0 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:46.216836 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275781d8-c14a-408d-ba9b-63060084b8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:46.217115 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275781d8-c14a-408d-ba9b-63060084b8e0 None admin] PATH_INFO: `/v3/projects/deb1496445dd47a6ba9ad9fb02737115` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:46.218404 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275781d8-c14a-408d-ba9b-63060084b8e0 None admin] RBAC: Authorizing `identity:get_project(project_id=deb1496445dd47a6ba9ad9fb02737115)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:46.220006 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275781d8-c14a-408d-ba9b-63060084b8e0 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:46.221817 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 117/225] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:44:46 2022] GET /identity/v3/projects/deb1496445dd47a6ba9ad9fb02737115 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:46.222807 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275781d8-c14a-408d-ba9b-63060084b8e0 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:46.239737 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f8332-cd0d-4048-b361-c99a8b35732b None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:46.277066 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b842cb4-87a6-48da-a1ff-69da5a00f464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:46.278094 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b842cb4-87a6-48da-a1ff-69da5a00f464 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:46.278577 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b842cb4-87a6-48da-a1ff-69da5a00f464 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:46.279251 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b842cb4-87a6-48da-a1ff-69da5a00f464 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:46.290365 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b842cb4-87a6-48da-a1ff-69da5a00f464 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:44:46.298400 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-0b842cb4-87a6-48da-a1ff-69da5a00f464 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 11:44:46.298400 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:44:46.298400 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:44:46.298400 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:44:46.298400 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:44:46.298400 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:44:46.298400 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:44:46.298400 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:44:46.298400 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:44:46.298400 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:44:46.298400 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:44:46.298400 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:44:46.298400 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:44:46.298400 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:44:46.298400 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:44:46.298400 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:44:46.299263 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:44:46.299263 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:44:46.299263 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:44:46.299263 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:44:46.299263 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:44:46.299263 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:44:46.299263 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:44:46.299263 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:44:46.299263 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:44:46.299263 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:44:46.299263 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:44:46.299263 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:44:46.299263 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:44:46.299263 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:44:46.299263 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:44:46.299263 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:44:46.300146 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:44:46.300146 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:44:46.300146 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:44:46.300146 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:44:46.300146 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:44:46.300146 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:44:46.300146 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:44:46.300146 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:44:46.300146 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:44:46.300146 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:44:46.300146 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 11:44:46.300146 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:44:46.300146 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 109/226] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Jun 3 11:44:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:44:46.300800 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b842cb4-87a6-48da-a1ff-69da5a00f464 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:46.352090 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:46.353248 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275781d8-c14a-408d-ba9b-63060084b8e0 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:46.396347 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd18ab-8937-4923-aec3-ca0102ad53f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:46.397359 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd18ab-8937-4923-aec3-ca0102ad53f4 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:46.397640 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd18ab-8937-4923-aec3-ca0102ad53f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:46.397910 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd18ab-8937-4923-aec3-ca0102ad53f4 None admin] PATH_INFO: `/v3/users/f12b1c7197be485395ef47860829f1b2` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:46.399114 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd18ab-8937-4923-aec3-ca0102ad53f4 None admin] RBAC: Authorizing `identity:get_user(user_id=f12b1c7197be485395ef47860829f1b2)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:46.400951 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd18ab-8937-4923-aec3-ca0102ad53f4 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:46.407259 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 118/227] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:44:46 2022] GET /identity/v3/users/f12b1c7197be485395ef47860829f1b2 => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:46.408213 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd18ab-8937-4923-aec3-ca0102ad53f4 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:46.427632 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:46.428792 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b842cb4-87a6-48da-a1ff-69da5a00f464 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:46.468334 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46c59d-9908-42a3-9ae0-4813977b2f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:46.468816 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46c59d-9908-42a3-9ae0-4813977b2f10 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:46.469101 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46c59d-9908-42a3-9ae0-4813977b2f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:46.469375 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46c59d-9908-42a3-9ae0-4813977b2f10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:46.470200 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c46c59d-9908-42a3-9ae0-4813977b2f10 None admin] RBAC: Adding query filter params (role.id=781e2d573ee94afaae05b3cc0bba8768, scope.project.id=deb1496445dd47a6ba9ad9fb02737115, user.id=14dcc2ad41c44f4684faee72ef37206c) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:46.470559 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c46c59d-9908-42a3-9ae0-4813977b2f10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:46.472200 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c46c59d-9908-42a3-9ae0-4813977b2f10 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:46.478195 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 110/228] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:44:46 2022] GET /identity/v3/role_assignments?user.id=14dcc2ad41c44f4684faee72ef37206c&scope.project.id=deb1496445dd47a6ba9ad9fb02737115&role.id=781e2d573ee94afaae05b3cc0bba8768 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:46.479157 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46c59d-9908-42a3-9ae0-4813977b2f10 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:46.539109 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd18ab-8937-4923-aec3-ca0102ad53f4 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:46.596376 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf37461-fd2b-4636-b224-1e8a3ff74458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:46.597074 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf37461-fd2b-4636-b224-1e8a3ff74458 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:46.597357 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf37461-fd2b-4636-b224-1e8a3ff74458 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:46.597625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf37461-fd2b-4636-b224-1e8a3ff74458 None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:46.598397 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf37461-fd2b-4636-b224-1e8a3ff74458 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:46.598698 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf37461-fd2b-4636-b224-1e8a3ff74458 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:46.601153 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf37461-fd2b-4636-b224-1e8a3ff74458 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:46.617003 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46c59d-9908-42a3-9ae0-4813977b2f10 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:46.623386 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 119/229] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:44:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:46.630143 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf37461-fd2b-4636-b224-1e8a3ff74458 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:46.653342 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:46.714368 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b0979-fae2-42e9-814a-3249f1aee2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:46.715907 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b0979-fae2-42e9-814a-3249f1aee2ff None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:46.717693 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b0979-fae2-42e9-814a-3249f1aee2ff None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:46.719166 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b0979-fae2-42e9-814a-3249f1aee2ff None admin] PATH_INFO: `/v3/projects/deb1496445dd47a6ba9ad9fb02737115` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:46.721496 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b0979-fae2-42e9-814a-3249f1aee2ff None admin] RBAC: Authorizing `identity:get_project(project_id=deb1496445dd47a6ba9ad9fb02737115)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:46.724586 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b0979-fae2-42e9-814a-3249f1aee2ff None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:46.728141 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 111/230] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:44:46 2022] GET /identity/v3/projects/deb1496445dd47a6ba9ad9fb02737115 => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:46.733946 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b0979-fae2-42e9-814a-3249f1aee2ff None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:46.754189 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:46.801198 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf37461-fd2b-4636-b224-1e8a3ff74458 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:46.858654 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5064b1c5-ba7d-4cee-958f-3a2a54c20fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:46.859458 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064b1c5-ba7d-4cee-958f-3a2a54c20fe9 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:46.859787 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064b1c5-ba7d-4cee-958f-3a2a54c20fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:46.860029 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064b1c5-ba7d-4cee-958f-3a2a54c20fe9 None admin] PATH_INFO: `/v3/users/f12b1c7197be485395ef47860829f1b2` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:46.862872 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5064b1c5-ba7d-4cee-958f-3a2a54c20fe9 None admin] RBAC: Authorizing `identity:get_user(user_id=f12b1c7197be485395ef47860829f1b2)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:46.864476 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5064b1c5-ba7d-4cee-958f-3a2a54c20fe9 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:46.866254 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 120/231] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:44:46 2022] GET /identity/v3/users/f12b1c7197be485395ef47860829f1b2 => generated 283 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:46.871651 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5064b1c5-ba7d-4cee-958f-3a2a54c20fe9 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:46.883166 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b0979-fae2-42e9-814a-3249f1aee2ff None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:46.931236 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b1815-3112-4f86-b297-dd1e16ef8be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:46.932940 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b1815-3112-4f86-b297-dd1e16ef8be9 None admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:46.933424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b1815-3112-4f86-b297-dd1e16ef8be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:46.933898 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b1815-3112-4f86-b297-dd1e16ef8be9 None admin] PATH_INFO: `/v3/projects/deb1496445dd47a6ba9ad9fb02737115/users/f12b1c7197be485395ef47860829f1b2/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:46.939117 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b1815-3112-4f86-b297-dd1e16ef8be9 None admin] RBAC: Authorizing `identity:create_grant(project_id=deb1496445dd47a6ba9ad9fb02737115, user_id=f12b1c7197be485395ef47860829f1b2, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:46.945016 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b1815-3112-4f86-b297-dd1e16ef8be9 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:46.972670 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 112/232] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Jun 3 11:44:46 2022] PUT /identity/v3/projects/deb1496445dd47a6ba9ad9fb02737115/users/f12b1c7197be485395ef47860829f1b2/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:44:47.040899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5064b1c5-ba7d-4cee-958f-3a2a54c20fe9 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:47.089701 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32bfde1-c539-4caa-a3df-0a33b39f025f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:47.090985 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32bfde1-c539-4caa-a3df-0a33b39f025f None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:47.091470 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32bfde1-c539-4caa-a3df-0a33b39f025f None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:47.091976 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32bfde1-c539-4caa-a3df-0a33b39f025f None admin] PATH_INFO: `/v3/projects/deb1496445dd47a6ba9ad9fb02737115` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:47.096629 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32bfde1-c539-4caa-a3df-0a33b39f025f None admin] RBAC: Authorizing `identity:get_project(project_id=deb1496445dd47a6ba9ad9fb02737115)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:47.098497 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32bfde1-c539-4caa-a3df-0a33b39f025f None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:47.101049 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 121/233] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:44:46 2022] GET /identity/v3/projects/deb1496445dd47a6ba9ad9fb02737115 => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:44:47.106503 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b1815-3112-4f86-b297-dd1e16ef8be9 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:47.174165 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:47.241820 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b1815-3112-4f86-b297-dd1e16ef8be9 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:47.277323 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79535ed9-119b-4f17-a0cc-7cc3df7fff56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:47.278267 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79535ed9-119b-4f17-a0cc-7cc3df7fff56 None admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:47.278551 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79535ed9-119b-4f17-a0cc-7cc3df7fff56 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:47.278824 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79535ed9-119b-4f17-a0cc-7cc3df7fff56 None admin] PATH_INFO: `/v3/projects/deb1496445dd47a6ba9ad9fb02737115/users/f12b1c7197be485395ef47860829f1b2/roles/5d1199580aaa485bb120b35e6f771ff9` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:47.281107 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79535ed9-119b-4f17-a0cc-7cc3df7fff56 None admin] RBAC: Authorizing `identity:create_grant(project_id=deb1496445dd47a6ba9ad9fb02737115, user_id=f12b1c7197be485395ef47860829f1b2, role_id=5d1199580aaa485bb120b35e6f771ff9)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:47.282548 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79535ed9-119b-4f17-a0cc-7cc3df7fff56 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:47.297291 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 113/234] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Jun 3 11:44:47 2022] PUT /identity/v3/projects/deb1496445dd47a6ba9ad9fb02737115/users/f12b1c7197be485395ef47860829f1b2/roles/5d1199580aaa485bb120b35e6f771ff9 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:44:48.184543 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a5467-8220-4ecb-b18f-9c14c437243b None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:48.185519 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a5467-8220-4ecb-b18f-9c14c437243b None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:48.186008 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a5467-8220-4ecb-b18f-9c14c437243b None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:48.187925 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 122/235] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:44:48.189663 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a48868-8815-4938-b80d-b33b367b2f1c None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:48.190529 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a48868-8815-4938-b80d-b33b367b2f1c None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:48.191004 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a48868-8815-4938-b80d-b33b367b2f1c None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:48.196756 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e7514-a372-4fdf-b3f7-7be6c41dc345 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:48.197294 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e7514-a372-4fdf-b3f7-7be6c41dc345 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:48.197773 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e7514-a372-4fdf-b3f7-7be6c41dc345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:48.202715 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 114/236] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:48 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:44:48.208791 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e54f9f-8916-4ffd-907f-5670e6af3c18 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:48.209327 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e54f9f-8916-4ffd-907f-5670e6af3c18 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:48.209821 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e54f9f-8916-4ffd-907f-5670e6af3c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:48.227697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-124e7514-a372-4fdf-b3f7-7be6c41dc345 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:48.229186 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-124e7514-a372-4fdf-b3f7-7be6c41dc345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:48.237266 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-81e54f9f-8916-4ffd-907f-5670e6af3c18 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:48.239568 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-81e54f9f-8916-4ffd-907f-5670e6af3c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:48.251698 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:48.357608 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 115/237] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 11:44:48.359249 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 123/238] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 11:44:48.382474 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e54f9f-8916-4ffd-907f-5670e6af3c18 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:48.397505 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e7514-a372-4fdf-b3f7-7be6c41dc345 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:48.437938 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:48.530287 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e7514-a372-4fdf-b3f7-7be6c41dc345 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:48.592693 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e54f9f-8916-4ffd-907f-5670e6af3c18 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:48.594134 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c4df52-2545-4ab9-94be-14778c7f2dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:48.594944 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4df52-2545-4ab9-94be-14778c7f2dea None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:48.595228 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4df52-2545-4ab9-94be-14778c7f2dea None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:48.595523 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4df52-2545-4ab9-94be-14778c7f2dea None admin] PATH_INFO: `/v3/domains/default` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:48.600233 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c4df52-2545-4ab9-94be-14778c7f2dea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:48.601718 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c4df52-2545-4ab9-94be-14778c7f2dea None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:48.603684 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 124/239] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:44:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:48.608980 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c4df52-2545-4ab9-94be-14778c7f2dea None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:48.630511 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:48.644417 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395da21-a313-483c-b1e3-7a0f3290084c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:48.645222 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395da21-a313-483c-b1e3-7a0f3290084c None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:48.645507 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395da21-a313-483c-b1e3-7a0f3290084c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:48.645780 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395da21-a313-483c-b1e3-7a0f3290084c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:48.668675 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1395da21-a313-483c-b1e3-7a0f3290084c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:44:48.689156 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-1395da21-a313-483c-b1e3-7a0f3290084c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 11:44:48.689156 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:44:48.689156 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:44:48.689156 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:44:48.689156 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:44:48.689156 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:44:48.689156 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:44:48.689156 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:44:48.689156 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:44:48.689156 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:44:48.689156 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:44:48.689156 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:44:48.689156 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:44:48.689156 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:44:48.689156 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:44:48.689156 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:44:48.690655 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:44:48.690655 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:44:48.690655 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:44:48.690655 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:44:48.690655 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:44:48.690655 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:44:48.690655 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:44:48.690655 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:44:48.690655 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:44:48.690655 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:44:48.690655 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:44:48.690655 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:44:48.690655 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:44:48.690655 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:44:48.690655 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:44:48.690655 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:44:48.691476 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:44:48.691476 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:44:48.691476 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:44:48.691476 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:44:48.691476 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:44:48.691476 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:44:48.691476 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:44:48.691476 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:44:48.691476 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:44:48.691476 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:44:48.691476 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 11:44:48.691476 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:44:48.691476 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 116/240] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:44:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:44:48.703537 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395da21-a313-483c-b1e3-7a0f3290084c None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:48.825450 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c4df52-2545-4ab9-94be-14778c7f2dea None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:48.827128 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:48.836422 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395da21-a313-483c-b1e3-7a0f3290084c None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:48.885794 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515dee0f-b829-424a-b4b0-c32245114dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:48.886474 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515dee0f-b829-424a-b4b0-c32245114dd7 None admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:48.886752 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515dee0f-b829-424a-b4b0-c32245114dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:48.887022 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515dee0f-b829-424a-b4b0-c32245114dd7 None admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:48.887884 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515dee0f-b829-424a-b4b0-c32245114dd7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:48.889501 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515dee0f-b829-424a-b4b0-c32245114dd7 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:48.917694 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec0bd0-cea8-4e1a-a3ae-402e6ec4dc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:48.918452 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec0bd0-cea8-4e1a-a3ae-402e6ec4dc76 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:48.918733 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec0bd0-cea8-4e1a-a3ae-402e6ec4dc76 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:48.919009 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec0bd0-cea8-4e1a-a3ae-402e6ec4dc76 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:48.919755 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 125/241] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Jun 3 11:44:48 2022] POST /identity/v3/users => generated 293 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 11:44:48.920648 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec0bd0-cea8-4e1a-a3ae-402e6ec4dc76 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:48.920958 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec0bd0-cea8-4e1a-a3ae-402e6ec4dc76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:48.928433 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec0bd0-cea8-4e1a-a3ae-402e6ec4dc76 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:48.939418 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 117/242] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 3 11:44:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:48.946467 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515dee0f-b829-424a-b4b0-c32245114dd7 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:49.029917 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:49.083649 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515dee0f-b829-424a-b4b0-c32245114dd7 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:49.120756 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb45094-7c51-472b-bd5b-3c42dc1729fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:49.121655 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb45094-7c51-472b-bd5b-3c42dc1729fb None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:49.121934 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb45094-7c51-472b-bd5b-3c42dc1729fb None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:49.122205 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb45094-7c51-472b-bd5b-3c42dc1729fb None admin] PATH_INFO: `/v3/users/1deed3c54dc84dfd8351ea38de2fa499` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:49.138064 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb45094-7c51-472b-bd5b-3c42dc1729fb None admin] RBAC: Authorizing `identity:get_user(user_id=1deed3c54dc84dfd8351ea38de2fa499)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:49.143809 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb45094-7c51-472b-bd5b-3c42dc1729fb None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:49.143809 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 126/243] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:44:48 2022] GET /identity/v3/users/1deed3c54dc84dfd8351ea38de2fa499 => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:49.148033 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec0bd0-cea8-4e1a-a3ae-402e6ec4dc76 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:49.284973 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9906c-9e35-4465-b109-9920b3e3b060 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:49.285475 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9906c-9e35-4465-b109-9920b3e3b060 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:49.285475 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9906c-9e35-4465-b109-9920b3e3b060 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:49.286875 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 127/244] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:44:49.287200 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec0bd0-cea8-4e1a-a3ae-402e6ec4dc76 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:49.297274 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f6b2c-7242-4a21-87ce-fd9e7899f7d4 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:49.297595 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f6b2c-7242-4a21-87ce-fd9e7899f7d4 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:49.297841 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f6b2c-7242-4a21-87ce-fd9e7899f7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:49.326846 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23660040-f4ea-41a9-bbdc-6cca588a02e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:49.328485 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23660040-f4ea-41a9-bbdc-6cca588a02e1 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:49.328979 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23660040-f4ea-41a9-bbdc-6cca588a02e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:49.329451 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23660040-f4ea-41a9-bbdc-6cca588a02e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:49.348601 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-134f6b2c-7242-4a21-87ce-fd9e7899f7d4 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:49.349820 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-134f6b2c-7242-4a21-87ce-fd9e7899f7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:49.371784 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:49.417282 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23660040-f4ea-41a9-bbdc-6cca588a02e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:49.419271 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23660040-f4ea-41a9-bbdc-6cca588a02e1 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:49.462768 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 128/245] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:44:49.497101 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f6b2c-7242-4a21-87ce-fd9e7899f7d4 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:49.570533 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 118/246] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:44:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 11:44:49.575630 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23660040-f4ea-41a9-bbdc-6cca588a02e1 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:49.586780 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:49.637822 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f6b2c-7242-4a21-87ce-fd9e7899f7d4 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:49.649122 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:49.679489 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9587f9f9-9e8a-44a9-9959-cf5d7e092497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:49.680690 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9587f9f9-9e8a-44a9-9959-cf5d7e092497 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:49.681164 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9587f9f9-9e8a-44a9-9959-cf5d7e092497 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:49.681846 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9587f9f9-9e8a-44a9-9959-cf5d7e092497 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:49.695311 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9587f9f9-9e8a-44a9-9959-cf5d7e092497 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:44:49.701515 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23660040-f4ea-41a9-bbdc-6cca588a02e1 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:49.704031 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-9587f9f9-9e8a-44a9-9959-cf5d7e092497 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 11:44:49.704031 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:44:49.704031 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:44:49.704031 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:44:49.704031 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:44:49.704031 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:44:49.704031 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:44:49.704031 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:44:49.704031 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:44:49.704031 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:44:49.704031 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:44:49.704031 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:44:49.704031 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:44:49.704031 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:44:49.704031 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:44:49.704031 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:44:49.705158 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:44:49.705158 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:44:49.705158 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:44:49.705158 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:44:49.705158 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:44:49.705158 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:44:49.705158 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:44:49.705158 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:44:49.705158 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:44:49.705158 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:44:49.705158 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:44:49.705158 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:44:49.705158 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:44:49.705158 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:44:49.705158 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:44:49.705158 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:44:49.706154 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:44:49.706154 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:44:49.706154 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:44:49.706154 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:44:49.706154 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:44:49.706154 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:44:49.706154 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:44:49.706154 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:44:49.706154 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:44:49.706154 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:44:49.706154 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 11:44:49.706154 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:44:49.708127 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 129/247] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:44:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:44:49.713976 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9587f9f9-9e8a-44a9-9959-cf5d7e092497 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:49.736581 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ab124-abfc-4ea2-a360-3e0335ad978c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:49.737957 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ab124-abfc-4ea2-a360-3e0335ad978c None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:49.738237 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ab124-abfc-4ea2-a360-3e0335ad978c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:49.738506 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ab124-abfc-4ea2-a360-3e0335ad978c None admin] PATH_INFO: `/v3/projects/deb1496445dd47a6ba9ad9fb02737115` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:49.739763 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931ab124-abfc-4ea2-a360-3e0335ad978c None admin] RBAC: Authorizing `identity:get_project(project_id=deb1496445dd47a6ba9ad9fb02737115)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:49.741375 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931ab124-abfc-4ea2-a360-3e0335ad978c None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:49.743064 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 119/248] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:44:49 2022] GET /identity/v3/projects/deb1496445dd47a6ba9ad9fb02737115 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:49.748546 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ab124-abfc-4ea2-a360-3e0335ad978c None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:49.829260 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9587f9f9-9e8a-44a9-9959-cf5d7e092497 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:49.849236 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:49.854623 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ab124-abfc-4ea2-a360-3e0335ad978c None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:49.872441 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ef5fc-0b11-42d3-b69a-f8c4761c0213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:49.873127 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ef5fc-0b11-42d3-b69a-f8c4761c0213 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:49.873506 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ef5fc-0b11-42d3-b69a-f8c4761c0213 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:49.873845 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ef5fc-0b11-42d3-b69a-f8c4761c0213 None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:49.874676 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317ef5fc-0b11-42d3-b69a-f8c4761c0213 None admin] RBAC: Adding query filter params (name=member) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:49.875082 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317ef5fc-0b11-42d3-b69a-f8c4761c0213 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:49.876663 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317ef5fc-0b11-42d3-b69a-f8c4761c0213 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:49.878693 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:49.891541 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 130/249] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 3 11:44:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:44:49.894024 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ebd0c-867c-4bcb-9175-0200cec39753 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:49.894316 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ebd0c-867c-4bcb-9175-0200cec39753 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:49.894593 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ebd0c-867c-4bcb-9175-0200cec39753 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:49.896274 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 131/250] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:44:49.897889 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ebd0c-867c-4bcb-9175-0200cec39753 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:49.900092 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7767028-03d0-40b4-aa25-59b69c0b1c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:49.900774 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7767028-03d0-40b4-aa25-59b69c0b1c29 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:49.901044 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7767028-03d0-40b4-aa25-59b69c0b1c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:49.901318 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7767028-03d0-40b4-aa25-59b69c0b1c29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:49.902177 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7767028-03d0-40b4-aa25-59b69c0b1c29 None admin] RBAC: Adding query filter params (role.id=c2a1a291255141b3b6eee6132725bfff, scope.project.id=deb1496445dd47a6ba9ad9fb02737115, user.id=1deed3c54dc84dfd8351ea38de2fa499) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:49.902494 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7767028-03d0-40b4-aa25-59b69c0b1c29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:49.904030 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7767028-03d0-40b4-aa25-59b69c0b1c29 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:49.913253 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 120/251] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:44:49 2022] GET /identity/v3/role_assignments?user.id=1deed3c54dc84dfd8351ea38de2fa499&scope.project.id=deb1496445dd47a6ba9ad9fb02737115&role.id=c2a1a291255141b3b6eee6132725bfff => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:44:49.914386 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadda91-55c4-4505-954c-fffc18792d71 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:49.914672 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadda91-55c4-4505-954c-fffc18792d71 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:49.914950 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadda91-55c4-4505-954c-fffc18792d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:49.946006 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-5dadda91-55c4-4505-954c-fffc18792d71 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:49.947245 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-5dadda91-55c4-4505-954c-fffc18792d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:50.101695 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 121/252] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:44:50.122649 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ebd0c-867c-4bcb-9175-0200cec39753 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:50.173090 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79097b53-f7af-4fd7-9a91-f0da3daac230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:50.173980 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79097b53-f7af-4fd7-9a91-f0da3daac230 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:50.174263 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79097b53-f7af-4fd7-9a91-f0da3daac230 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:50.175207 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79097b53-f7af-4fd7-9a91-f0da3daac230 None admin] PATH_INFO: `/v3/users/14dcc2ad41c44f4684faee72ef37206c` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:50.176554 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79097b53-f7af-4fd7-9a91-f0da3daac230 None admin] RBAC: Authorizing `identity:get_user(user_id=14dcc2ad41c44f4684faee72ef37206c)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:50.180966 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79097b53-f7af-4fd7-9a91-f0da3daac230 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:50.181092 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dadda91-55c4-4505-954c-fffc18792d71 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:50.181168 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 132/253] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:44:49 2022] GET /identity/v3/users/14dcc2ad41c44f4684faee72ef37206c => generated 297 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:50.185366 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79097b53-f7af-4fd7-9a91-f0da3daac230 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:50.242309 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:50.308124 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dadda91-55c4-4505-954c-fffc18792d71 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:50.328297 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:50.340295 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79097b53-f7af-4fd7-9a91-f0da3daac230 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:50.351404 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fabb7d-8e78-43c4-8a3a-8e6ff5184446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:50.352581 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fabb7d-8e78-43c4-8a3a-8e6ff5184446 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:50.353079 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fabb7d-8e78-43c4-8a3a-8e6ff5184446 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:50.353547 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fabb7d-8e78-43c4-8a3a-8e6ff5184446 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:50.366169 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fabb7d-8e78-43c4-8a3a-8e6ff5184446 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:44:50.375349 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-a5fabb7d-8e78-43c4-8a3a-8e6ff5184446 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:44:50.375349 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:44:50.375349 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:44:50.375349 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:44:50.375349 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:44:50.375349 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:44:50.375349 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:44:50.375349 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:44:50.375349 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:44:50.375349 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:44:50.375349 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:44:50.375349 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:44:50.375349 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:44:50.375349 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:44:50.375349 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:44:50.375349 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:44:50.376276 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:44:50.376276 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:44:50.376276 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:44:50.376276 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:44:50.376276 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:44:50.376276 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:44:50.376276 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:44:50.376276 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:44:50.376276 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:44:50.376276 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:44:50.376276 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:44:50.376276 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:44:50.376276 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:44:50.376276 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:44:50.376276 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:44:50.376276 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:44:50.377052 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:44:50.377052 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:44:50.377052 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:44:50.377052 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:44:50.377052 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:44:50.377052 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:44:50.377052 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:44:50.377052 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:44:50.377052 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:44:50.377052 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:44:50.377052 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:44:50.377052 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:44:50.379676 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 122/254] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 3 11:44:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:44:50.387385 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fabb7d-8e78-43c4-8a3a-8e6ff5184446 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:50.419725 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af880bd5-081d-4f83-b0b0-332077e74ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:50.420629 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af880bd5-081d-4f83-b0b0-332077e74ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:50.420908 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af880bd5-081d-4f83-b0b0-332077e74ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:50.421180 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af880bd5-081d-4f83-b0b0-332077e74ba1 None admin] PATH_INFO: `/v3/projects/deb1496445dd47a6ba9ad9fb02737115` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:50.425733 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af880bd5-081d-4f83-b0b0-332077e74ba1 None admin] RBAC: Authorizing `identity:get_project(project_id=deb1496445dd47a6ba9ad9fb02737115)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:50.427207 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af880bd5-081d-4f83-b0b0-332077e74ba1 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:50.429254 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 133/255] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:44:50 2022] GET /identity/v3/projects/deb1496445dd47a6ba9ad9fb02737115 => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:44:50.430480 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad02c1-cd6b-442c-9bd1-34be5ab9fb26 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:50.430769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad02c1-cd6b-442c-9bd1-34be5ab9fb26 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:50.431045 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad02c1-cd6b-442c-9bd1-34be5ab9fb26 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:50.432513 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 134/256] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:44:50.437140 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad02c1-cd6b-442c-9bd1-34be5ab9fb26 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:50.517311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fabb7d-8e78-43c4-8a3a-8e6ff5184446 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:50.556882 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06333c2-3f14-4ed4-ac6d-33f4e58e80af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:50.558217 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06333c2-3f14-4ed4-ac6d-33f4e58e80af None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:50.558714 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06333c2-3f14-4ed4-ac6d-33f4e58e80af None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:50.559244 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06333c2-3f14-4ed4-ac6d-33f4e58e80af None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:50.560371 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06333c2-3f14-4ed4-ac6d-33f4e58e80af None admin] RBAC: Adding query filter params (name=admin) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:50.560998 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06333c2-3f14-4ed4-ac6d-33f4e58e80af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:50.562853 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06333c2-3f14-4ed4-ac6d-33f4e58e80af None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:50.574566 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 123/257] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:44:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:44:50.576766 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2f325-d1b7-4c8d-97f1-75857c4f947d None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:50.581751 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2f325-d1b7-4c8d-97f1-75857c4f947d None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:50.582274 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2f325-d1b7-4c8d-97f1-75857c4f947d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:50.601313 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-94e2f325-d1b7-4c8d-97f1-75857c4f947d None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:50.603362 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-94e2f325-d1b7-4c8d-97f1-75857c4f947d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:50.643901 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:50.662168 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad02c1-cd6b-442c-9bd1-34be5ab9fb26 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:50.689567 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:50.708961 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 124/258] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:44:50.711383 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e2f325-d1b7-4c8d-97f1-75857c4f947d None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:50.729310 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91862b69-f56b-4e99-8008-ea751c7363d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:50.731070 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91862b69-f56b-4e99-8008-ea751c7363d8 None admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:50.731353 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91862b69-f56b-4e99-8008-ea751c7363d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:50.731650 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91862b69-f56b-4e99-8008-ea751c7363d8 None admin] PATH_INFO: `/v3/projects/deb1496445dd47a6ba9ad9fb02737115/users/14dcc2ad41c44f4684faee72ef37206c/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:50.737296 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91862b69-f56b-4e99-8008-ea751c7363d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=deb1496445dd47a6ba9ad9fb02737115, user_id=14dcc2ad41c44f4684faee72ef37206c, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:50.740182 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91862b69-f56b-4e99-8008-ea751c7363d8 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:50.767736 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 135/259] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Jun 3 11:44:50 2022] PUT /identity/v3/projects/deb1496445dd47a6ba9ad9fb02737115/users/14dcc2ad41c44f4684faee72ef37206c/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:44:50.769046 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91862b69-f56b-4e99-8008-ea751c7363d8 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:50.931436 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91862b69-f56b-4e99-8008-ea751c7363d8 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:50.949626 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e2f325-d1b7-4c8d-97f1-75857c4f947d None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:50.969178 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab597390-9476-4275-9785-7c32003ced71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:50.970061 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab597390-9476-4275-9785-7c32003ced71 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:50.970345 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab597390-9476-4275-9785-7c32003ced71 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:50.970616 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab597390-9476-4275-9785-7c32003ced71 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:50.982137 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab597390-9476-4275-9785-7c32003ced71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:44:50.991344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-ab597390-9476-4275-9785-7c32003ced71 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 11:44:50.991344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:44:50.991344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:44:50.991344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:44:50.991344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:44:50.991344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:44:50.991344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:44:50.991344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:44:50.991344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:44:50.991344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:44:50.991344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:44:50.991344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:44:50.991344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:44:50.991344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:44:50.991344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:44:50.991344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:44:50.992325 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:44:50.992325 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:44:50.992325 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:44:50.992325 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:44:50.992325 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:44:50.992325 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:44:50.992325 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:44:50.992325 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:44:50.992325 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:44:50.992325 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:44:50.992325 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:44:50.992325 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:44:50.992325 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:44:50.992325 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:44:50.992325 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:44:50.992325 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:44:50.993405 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:44:50.993405 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:44:50.993405 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:44:50.993405 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:44:50.993405 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:44:50.993405 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:44:50.993405 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:44:50.993405 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:44:50.993405 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:44:50.993405 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:44:50.993405 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 11:44:50.993405 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:44:50.993405 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 136/260] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Jun 3 11:44:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:44:51.000815 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab597390-9476-4275-9785-7c32003ced71 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:51.073166 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0de186-f232-41ab-a746-2f5326d12963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:51.074064 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0de186-f232-41ab-a746-2f5326d12963 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:51.074347 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0de186-f232-41ab-a746-2f5326d12963 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:51.074620 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0de186-f232-41ab-a746-2f5326d12963 None admin] PATH_INFO: `/v3/users/f12b1c7197be485395ef47860829f1b2` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:51.075198 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:51.076896 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0de186-f232-41ab-a746-2f5326d12963 None admin] RBAC: Authorizing `identity:get_user(user_id=f12b1c7197be485395ef47860829f1b2)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:51.077719 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0de186-f232-41ab-a746-2f5326d12963 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:51.079398 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 125/261] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:44:50 2022] GET /identity/v3/users/f12b1c7197be485395ef47860829f1b2 => generated 283 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:51.085333 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0de186-f232-41ab-a746-2f5326d12963 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:51.188662 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:51.215274 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab597390-9476-4275-9785-7c32003ced71 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:51.300226 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c404504d-188d-494f-b388-53b813d73de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:51.301151 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c404504d-188d-494f-b388-53b813d73de3 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:51.301604 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c404504d-188d-494f-b388-53b813d73de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:51.302017 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c404504d-188d-494f-b388-53b813d73de3 None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:51.302917 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c404504d-188d-494f-b388-53b813d73de3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:51.303363 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c404504d-188d-494f-b388-53b813d73de3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:51.304923 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c404504d-188d-494f-b388-53b813d73de3 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:51.314966 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 137/262] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:44:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:51.322937 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c404504d-188d-494f-b388-53b813d73de3 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:51.345768 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0de186-f232-41ab-a746-2f5326d12963 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:51.417522 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f70ab4-b22b-478e-a63f-db9a18a36060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:51.418171 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f70ab4-b22b-478e-a63f-db9a18a36060 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:51.418938 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f70ab4-b22b-478e-a63f-db9a18a36060 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:51.419216 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f70ab4-b22b-478e-a63f-db9a18a36060 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:51.508080 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:51.518314 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c404504d-188d-494f-b388-53b813d73de3 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:51.561891 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f70ab4-b22b-478e-a63f-db9a18a36060 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:51.563715 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f70ab4-b22b-478e-a63f-db9a18a36060 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:51.615064 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278a075-409b-45b7-b32c-5ebe39d3d23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:51.617064 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278a075-409b-45b7-b32c-5ebe39d3d23f None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:51.617346 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278a075-409b-45b7-b32c-5ebe39d3d23f None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:51.617624 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278a075-409b-45b7-b32c-5ebe39d3d23f None admin] PATH_INFO: `/v3/users/f12b1c7197be485395ef47860829f1b2` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:51.628293 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d278a075-409b-45b7-b32c-5ebe39d3d23f None admin] RBAC: Authorizing `identity:get_user(user_id=f12b1c7197be485395ef47860829f1b2)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:51.629780 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d278a075-409b-45b7-b32c-5ebe39d3d23f None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:51.631451 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 138/263] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:44:51 2022] GET /identity/v3/users/f12b1c7197be485395ef47860829f1b2 => generated 283 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:44:51.637040 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278a075-409b-45b7-b32c-5ebe39d3d23f None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:51.670459 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:51.819920 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278a075-409b-45b7-b32c-5ebe39d3d23f None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:51.835346 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 126/264] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:44:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 750 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 03 11:44:51.842258 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f70ab4-b22b-478e-a63f-db9a18a36060 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:51.882466 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7bc4e2-652d-4bdc-a9c0-bf57414dd356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:51.883120 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7bc4e2-652d-4bdc-a9c0-bf57414dd356 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:51.883405 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7bc4e2-652d-4bdc-a9c0-bf57414dd356 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:51.883704 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7bc4e2-652d-4bdc-a9c0-bf57414dd356 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:51.950840 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:52.027366 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7bc4e2-652d-4bdc-a9c0-bf57414dd356 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:52.029100 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7bc4e2-652d-4bdc-a9c0-bf57414dd356 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:52.041218 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f70ab4-b22b-478e-a63f-db9a18a36060 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:52.111190 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09200aa3-b7eb-4c42-94ea-5d9203ffb2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:52.112997 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09200aa3-b7eb-4c42-94ea-5d9203ffb2b9 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:52.113279 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09200aa3-b7eb-4c42-94ea-5d9203ffb2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:52.113555 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09200aa3-b7eb-4c42-94ea-5d9203ffb2b9 None admin] PATH_INFO: `/v3/projects/deb1496445dd47a6ba9ad9fb02737115` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:52.115454 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09200aa3-b7eb-4c42-94ea-5d9203ffb2b9 None admin] RBAC: Authorizing `identity:get_project(project_id=deb1496445dd47a6ba9ad9fb02737115)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:52.118512 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09200aa3-b7eb-4c42-94ea-5d9203ffb2b9 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:52.120277 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 127/265] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:44:51 2022] GET /identity/v3/projects/deb1496445dd47a6ba9ad9fb02737115 => generated 302 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:44:52.126969 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09200aa3-b7eb-4c42-94ea-5d9203ffb2b9 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:52.134736 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:52.223588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 139/266] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:44:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 11:44:52.228953 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7bc4e2-652d-4bdc-a9c0-bf57414dd356 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:52.304695 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09200aa3-b7eb-4c42-94ea-5d9203ffb2b9 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:52.315880 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:52.349887 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18720c-fea8-4b8e-81eb-3218f62c7d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:52.351125 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18720c-fea8-4b8e-81eb-3218f62c7d65 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:52.351606 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18720c-fea8-4b8e-81eb-3218f62c7d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:52.352127 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18720c-fea8-4b8e-81eb-3218f62c7d65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:52.353203 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18720c-fea8-4b8e-81eb-3218f62c7d65 None admin] RBAC: Adding query filter params (role.id=c486e164840b41a59fd118dece2ce572, scope.project.id=deb1496445dd47a6ba9ad9fb02737115, user.id=f12b1c7197be485395ef47860829f1b2) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:52.353659 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18720c-fea8-4b8e-81eb-3218f62c7d65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:52.355423 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18720c-fea8-4b8e-81eb-3218f62c7d65 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:52.361668 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7bc4e2-652d-4bdc-a9c0-bf57414dd356 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:52.366990 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 128/267] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:44:52 2022] GET /identity/v3/role_assignments?user.id=f12b1c7197be485395ef47860829f1b2&scope.project.id=deb1496445dd47a6ba9ad9fb02737115&role.id=c486e164840b41a59fd118dece2ce572 => generated 608 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:52.415162 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820e1c5-67f3-425a-b13f-335a4503e1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:52.416199 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820e1c5-67f3-425a-b13f-335a4503e1f3 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:52.416655 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820e1c5-67f3-425a-b13f-335a4503e1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:52.417103 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820e1c5-67f3-425a-b13f-335a4503e1f3 None admin] PATH_INFO: `/v3/projects/deb1496445dd47a6ba9ad9fb02737115` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:52.419126 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a820e1c5-67f3-425a-b13f-335a4503e1f3 None admin] RBAC: Authorizing `identity:get_project(project_id=deb1496445dd47a6ba9ad9fb02737115)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:52.421853 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a820e1c5-67f3-425a-b13f-335a4503e1f3 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:52.425672 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 140/268] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:44:52 2022] GET /identity/v3/projects/deb1496445dd47a6ba9ad9fb02737115 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:52.431449 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18720c-fea8-4b8e-81eb-3218f62c7d65 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:52.527749 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:52.567285 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18720c-fea8-4b8e-81eb-3218f62c7d65 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:52.606566 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f6bc8-74c1-4df6-b6e5-4a980fc980ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:52.607626 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f6bc8-74c1-4df6-b6e5-4a980fc980ef None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:52.608111 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f6bc8-74c1-4df6-b6e5-4a980fc980ef None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:52.608607 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f6bc8-74c1-4df6-b6e5-4a980fc980ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:52.609638 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f6bc8-74c1-4df6-b6e5-4a980fc980ef None admin] RBAC: Adding query filter params (role.id=5d1199580aaa485bb120b35e6f771ff9, scope.project.id=deb1496445dd47a6ba9ad9fb02737115, user.id=f12b1c7197be485395ef47860829f1b2) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:52.610151 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f6bc8-74c1-4df6-b6e5-4a980fc980ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:52.612022 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f6bc8-74c1-4df6-b6e5-4a980fc980ef None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:52.619603 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 129/269] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:44:52 2022] GET /identity/v3/role_assignments?user.id=f12b1c7197be485395ef47860829f1b2&scope.project.id=deb1496445dd47a6ba9ad9fb02737115&role.id=5d1199580aaa485bb120b35e6f771ff9 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:52.957682 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d9e87-c37a-4814-96b3-beb6a06d7fc2 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:52.958196 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d9e87-c37a-4814-96b3-beb6a06d7fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:52.958270 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d9e87-c37a-4814-96b3-beb6a06d7fc2 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:52.959928 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 141/270] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:44:52.966131 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d373a-5d5a-4fc4-ab4a-19a2e6c0ad01 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:52.966766 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d373a-5d5a-4fc4-ab4a-19a2e6c0ad01 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:52.967245 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d373a-5d5a-4fc4-ab4a-19a2e6c0ad01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:52.996358 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-5c9d373a-5d5a-4fc4-ab4a-19a2e6c0ad01 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:52.997893 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-5c9d373a-5d5a-4fc4-ab4a-19a2e6c0ad01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:53.012747 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223083a-cfc8-467c-8e44-795135486ab9 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:53.013394 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223083a-cfc8-467c-8e44-795135486ab9 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:53.013898 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223083a-cfc8-467c-8e44-795135486ab9 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:53.015476 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 142/271] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:44:53.021050 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdc4e2-5fc0-4799-9d45-d306d73ee4fd None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:53.021344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdc4e2-5fc0-4799-9d45-d306d73ee4fd None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:53.021631 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdc4e2-5fc0-4799-9d45-d306d73ee4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:53.044554 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-29fdc4e2-5fc0-4799-9d45-d306d73ee4fd None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:53.046130 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-29fdc4e2-5fc0-4799-9d45-d306d73ee4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:53.086527 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 130/272] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 11:44:53.090128 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf567a33-bf91-485b-8c3c-02b3b6be333d None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:53.090128 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf567a33-bf91-485b-8c3c-02b3b6be333d None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:53.090128 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf567a33-bf91-485b-8c3c-02b3b6be333d None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:53.090128 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 131/273] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:44:53.095528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc22452-5c45-4d2a-b607-078d6b71454f None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:53.095824 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc22452-5c45-4d2a-b607-078d6b71454f None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:53.096105 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc22452-5c45-4d2a-b607-078d6b71454f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:53.114594 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-0dc22452-5c45-4d2a-b607-078d6b71454f None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:53.116107 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-0dc22452-5c45-4d2a-b607-078d6b71454f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:53.143635 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 143/274] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 11:44:53.144660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fdc4e2-5fc0-4799-9d45-d306d73ee4fd None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:53.182361 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:53.195265 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 132/275] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:44:53.197501 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc22452-5c45-4d2a-b607-078d6b71454f None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:53.226445 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:53.269894 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fdc4e2-5fc0-4799-9d45-d306d73ee4fd None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:53.301296 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc22452-5c45-4d2a-b607-078d6b71454f None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:53.307987 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1f66e-eb75-4205-b1af-cf880249e6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:53.308785 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1f66e-eb75-4205-b1af-cf880249e6bb None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:53.309058 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1f66e-eb75-4205-b1af-cf880249e6bb None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:53.309325 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1f66e-eb75-4205-b1af-cf880249e6bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:53.319648 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc1f66e-eb75-4205-b1af-cf880249e6bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:44:53.327175 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-5cc1f66e-eb75-4205-b1af-cf880249e6bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 11:44:53.327175 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:44:53.327175 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:44:53.327175 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:44:53.327175 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:44:53.327175 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:44:53.327175 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:44:53.327175 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:44:53.327175 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:44:53.327175 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:44:53.327175 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:44:53.327175 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:44:53.327175 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:44:53.327175 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:44:53.327175 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:44:53.327175 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:44:53.328091 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:44:53.328091 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:44:53.328091 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:44:53.328091 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:44:53.328091 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:44:53.328091 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:44:53.328091 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:44:53.328091 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:44:53.328091 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:44:53.328091 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:44:53.328091 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:44:53.328091 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:44:53.328091 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:44:53.328091 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:44:53.328091 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:44:53.328091 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:44:53.328891 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:44:53.328891 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:44:53.328891 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:44:53.328891 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:44:53.328891 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:44:53.328891 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:44:53.328891 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:44:53.328891 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:44:53.328891 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:44:53.328891 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:44:53.328891 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 11:44:53.328891 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:44:53.328891 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 144/276] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:44:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:44:53.329674 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1f66e-eb75-4205-b1af-cf880249e6bb None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:53.342148 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73941e3e-c31c-456c-a096-a0e051ffe878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:53.342945 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73941e3e-c31c-456c-a096-a0e051ffe878 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:53.343228 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73941e3e-c31c-456c-a096-a0e051ffe878 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:53.343511 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73941e3e-c31c-456c-a096-a0e051ffe878 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:53.354813 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73941e3e-c31c-456c-a096-a0e051ffe878 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:44:53.363034 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-73941e3e-c31c-456c-a096-a0e051ffe878 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 11:44:53.363034 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:44:53.363034 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:44:53.363034 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:44:53.363034 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:44:53.363034 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:44:53.363034 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:44:53.363034 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:44:53.363034 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:44:53.363034 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:44:53.363034 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:44:53.363034 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:44:53.363034 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:44:53.363034 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:44:53.363034 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:44:53.363034 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:44:53.364269 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:44:53.364269 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:44:53.364269 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:44:53.364269 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:44:53.364269 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:44:53.364269 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:44:53.364269 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:44:53.364269 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:44:53.364269 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:44:53.364269 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:44:53.364269 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:44:53.364269 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:44:53.364269 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:44:53.364269 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:44:53.364269 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:44:53.364269 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:44:53.365250 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:44:53.365250 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:44:53.365250 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:44:53.365250 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:44:53.365250 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:44:53.365250 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:44:53.365250 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:44:53.365250 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:44:53.365250 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:44:53.365250 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:44:53.365250 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 11:44:53.365250 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:44:53.365250 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 133/277] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:44:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:44:53.365250 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73941e3e-c31c-456c-a096-a0e051ffe878 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:53.421054 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:53.447120 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1f66e-eb75-4205-b1af-cf880249e6bb None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:53.470741 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:53.480407 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73941e3e-c31c-456c-a096-a0e051ffe878 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:53.484481 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc44493-aff5-4a34-9217-c2a2605f1018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:53.485276 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc44493-aff5-4a34-9217-c2a2605f1018 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:53.485560 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc44493-aff5-4a34-9217-c2a2605f1018 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:53.485839 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc44493-aff5-4a34-9217-c2a2605f1018 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:53.487547 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc44493-aff5-4a34-9217-c2a2605f1018 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:53.489005 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc44493-aff5-4a34-9217-c2a2605f1018 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:53.495067 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 145/278] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:44:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:53.495067 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc44493-aff5-4a34-9217-c2a2605f1018 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:53.520763 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ac571-c8aa-4d0b-b45e-05aca9756dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:53.521429 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ac571-c8aa-4d0b-b45e-05aca9756dde None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:53.521709 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ac571-c8aa-4d0b-b45e-05aca9756dde None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:53.522237 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ac571-c8aa-4d0b-b45e-05aca9756dde None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:53.522712 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9ac571-c8aa-4d0b-b45e-05aca9756dde None admin] RBAC: Adding query filter params (name=member) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:53.523013 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9ac571-c8aa-4d0b-b45e-05aca9756dde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:53.524413 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9ac571-c8aa-4d0b-b45e-05aca9756dde None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:53.534561 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 134/279] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 3 11:44:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:53.535418 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ac571-c8aa-4d0b-b45e-05aca9756dde None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:53.598096 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc44493-aff5-4a34-9217-c2a2605f1018 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:53.631245 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc436b0-1ce6-40fe-9c43-93c171a62899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:53.631943 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc436b0-1ce6-40fe-9c43-93c171a62899 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:53.632236 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc436b0-1ce6-40fe-9c43-93c171a62899 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:53.632625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc436b0-1ce6-40fe-9c43-93c171a62899 None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:53.633383 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc436b0-1ce6-40fe-9c43-93c171a62899 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:53.633693 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc436b0-1ce6-40fe-9c43-93c171a62899 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:53.635085 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc436b0-1ce6-40fe-9c43-93c171a62899 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:53.647872 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ac571-c8aa-4d0b-b45e-05aca9756dde None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:53.648033 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 146/280] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 3 11:44:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:53.648033 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc436b0-1ce6-40fe-9c43-93c171a62899 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:53.662783 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:53.686197 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef422d-4d43-4bb6-9daa-728f05c6f1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:53.687052 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef422d-4d43-4bb6-9daa-728f05c6f1a7 None admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:53.687451 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef422d-4d43-4bb6-9daa-728f05c6f1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:53.687759 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef422d-4d43-4bb6-9daa-728f05c6f1a7 None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:53.688468 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef422d-4d43-4bb6-9daa-728f05c6f1a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:53.689934 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef422d-4d43-4bb6-9daa-728f05c6f1a7 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:53.706727 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:53.723531 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 135/281] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Jun 3 11:44:53 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:44:53.723531 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef422d-4d43-4bb6-9daa-728f05c6f1a7 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:53.776544 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc436b0-1ce6-40fe-9c43-93c171a62899 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:53.814090 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f665a7-44c6-4f09-97d3-3d83c6a602c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:53.815538 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f665a7-44c6-4f09-97d3-3d83c6a602c8 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:53.815822 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f665a7-44c6-4f09-97d3-3d83c6a602c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:53.816098 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f665a7-44c6-4f09-97d3-3d83c6a602c8 None admin] PATH_INFO: `/v3/users/0db8f62b3b07488982e3f6e486e78240` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:53.832926 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f665a7-44c6-4f09-97d3-3d83c6a602c8 None admin] RBAC: Authorizing `identity:get_user(user_id=0db8f62b3b07488982e3f6e486e78240)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:53.834471 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f665a7-44c6-4f09-97d3-3d83c6a602c8 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:53.836512 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 147/282] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:44:53 2022] GET /identity/v3/users/0db8f62b3b07488982e3f6e486e78240 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:53.841294 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600aa3ab-f7a3-475f-9271-ae1ce69d43c3 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:53.841863 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600aa3ab-f7a3-475f-9271-ae1ce69d43c3 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:53.842146 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600aa3ab-f7a3-475f-9271-ae1ce69d43c3 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:53.844173 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 148/283] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:44:53.848678 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef422d-4d43-4bb6-9daa-728f05c6f1a7 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:53.848946 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600aa3ab-f7a3-475f-9271-ae1ce69d43c3 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:53.885761 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c7701-6b60-4871-a1d9-4e129153aa80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:53.886711 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c7701-6b60-4871-a1d9-4e129153aa80 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:53.887003 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c7701-6b60-4871-a1d9-4e129153aa80 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:53.887290 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c7701-6b60-4871-a1d9-4e129153aa80 None admin] PATH_INFO: `/v3/users/1deed3c54dc84dfd8351ea38de2fa499` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:53.888619 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7c7701-6b60-4871-a1d9-4e129153aa80 None admin] RBAC: Authorizing `identity:get_user(user_id=1deed3c54dc84dfd8351ea38de2fa499)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:53.890169 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7c7701-6b60-4871-a1d9-4e129153aa80 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:53.900200 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 136/284] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:44:53 2022] GET /identity/v3/users/1deed3c54dc84dfd8351ea38de2fa499 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:53.900200 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac4ed8-a35c-4b95-bf4c-e8ced124afc1 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:53.900200 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac4ed8-a35c-4b95-bf4c-e8ced124afc1 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:53.900200 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac4ed8-a35c-4b95-bf4c-e8ced124afc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:53.918241 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-3cac4ed8-a35c-4b95-bf4c-e8ced124afc1 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:53.919470 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-3cac4ed8-a35c-4b95-bf4c-e8ced124afc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:53.957520 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:53.971663 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600aa3ab-f7a3-475f-9271-ae1ce69d43c3 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:53.985969 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:54.003540 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 137/285] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:44:54.004379 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac4ed8-a35c-4b95-bf4c-e8ced124afc1 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:54.017925 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031b6c4-00bc-4e0e-b337-bd4cd39f4155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:54.018941 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031b6c4-00bc-4e0e-b337-bd4cd39f4155 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:54.019237 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031b6c4-00bc-4e0e-b337-bd4cd39f4155 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:54.019553 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031b6c4-00bc-4e0e-b337-bd4cd39f4155 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:54.020567 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8031b6c4-00bc-4e0e-b337-bd4cd39f4155 None admin] RBAC: Adding query filter params (role.id=781e2d573ee94afaae05b3cc0bba8768, user.id=0db8f62b3b07488982e3f6e486e78240, scope.system=all) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:54.020890 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8031b6c4-00bc-4e0e-b337-bd4cd39f4155 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:54.022514 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8031b6c4-00bc-4e0e-b337-bd4cd39f4155 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:54.030659 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 149/286] 10.222.0.15 () {56 vars in 1308 bytes} [Fri Jun 3 11:44:53 2022] GET /identity/v3/role_assignments?user.id=0db8f62b3b07488982e3f6e486e78240&scope.system=all&role.id=781e2d573ee94afaae05b3cc0bba8768 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:54.031487 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031b6c4-00bc-4e0e-b337-bd4cd39f4155 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:54.150658 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac4ed8-a35c-4b95-bf4c-e8ced124afc1 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:54.190821 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa86c29-8e2c-4639-bdff-24eb3450077d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:54.191745 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa86c29-8e2c-4639-bdff-24eb3450077d None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:54.192032 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa86c29-8e2c-4639-bdff-24eb3450077d None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:54.192310 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa86c29-8e2c-4639-bdff-24eb3450077d None admin] PATH_INFO: `/v3/projects/deb1496445dd47a6ba9ad9fb02737115` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:54.193952 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa86c29-8e2c-4639-bdff-24eb3450077d None admin] RBAC: Authorizing `identity:get_project(project_id=deb1496445dd47a6ba9ad9fb02737115)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:54.195447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa86c29-8e2c-4639-bdff-24eb3450077d None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:54.197553 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 138/287] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:44:54 2022] GET /identity/v3/projects/deb1496445dd47a6ba9ad9fb02737115 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:54.203799 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa86c29-8e2c-4639-bdff-24eb3450077d None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:54.218211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031b6c4-00bc-4e0e-b337-bd4cd39f4155 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:54.269003 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:54.287755 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c380c-9e03-41ab-865e-c52069467a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:54.288607 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c380c-9e03-41ab-865e-c52069467a8b None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:54.288943 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c380c-9e03-41ab-865e-c52069467a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:54.289225 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c380c-9e03-41ab-865e-c52069467a8b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:54.310280 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0c380c-9e03-41ab-865e-c52069467a8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:44:54.321598 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-bb0c380c-9e03-41ab-865e-c52069467a8b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 11:44:54.321598 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:44:54.321598 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:44:54.321598 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:44:54.321598 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:44:54.321598 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:44:54.321598 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:44:54.321598 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:44:54.321598 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:44:54.321598 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:44:54.321598 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:44:54.321598 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:44:54.321598 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:44:54.321598 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:44:54.321598 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:44:54.321598 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:44:54.322515 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:44:54.322515 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:44:54.322515 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:44:54.322515 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:44:54.322515 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:44:54.322515 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:44:54.322515 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:44:54.322515 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:44:54.322515 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:44:54.322515 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:44:54.322515 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:44:54.322515 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:44:54.322515 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:44:54.322515 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:44:54.322515 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:44:54.322515 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:44:54.323301 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:44:54.323301 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:44:54.323301 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:44:54.323301 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:44:54.323301 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:44:54.323301 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:44:54.323301 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:44:54.323301 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:44:54.323301 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:44:54.323301 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:44:54.323301 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 11:44:54.323301 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:44:54.324147 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 150/288] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:44:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:44:54.337146 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c380c-9e03-41ab-865e-c52069467a8b None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:54.393890 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa86c29-8e2c-4639-bdff-24eb3450077d None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:54.406275 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:54.461097 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e63f43-5c2a-41e5-96bf-1f4e66381581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:54.462061 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e63f43-5c2a-41e5-96bf-1f4e66381581 None admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:54.462340 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e63f43-5c2a-41e5-96bf-1f4e66381581 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:54.462613 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e63f43-5c2a-41e5-96bf-1f4e66381581 None admin] PATH_INFO: `/v3/projects/deb1496445dd47a6ba9ad9fb02737115/users/1deed3c54dc84dfd8351ea38de2fa499/roles/c2a1a291255141b3b6eee6132725bfff` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:54.465964 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e63f43-5c2a-41e5-96bf-1f4e66381581 None admin] RBAC: Authorizing `identity:create_grant(project_id=deb1496445dd47a6ba9ad9fb02737115, user_id=1deed3c54dc84dfd8351ea38de2fa499, role_id=c2a1a291255141b3b6eee6132725bfff)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:54.467420 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e63f43-5c2a-41e5-96bf-1f4e66381581 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:54.488458 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 139/289] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Jun 3 11:44:54 2022] PUT /identity/v3/projects/deb1496445dd47a6ba9ad9fb02737115/users/1deed3c54dc84dfd8351ea38de2fa499/roles/c2a1a291255141b3b6eee6132725bfff => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:44:54.510471 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c380c-9e03-41ab-865e-c52069467a8b None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:54.548500 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1dad92-df58-47bc-a113-775d18406dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:54.550147 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1dad92-df58-47bc-a113-775d18406dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:54.550661 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1dad92-df58-47bc-a113-775d18406dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:54.551106 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1dad92-df58-47bc-a113-775d18406dd8 None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:54.552212 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1dad92-df58-47bc-a113-775d18406dd8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:54.552693 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1dad92-df58-47bc-a113-775d18406dd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:54.554325 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1dad92-df58-47bc-a113-775d18406dd8 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:54.565348 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 151/290] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 3 11:44:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:54.576694 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e63f43-5c2a-41e5-96bf-1f4e66381581 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:54.732772 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:54.740450 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e63f43-5c2a-41e5-96bf-1f4e66381581 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:54.789188 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b81e25-1a5d-4dbf-9354-e43d49ba4d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:54.790068 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b81e25-1a5d-4dbf-9354-e43d49ba4d38 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:54.790351 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b81e25-1a5d-4dbf-9354-e43d49ba4d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:54.790629 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b81e25-1a5d-4dbf-9354-e43d49ba4d38 None admin] PATH_INFO: `/v3/users/14dcc2ad41c44f4684faee72ef37206c` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:54.792351 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b81e25-1a5d-4dbf-9354-e43d49ba4d38 None admin] RBAC: Authorizing `identity:get_user(user_id=14dcc2ad41c44f4684faee72ef37206c)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:54.793802 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b81e25-1a5d-4dbf-9354-e43d49ba4d38 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:54.795754 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 140/291] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:44:54 2022] GET /identity/v3/users/14dcc2ad41c44f4684faee72ef37206c => generated 297 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:54.803566 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1dad92-df58-47bc-a113-775d18406dd8 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:54.946368 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:54.952885 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1dad92-df58-47bc-a113-775d18406dd8 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:55.003610 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978baeb5-a5eb-48dd-9189-3113526591ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:55.004212 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978baeb5-a5eb-48dd-9189-3113526591ee None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:55.004462 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978baeb5-a5eb-48dd-9189-3113526591ee None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:55.004738 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978baeb5-a5eb-48dd-9189-3113526591ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:55.076058 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978baeb5-a5eb-48dd-9189-3113526591ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:55.077525 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978baeb5-a5eb-48dd-9189-3113526591ee None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:55.173911 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:55.181426 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 152/292] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:44:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 11:44:55.188604 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b81e25-1a5d-4dbf-9354-e43d49ba4d38 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:55.337763 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b81e25-1a5d-4dbf-9354-e43d49ba4d38 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:55.378306 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649cfdb5-4633-496f-8232-9e3b9b0ff90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:55.379175 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649cfdb5-4633-496f-8232-9e3b9b0ff90f None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:55.379455 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649cfdb5-4633-496f-8232-9e3b9b0ff90f None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:55.379759 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649cfdb5-4633-496f-8232-9e3b9b0ff90f None admin] PATH_INFO: `/v3/projects/deb1496445dd47a6ba9ad9fb02737115` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:55.380956 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649cfdb5-4633-496f-8232-9e3b9b0ff90f None admin] RBAC: Authorizing `identity:get_project(project_id=deb1496445dd47a6ba9ad9fb02737115)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:55.382394 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649cfdb5-4633-496f-8232-9e3b9b0ff90f None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:55.384113 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 141/293] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:44:55 2022] GET /identity/v3/projects/deb1496445dd47a6ba9ad9fb02737115 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:55.389949 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978baeb5-a5eb-48dd-9189-3113526591ee None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:55.518767 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978baeb5-a5eb-48dd-9189-3113526591ee None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:55.564241 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e6f26-acba-412e-8110-b1d709cb8036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:55.564955 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e6f26-acba-412e-8110-b1d709cb8036 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:55.565240 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e6f26-acba-412e-8110-b1d709cb8036 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:55.565513 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e6f26-acba-412e-8110-b1d709cb8036 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:55.566350 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2e6f26-acba-412e-8110-b1d709cb8036 None admin] RBAC: Adding query filter params (role.id=781e2d573ee94afaae05b3cc0bba8768, scope.project.id=deb1496445dd47a6ba9ad9fb02737115, user.id=14dcc2ad41c44f4684faee72ef37206c) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:55.566662 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2e6f26-acba-412e-8110-b1d709cb8036 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:55.568138 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2e6f26-acba-412e-8110-b1d709cb8036 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:55.574349 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 153/294] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:44:55 2022] GET /identity/v3/role_assignments?user.id=14dcc2ad41c44f4684faee72ef37206c&scope.project.id=deb1496445dd47a6ba9ad9fb02737115&role.id=781e2d573ee94afaae05b3cc0bba8768 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:56.529488 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe18ae4-f0d6-44b7-8a34-796a93cf315b None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:56.530008 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe18ae4-f0d6-44b7-8a34-796a93cf315b None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:56.530083 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe18ae4-f0d6-44b7-8a34-796a93cf315b None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:56.531652 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 142/295] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:44:56.537101 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e528c5-0975-4eda-8498-3d7301592b2f None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:56.537497 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e528c5-0975-4eda-8498-3d7301592b2f None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:56.537660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e528c5-0975-4eda-8498-3d7301592b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:56.555525 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-a2e528c5-0975-4eda-8498-3d7301592b2f None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:56.556759 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-a2e528c5-0975-4eda-8498-3d7301592b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:56.563448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf7aee-9751-4a58-8bed-f558d7fdae05 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:56.564029 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf7aee-9751-4a58-8bed-f558d7fdae05 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:56.564501 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf7aee-9751-4a58-8bed-f558d7fdae05 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:56.566971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 143/296] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:44:56.572167 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68730e-43c8-4db9-b153-fac2b99e46c2 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:56.572694 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68730e-43c8-4db9-b153-fac2b99e46c2 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:56.573166 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68730e-43c8-4db9-b153-fac2b99e46c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:56.590266 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-2e68730e-43c8-4db9-b153-fac2b99e46c2 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:56.591764 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-2e68730e-43c8-4db9-b153-fac2b99e46c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:56.622568 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:56.628714 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:56.642838 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 154/297] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:44:56.644926 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3bdeb-50e0-4953-a348-3cd4312169a5 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:56.645216 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3bdeb-50e0-4953-a348-3cd4312169a5 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:56.645488 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3bdeb-50e0-4953-a348-3cd4312169a5 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:56.646903 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 155/298] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:44:56.652625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd4a2a-53ce-4f3e-96ec-e4c6dbb847d8 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:56.652909 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd4a2a-53ce-4f3e-96ec-e4c6dbb847d8 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:56.653183 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd4a2a-53ce-4f3e-96ec-e4c6dbb847d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:56.671156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-ebcd4a2a-53ce-4f3e-96ec-e4c6dbb847d8 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:56.672167 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 144/299] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 11:44:56.672858 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68730e-43c8-4db9-b153-fac2b99e46c2 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:56.675901 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-ebcd4a2a-53ce-4f3e-96ec-e4c6dbb847d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:56.756004 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 156/300] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 11:44:56.765020 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd4a2a-53ce-4f3e-96ec-e4c6dbb847d8 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:56.785680 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68730e-43c8-4db9-b153-fac2b99e46c2 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:56.823297 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518b325-93d6-4e6a-920c-8f2eba801a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:56.824172 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518b325-93d6-4e6a-920c-8f2eba801a2a None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:56.824461 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518b325-93d6-4e6a-920c-8f2eba801a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:56.824739 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518b325-93d6-4e6a-920c-8f2eba801a2a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:56.836429 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518b325-93d6-4e6a-920c-8f2eba801a2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:44:56.844583 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-6518b325-93d6-4e6a-920c-8f2eba801a2a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 11:44:56.844583 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:44:56.844583 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:44:56.844583 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:44:56.844583 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:44:56.844583 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:44:56.844583 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:44:56.844583 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:44:56.844583 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:44:56.844583 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:44:56.844583 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:44:56.844583 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:44:56.844583 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:44:56.844583 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:44:56.844583 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:44:56.844583 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:44:56.845459 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:44:56.845459 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:44:56.845459 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:44:56.845459 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:44:56.845459 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:44:56.845459 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:44:56.845459 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:44:56.845459 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:44:56.845459 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:44:56.845459 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:44:56.845459 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:44:56.845459 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:44:56.845459 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:44:56.845459 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:44:56.845459 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:44:56.845459 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:44:56.846300 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:44:56.846300 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:44:56.846300 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:44:56.846300 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:44:56.846300 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:44:56.846300 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:44:56.846300 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:44:56.846300 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:44:56.846300 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:44:56.846300 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:44:56.846300 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 11:44:56.846300 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:44:56.846300 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 145/301] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:44:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:44:56.847433 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518b325-93d6-4e6a-920c-8f2eba801a2a None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:56.872694 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd4a2a-53ce-4f3e-96ec-e4c6dbb847d8 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:56.873268 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:56.898438 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:56.914111 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206357f3-e579-498a-890a-41cc80514a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:56.914904 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206357f3-e579-498a-890a-41cc80514a0e None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:56.915184 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206357f3-e579-498a-890a-41cc80514a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:56.915455 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206357f3-e579-498a-890a-41cc80514a0e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:56.926050 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206357f3-e579-498a-890a-41cc80514a0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:44:56.934033 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-206357f3-e579-498a-890a-41cc80514a0e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 11:44:56.934033 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:44:56.934033 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:44:56.934033 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:44:56.934033 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:44:56.934033 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:44:56.934033 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:44:56.934033 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:44:56.934033 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:44:56.934033 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:44:56.934033 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:44:56.934033 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:44:56.934033 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:44:56.934033 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:44:56.934033 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:44:56.934033 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:44:56.935057 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:44:56.935057 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:44:56.935057 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:44:56.935057 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:44:56.935057 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:44:56.935057 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:44:56.935057 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:44:56.935057 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:44:56.935057 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:44:56.935057 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:44:56.935057 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:44:56.935057 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:44:56.935057 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:44:56.935057 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:44:56.935057 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:44:56.935057 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:44:56.935903 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:44:56.935903 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:44:56.935903 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:44:56.935903 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:44:56.935903 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:44:56.935903 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:44:56.935903 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:44:56.935903 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:44:56.935903 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:44:56.935903 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:44:56.935903 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 11:44:56.935903 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:44:56.935903 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 157/302] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:44:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:44:56.936564 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206357f3-e579-498a-890a-41cc80514a0e None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:56.970307 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518b325-93d6-4e6a-920c-8f2eba801a2a None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:57.007145 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea3b745-eaee-4d1a-b136-98f45be05378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:57.008258 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3b745-eaee-4d1a-b136-98f45be05378 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:57.008749 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3b745-eaee-4d1a-b136-98f45be05378 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:57.009316 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3b745-eaee-4d1a-b136-98f45be05378 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:57.010776 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea3b745-eaee-4d1a-b136-98f45be05378 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:57.012457 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea3b745-eaee-4d1a-b136-98f45be05378 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:57.014574 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 146/303] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:44:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:57.015597 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea3b745-eaee-4d1a-b136-98f45be05378 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:57.044650 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206357f3-e579-498a-890a-41cc80514a0e None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:57.079003 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ae7bf-a374-41a3-adef-27dc6d1cff26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:57.079693 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ae7bf-a374-41a3-adef-27dc6d1cff26 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:57.079980 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ae7bf-a374-41a3-adef-27dc6d1cff26 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:57.080257 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ae7bf-a374-41a3-adef-27dc6d1cff26 None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:57.081104 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58ae7bf-a374-41a3-adef-27dc6d1cff26 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:57.081410 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58ae7bf-a374-41a3-adef-27dc6d1cff26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:57.082790 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58ae7bf-a374-41a3-adef-27dc6d1cff26 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:57.091838 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 158/304] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 3 11:44:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:57.092690 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ae7bf-a374-41a3-adef-27dc6d1cff26 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:57.113577 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:57.124777 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea3b745-eaee-4d1a-b136-98f45be05378 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:57.136624 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:57.161326 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00665b2-4185-4d19-8fd5-be41331a9fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:57.161986 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00665b2-4185-4d19-8fd5-be41331a9fc1 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:57.162263 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00665b2-4185-4d19-8fd5-be41331a9fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:57.162529 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00665b2-4185-4d19-8fd5-be41331a9fc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:57.163259 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00665b2-4185-4d19-8fd5-be41331a9fc1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:57.163583 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00665b2-4185-4d19-8fd5-be41331a9fc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:57.165309 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00665b2-4185-4d19-8fd5-be41331a9fc1 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:57.175112 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 147/305] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 3 11:44:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:57.176219 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00665b2-4185-4d19-8fd5-be41331a9fc1 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:57.195702 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ae7bf-a374-41a3-adef-27dc6d1cff26 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:57.230520 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd89bd-d684-4be9-aab2-538b6b2a7367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:57.231209 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd89bd-d684-4be9-aab2-538b6b2a7367 None admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:57.231464 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd89bd-d684-4be9-aab2-538b6b2a7367 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:57.231777 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd89bd-d684-4be9-aab2-538b6b2a7367 None admin] PATH_INFO: `/v3/groups` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:57.232459 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dd89bd-d684-4be9-aab2-538b6b2a7367 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:57.233915 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dd89bd-d684-4be9-aab2-538b6b2a7367 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:57.250579 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 159/306] 10.222.0.15 () {60 vars in 1134 bytes} [Fri Jun 3 11:44:57 2022] POST /identity/v3/groups => generated 229 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:44:57.257826 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd89bd-d684-4be9-aab2-538b6b2a7367 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:57.294486 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00665b2-4185-4d19-8fd5-be41331a9fc1 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:57.333765 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b20da-3aa3-447d-85a5-a20a7d901dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:57.334657 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b20da-3aa3-447d-85a5-a20a7d901dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:57.334944 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b20da-3aa3-447d-85a5-a20a7d901dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:57.335220 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b20da-3aa3-447d-85a5-a20a7d901dc6 None admin] PATH_INFO: `/v3/users/e5ba766e7bab403fb54261621ece8de3` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:57.352347 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b20da-3aa3-447d-85a5-a20a7d901dc6 None admin] RBAC: Authorizing `identity:get_user(user_id=e5ba766e7bab403fb54261621ece8de3)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:57.353958 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b20da-3aa3-447d-85a5-a20a7d901dc6 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:57.355899 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 148/307] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:44:57 2022] GET /identity/v3/users/e5ba766e7bab403fb54261621ece8de3 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:57.357323 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f0e5d-722a-4e84-b371-e02b32a96a99 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:57.357613 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f0e5d-722a-4e84-b371-e02b32a96a99 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:57.357888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f0e5d-722a-4e84-b371-e02b32a96a99 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:57.363692 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 149/308] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:44:57.365104 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f0e5d-722a-4e84-b371-e02b32a96a99 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:57.378409 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:57.379576 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd89bd-d684-4be9-aab2-538b6b2a7367 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:57.381640 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:57.422512 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ee835-bedb-4aad-b42a-0b6b1b4bea11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:57.423409 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ee835-bedb-4aad-b42a-0b6b1b4bea11 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:57.423729 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ee835-bedb-4aad-b42a-0b6b1b4bea11 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:57.424003 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ee835-bedb-4aad-b42a-0b6b1b4bea11 None admin] PATH_INFO: `/v3/users/0db8f62b3b07488982e3f6e486e78240` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:57.425313 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ee835-bedb-4aad-b42a-0b6b1b4bea11 None admin] RBAC: Authorizing `identity:get_user(user_id=0db8f62b3b07488982e3f6e486e78240)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:57.426835 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ee835-bedb-4aad-b42a-0b6b1b4bea11 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:57.428566 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 160/309] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:44:57 2022] GET /identity/v3/users/0db8f62b3b07488982e3f6e486e78240 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:57.429784 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d91fa-8094-4d10-9670-ffd53049aa9b None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:57.430073 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d91fa-8094-4d10-9670-ffd53049aa9b None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:57.430352 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d91fa-8094-4d10-9670-ffd53049aa9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:57.448495 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-532d91fa-8094-4d10-9670-ffd53049aa9b None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:57.449689 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-532d91fa-8094-4d10-9670-ffd53049aa9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:57.490990 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f0e5d-722a-4e84-b371-e02b32a96a99 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:57.527056 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 161/310] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:44:57.527910 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d91fa-8094-4d10-9670-ffd53049aa9b None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:57.531447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57304933-adbb-43b2-af05-235a011c8c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:57.532134 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57304933-adbb-43b2-af05-235a011c8c2d None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:57.533267 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57304933-adbb-43b2-af05-235a011c8c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:57.534111 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57304933-adbb-43b2-af05-235a011c8c2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:57.535006 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57304933-adbb-43b2-af05-235a011c8c2d None admin] RBAC: Adding query filter params (role.id=c2a1a291255141b3b6eee6132725bfff, user.id=e5ba766e7bab403fb54261621ece8de3, scope.system=all) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:57.535325 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57304933-adbb-43b2-af05-235a011c8c2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:57.536980 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57304933-adbb-43b2-af05-235a011c8c2d None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:57.542428 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 150/311] 10.222.0.15 () {56 vars in 1308 bytes} [Fri Jun 3 11:44:57 2022] GET /identity/v3/role_assignments?user.id=e5ba766e7bab403fb54261621ece8de3&scope.system=all&role.id=c2a1a291255141b3b6eee6132725bfff => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:44:57.552926 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57304933-adbb-43b2-af05-235a011c8c2d None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:57.645673 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:57.677112 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:57.680071 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57304933-adbb-43b2-af05-235a011c8c2d None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:57.682366 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d91fa-8094-4d10-9670-ffd53049aa9b None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:57.722154 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43baa764-f03f-4a9f-a6f7-1a6f46dee28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:57.723116 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43baa764-f03f-4a9f-a6f7-1a6f46dee28c None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:57.723467 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43baa764-f03f-4a9f-a6f7-1a6f46dee28c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:57.723844 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43baa764-f03f-4a9f-a6f7-1a6f46dee28c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:57.731098 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a1fd4-d646-4c0b-bca8-1fbb280722b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:57.732594 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a1fd4-d646-4c0b-bca8-1fbb280722b9 None admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:57.733405 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a1fd4-d646-4c0b-bca8-1fbb280722b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:57.733885 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a1fd4-d646-4c0b-bca8-1fbb280722b9 None admin] PATH_INFO: `/v3/system/users/0db8f62b3b07488982e3f6e486e78240/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:57.735886 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a1fd4-d646-4c0b-bca8-1fbb280722b9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0db8f62b3b07488982e3f6e486e78240, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:57.736368 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43baa764-f03f-4a9f-a6f7-1a6f46dee28c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:44:57.738207 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a1fd4-d646-4c0b-bca8-1fbb280722b9 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:57.745819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-43baa764-f03f-4a9f-a6f7-1a6f46dee28c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 11:44:57.745819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:44:57.745819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:44:57.745819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:44:57.745819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:44:57.745819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:44:57.745819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:44:57.745819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:44:57.745819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:44:57.745819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:44:57.745819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:44:57.745819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:44:57.745819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:44:57.745819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:44:57.745819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:44:57.745819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:44:57.746817 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:44:57.746817 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:44:57.746817 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:44:57.746817 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:44:57.746817 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:44:57.746817 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:44:57.746817 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:44:57.746817 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:44:57.746817 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:44:57.746817 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:44:57.746817 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:44:57.746817 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:44:57.746817 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:44:57.746817 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:44:57.746817 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:44:57.746817 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:44:57.747864 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:44:57.747864 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:44:57.747864 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:44:57.747864 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:44:57.747864 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:44:57.747864 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:44:57.747864 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:44:57.747864 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:44:57.747864 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:44:57.747864 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:44:57.747864 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 11:44:57.747864 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:44:57.747864 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 151/312] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:44:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:44:57.753986 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43baa764-f03f-4a9f-a6f7-1a6f46dee28c None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:57.759905 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 162/313] 10.222.0.15 () {58 vars in 1334 bytes} [Fri Jun 3 11:44:57 2022] PUT /identity/v3/system/users/0db8f62b3b07488982e3f6e486e78240/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:44:57.874225 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43baa764-f03f-4a9f-a6f7-1a6f46dee28c None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:57.912312 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8578daf-44c1-45af-8ced-6bda2c15a01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:57.912994 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8578daf-44c1-45af-8ced-6bda2c15a01c None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:57.913273 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8578daf-44c1-45af-8ced-6bda2c15a01c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:57.913551 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8578daf-44c1-45af-8ced-6bda2c15a01c None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:57.914303 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8578daf-44c1-45af-8ced-6bda2c15a01c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:57.914610 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8578daf-44c1-45af-8ced-6bda2c15a01c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:57.916071 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8578daf-44c1-45af-8ced-6bda2c15a01c None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:57.923895 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:57.931012 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 152/314] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 3 11:44:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:57.932513 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a1fd4-d646-4c0b-bca8-1fbb280722b9 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:58.038321 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a1fd4-d646-4c0b-bca8-1fbb280722b9 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:58.073587 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b94e67-6b6c-40bd-8cfb-8ecf049b72e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:58.074473 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b94e67-6b6c-40bd-8cfb-8ecf049b72e5 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:58.074754 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b94e67-6b6c-40bd-8cfb-8ecf049b72e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:58.075033 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b94e67-6b6c-40bd-8cfb-8ecf049b72e5 None admin] PATH_INFO: `/v3/users/1deed3c54dc84dfd8351ea38de2fa499` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:58.076256 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b94e67-6b6c-40bd-8cfb-8ecf049b72e5 None admin] RBAC: Authorizing `identity:get_user(user_id=1deed3c54dc84dfd8351ea38de2fa499)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:58.077764 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b94e67-6b6c-40bd-8cfb-8ecf049b72e5 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:58.079620 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 163/315] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:44:57 2022] GET /identity/v3/users/1deed3c54dc84dfd8351ea38de2fa499 => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:44:58.085068 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8578daf-44c1-45af-8ced-6bda2c15a01c None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:58.189396 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8578daf-44c1-45af-8ced-6bda2c15a01c None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:58.224241 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97658e-2962-4677-9f09-8674c6345a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:58.224886 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97658e-2962-4677-9f09-8674c6345a90 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:58.225165 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97658e-2962-4677-9f09-8674c6345a90 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:58.225486 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97658e-2962-4677-9f09-8674c6345a90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:58.288346 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:58.295013 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd97658e-2962-4677-9f09-8674c6345a90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:58.296562 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd97658e-2962-4677-9f09-8674c6345a90 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:58.399021 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 153/316] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:44:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 11:44:58.404774 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b94e67-6b6c-40bd-8cfb-8ecf049b72e5 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:58.436833 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:58.515263 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b94e67-6b6c-40bd-8cfb-8ecf049b72e5 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:58.550942 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b6d93-3f25-4307-b45c-8532ff370b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:58.551834 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b6d93-3f25-4307-b45c-8532ff370b67 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:58.552117 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b6d93-3f25-4307-b45c-8532ff370b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:58.552393 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b6d93-3f25-4307-b45c-8532ff370b67 None admin] PATH_INFO: `/v3/projects/deb1496445dd47a6ba9ad9fb02737115` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:58.553573 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b6d93-3f25-4307-b45c-8532ff370b67 None admin] RBAC: Authorizing `identity:get_project(project_id=deb1496445dd47a6ba9ad9fb02737115)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:58.555014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b6d93-3f25-4307-b45c-8532ff370b67 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:58.557082 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 164/317] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:44:58 2022] GET /identity/v3/projects/deb1496445dd47a6ba9ad9fb02737115 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:58.562589 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97658e-2962-4677-9f09-8674c6345a90 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:58.661086 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:58.667059 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97658e-2962-4677-9f09-8674c6345a90 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:58.702083 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b136cc-6072-4286-8a9a-9bf64bac385b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:58.702740 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b136cc-6072-4286-8a9a-9bf64bac385b None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:58.703018 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b136cc-6072-4286-8a9a-9bf64bac385b None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:58.703292 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b136cc-6072-4286-8a9a-9bf64bac385b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:58.704142 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b136cc-6072-4286-8a9a-9bf64bac385b None admin] RBAC: Adding query filter params (role.id=c2a1a291255141b3b6eee6132725bfff, scope.project.id=deb1496445dd47a6ba9ad9fb02737115, user.id=1deed3c54dc84dfd8351ea38de2fa499) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:44:58.704453 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b136cc-6072-4286-8a9a-9bf64bac385b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:58.706415 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b136cc-6072-4286-8a9a-9bf64bac385b None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:58.719688 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 154/318] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:44:58 2022] GET /identity/v3/role_assignments?user.id=1deed3c54dc84dfd8351ea38de2fa499&scope.project.id=deb1496445dd47a6ba9ad9fb02737115&role.id=c2a1a291255141b3b6eee6132725bfff => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:59.581447 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261394ee-4dc5-4f36-9dba-f64abbba65c8 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:59.581991 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261394ee-4dc5-4f36-9dba-f64abbba65c8 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:59.581991 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261394ee-4dc5-4f36-9dba-f64abbba65c8 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:59.583559 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 165/319] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 11:44:59.588485 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d69f16-678e-44dd-9f40-1ea393c5f3a3 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:59.588859 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d69f16-678e-44dd-9f40-1ea393c5f3a3 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:59.589104 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d69f16-678e-44dd-9f40-1ea393c5f3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:59.606442 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-54d69f16-678e-44dd-9f40-1ea393c5f3a3 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:59.607654 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-54d69f16-678e-44dd-9f40-1ea393c5f3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:59.677895 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 155/320] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:44:59.700027 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261394ee-4dc5-4f36-9dba-f64abbba65c8 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:59.802698 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:44:59.807320 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261394ee-4dc5-4f36-9dba-f64abbba65c8 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:59.844497 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb82db9-59fc-430a-bc46-c22d3844a357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:59.845213 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb82db9-59fc-430a-bc46-c22d3844a357 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:59.845500 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb82db9-59fc-430a-bc46-c22d3844a357 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:59.845778 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb82db9-59fc-430a-bc46-c22d3844a357 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:59.847472 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb82db9-59fc-430a-bc46-c22d3844a357 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:44:59.848939 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb82db9-59fc-430a-bc46-c22d3844a357 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:44:59.850746 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 166/321] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:44:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:44:59.855141 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014f1a9-bbef-4fd0-8ed2-21f5e17aae2d None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:59.855435 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014f1a9-bbef-4fd0-8ed2-21f5e17aae2d None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:59.855747 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014f1a9-bbef-4fd0-8ed2-21f5e17aae2d None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:59.855836 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb82db9-59fc-430a-bc46-c22d3844a357 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:59.857237 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 156/322] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:44:59.862441 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c932a-e32d-4328-911e-6b1d8fab09c5 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:59.862728 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c932a-e32d-4328-911e-6b1d8fab09c5 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:59.863005 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c932a-e32d-4328-911e-6b1d8fab09c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:44:59.879883 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-a72c932a-e32d-4328-911e-6b1d8fab09c5 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:44:59.881056 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-a72c932a-e32d-4328-911e-6b1d8fab09c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:44:59.957297 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 157/323] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:44:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 11:44:59.962431 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb82db9-59fc-430a-bc46-c22d3844a357 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:44:59.978983 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c932a-e32d-4328-911e-6b1d8fab09c5 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:44:59.998157 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9c6e5-1f6b-47c5-b72c-ab35959aa9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:44:59.998825 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9c6e5-1f6b-47c5-b72c-ab35959aa9e3 None admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:44:59.999113 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9c6e5-1f6b-47c5-b72c-ab35959aa9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:44:59.999393 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9c6e5-1f6b-47c5-b72c-ab35959aa9e3 None admin] PATH_INFO: `/v3/groups` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:00.000114 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9c6e5-1f6b-47c5-b72c-ab35959aa9e3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:00.000777 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:00.001571 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9c6e5-1f6b-47c5-b72c-ab35959aa9e3 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:00.016940 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 167/324] 10.222.0.15 () {60 vars in 1134 bytes} [Fri Jun 3 11:44:59 2022] POST /identity/v3/groups => generated 226 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 11:45:00.091717 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c932a-e32d-4328-911e-6b1d8fab09c5 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:00.129363 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7cb8c2-30da-4859-85db-9eeb09fdc7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:00.130083 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cb8c2-30da-4859-85db-9eeb09fdc7b5 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:00.130367 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cb8c2-30da-4859-85db-9eeb09fdc7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:00.130641 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cb8c2-30da-4859-85db-9eeb09fdc7b5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:00.143048 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d304205-090c-4c5d-9301-98ea0b96acee None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:00.143343 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d304205-090c-4c5d-9301-98ea0b96acee None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:00.143650 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d304205-090c-4c5d-9301-98ea0b96acee None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:00.144498 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7cb8c2-30da-4859-85db-9eeb09fdc7b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:45:00.145197 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 168/325] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 11:45:00.150844 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba341210-c612-44f0-9752-b6ce5a5aca02 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:00.151128 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba341210-c612-44f0-9752-b6ce5a5aca02 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:00.151413 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba341210-c612-44f0-9752-b6ce5a5aca02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:00.153010 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-be7cb8c2-30da-4859-85db-9eeb09fdc7b5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 11:45:00.153010 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:00.153010 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:00.153010 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:00.153010 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:00.153010 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:00.153010 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:00.153010 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:00.153010 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:00.153010 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:00.153010 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:00.153010 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:00.153010 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:45:00.153010 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:45:00.153010 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:45:00.153010 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:45:00.153873 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:45:00.153873 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:45:00.153873 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:45:00.153873 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:45:00.153873 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:00.153873 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:00.153873 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:00.153873 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:00.153873 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:00.153873 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:00.153873 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:00.153873 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:00.153873 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:00.153873 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:00.153873 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:00.153873 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:00.154659 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:00.154659 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:00.154659 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:00.154659 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:00.154659 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:45:00.154659 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:45:00.154659 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:45:00.154659 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:45:00.154659 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:45:00.154659 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:45:00.154659 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 11:45:00.154659 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:00.155256 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 158/326] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:44:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:45:00.160198 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7cb8c2-30da-4859-85db-9eeb09fdc7b5 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:00.169588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-ba341210-c612-44f0-9752-b6ce5a5aca02 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:00.170933 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-ba341210-c612-44f0-9752-b6ce5a5aca02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:00.197997 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:00.248673 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 169/327] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 11:45:00.256563 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:00.273132 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba341210-c612-44f0-9752-b6ce5a5aca02 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:00.277994 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7cb8c2-30da-4859-85db-9eeb09fdc7b5 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:00.321155 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b88428-2f59-4764-aaa8-9cd856d3f809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:00.322233 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b88428-2f59-4764-aaa8-9cd856d3f809 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:00.322690 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b88428-2f59-4764-aaa8-9cd856d3f809 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:00.323159 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b88428-2f59-4764-aaa8-9cd856d3f809 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:00.324110 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b88428-2f59-4764-aaa8-9cd856d3f809 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:00.324580 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b88428-2f59-4764-aaa8-9cd856d3f809 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:00.326206 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b88428-2f59-4764-aaa8-9cd856d3f809 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:00.335368 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 159/328] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 3 11:45:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:45:00.341111 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b88428-2f59-4764-aaa8-9cd856d3f809 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:00.403833 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba341210-c612-44f0-9752-b6ce5a5aca02 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:00.449999 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a74f3-2cb6-42c3-8ebb-89f4c8a5dc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:00.450803 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a74f3-2cb6-42c3-8ebb-89f4c8a5dc74 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:00.451092 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a74f3-2cb6-42c3-8ebb-89f4c8a5dc74 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:00.451397 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a74f3-2cb6-42c3-8ebb-89f4c8a5dc74 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:00.472196 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a74f3-2cb6-42c3-8ebb-89f4c8a5dc74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:45:00.479663 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b88428-2f59-4764-aaa8-9cd856d3f809 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:00.480777 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-791a74f3-2cb6-42c3-8ebb-89f4c8a5dc74 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 11:45:00.480777 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:00.480777 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:00.480777 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:00.480777 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:00.480777 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:00.480777 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:00.480777 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:00.480777 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:00.480777 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:00.480777 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:00.480777 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:00.480777 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:45:00.480777 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:45:00.480777 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:45:00.480777 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:45:00.481766 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:45:00.481766 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:45:00.481766 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:45:00.481766 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:45:00.481766 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:00.481766 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:00.481766 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:00.481766 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:00.481766 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:00.481766 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:00.481766 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:00.481766 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:00.481766 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:00.481766 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:00.481766 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:00.481766 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:00.482741 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:00.482741 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:00.482741 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:00.482741 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:00.482741 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:45:00.482741 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:45:00.482741 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:45:00.482741 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:45:00.482741 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:45:00.482741 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:45:00.482741 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 11:45:00.482741 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:00.485114 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 170/329] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:45:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:45:00.491764 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a74f3-2cb6-42c3-8ebb-89f4c8a5dc74 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:00.515575 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:00.528684 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c246d16-431d-416d-a8a6-26046e1d23bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:00.529772 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c246d16-431d-416d-a8a6-26046e1d23bb None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:00.529908 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c246d16-431d-416d-a8a6-26046e1d23bb None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:00.530145 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c246d16-431d-416d-a8a6-26046e1d23bb None admin] PATH_INFO: `/v3/users/e5ba766e7bab403fb54261621ece8de3` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:00.531304 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c246d16-431d-416d-a8a6-26046e1d23bb None admin] RBAC: Authorizing `identity:get_user(user_id=e5ba766e7bab403fb54261621ece8de3)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:00.532792 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c246d16-431d-416d-a8a6-26046e1d23bb None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:00.534470 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 160/330] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:45:00 2022] GET /identity/v3/users/e5ba766e7bab403fb54261621ece8de3 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:45:00.544857 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c246d16-431d-416d-a8a6-26046e1d23bb None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:00.568538 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:00.609735 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a74f3-2cb6-42c3-8ebb-89f4c8a5dc74 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:00.644965 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a3fd27-4d99-491a-979c-eeec57855053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:00.645650 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3fd27-4d99-491a-979c-eeec57855053 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:00.645918 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3fd27-4d99-491a-979c-eeec57855053 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:00.646197 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3fd27-4d99-491a-979c-eeec57855053 None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:00.646946 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a3fd27-4d99-491a-979c-eeec57855053 None admin] RBAC: Adding query filter params (name=member) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:00.647250 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a3fd27-4d99-491a-979c-eeec57855053 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:00.650072 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a3fd27-4d99-491a-979c-eeec57855053 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:00.663605 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 171/331] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 3 11:45:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:00.666082 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a3fd27-4d99-491a-979c-eeec57855053 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:00.690540 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c246d16-431d-416d-a8a6-26046e1d23bb None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:00.731753 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e10580-152f-4965-af43-d1dd107c0062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:00.732618 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e10580-152f-4965-af43-d1dd107c0062 None admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:00.732908 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e10580-152f-4965-af43-d1dd107c0062 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:00.733366 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e10580-152f-4965-af43-d1dd107c0062 None admin] PATH_INFO: `/v3/system/users/e5ba766e7bab403fb54261621ece8de3/roles/c2a1a291255141b3b6eee6132725bfff` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:00.736607 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e10580-152f-4965-af43-d1dd107c0062 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e5ba766e7bab403fb54261621ece8de3, role_id=c2a1a291255141b3b6eee6132725bfff)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:00.738609 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e10580-152f-4965-af43-d1dd107c0062 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:00.752155 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 161/332] 10.222.0.15 () {58 vars in 1334 bytes} [Fri Jun 3 11:45:00 2022] PUT /identity/v3/system/users/e5ba766e7bab403fb54261621ece8de3/roles/c2a1a291255141b3b6eee6132725bfff => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:45:00.796108 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:00.819200 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a3fd27-4d99-491a-979c-eeec57855053 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:00.857147 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e37aca-68c4-46f1-8bf1-813f991e9944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:00.858049 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e37aca-68c4-46f1-8bf1-813f991e9944 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:00.858329 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e37aca-68c4-46f1-8bf1-813f991e9944 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:00.858601 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e37aca-68c4-46f1-8bf1-813f991e9944 None admin] PATH_INFO: `/v3/users/0db8f62b3b07488982e3f6e486e78240` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:00.859855 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e37aca-68c4-46f1-8bf1-813f991e9944 None admin] RBAC: Authorizing `identity:get_user(user_id=0db8f62b3b07488982e3f6e486e78240)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:00.861377 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e37aca-68c4-46f1-8bf1-813f991e9944 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:00.863723 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 172/333] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:45:00 2022] GET /identity/v3/users/0db8f62b3b07488982e3f6e486e78240 => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:00.869958 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e10580-152f-4965-af43-d1dd107c0062 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:00.955458 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:00.983685 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e10580-152f-4965-af43-d1dd107c0062 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:01.021505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6833aed1-975e-4647-82de-ce6a1bfe91ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:01.022162 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833aed1-975e-4647-82de-ce6a1bfe91ae None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:01.022501 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833aed1-975e-4647-82de-ce6a1bfe91ae None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:01.022777 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833aed1-975e-4647-82de-ce6a1bfe91ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:01.023637 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6833aed1-975e-4647-82de-ce6a1bfe91ae None admin] RBAC: Adding query filter params (role.id=781e2d573ee94afaae05b3cc0bba8768, user.id=0db8f62b3b07488982e3f6e486e78240, scope.system=all) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:01.023952 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6833aed1-975e-4647-82de-ce6a1bfe91ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:01.025658 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6833aed1-975e-4647-82de-ce6a1bfe91ae None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:01.038293 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 162/334] 10.222.0.15 () {56 vars in 1308 bytes} [Fri Jun 3 11:45:00 2022] GET /identity/v3/role_assignments?user.id=0db8f62b3b07488982e3f6e486e78240&scope.system=all&role.id=781e2d573ee94afaae05b3cc0bba8768 => generated 510 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:02.999011 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0274d9-da62-425a-b57c-7e9f28552546 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:02.999535 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0274d9-da62-425a-b57c-7e9f28552546 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:02.999615 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0274d9-da62-425a-b57c-7e9f28552546 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:03.001244 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 173/335] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:45:03.006500 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf4fc1-b89c-4a6e-9c28-ae5d0ba99e95 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:03.006893 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf4fc1-b89c-4a6e-9c28-ae5d0ba99e95 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:03.007055 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf4fc1-b89c-4a6e-9c28-ae5d0ba99e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:03.026425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-20cf4fc1-b89c-4a6e-9c28-ae5d0ba99e95 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:03.027631 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-20cf4fc1-b89c-4a6e-9c28-ae5d0ba99e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:03.119260 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 163/336] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:45:03.156085 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0274d9-da62-425a-b57c-7e9f28552546 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:03.293112 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0274d9-da62-425a-b57c-7e9f28552546 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:03.313509 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2b66a-3441-45d5-a359-2e7b3d99e1cd None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:03.314156 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2b66a-3441-45d5-a359-2e7b3d99e1cd None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:03.314663 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2b66a-3441-45d5-a359-2e7b3d99e1cd None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:03.316537 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 164/337] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:45:03.322055 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a6a35-c21a-4adc-a651-142bdbb11328 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:03.322584 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a6a35-c21a-4adc-a651-142bdbb11328 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:03.323063 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a6a35-c21a-4adc-a651-142bdbb11328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:03.357798 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c30b7-9614-43a4-b640-46df43b0726f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:03.359017 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c30b7-9614-43a4-b640-46df43b0726f None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:03.359526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c30b7-9614-43a4-b640-46df43b0726f None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:03.360044 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c30b7-9614-43a4-b640-46df43b0726f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:03.361564 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-e33a6a35-c21a-4adc-a651-142bdbb11328 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:03.363342 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-e33a6a35-c21a-4adc-a651-142bdbb11328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:03.389690 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c30b7-9614-43a4-b640-46df43b0726f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:45:03.398701 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-923c30b7-9614-43a4-b640-46df43b0726f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 11:45:03.398701 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:03.398701 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:03.398701 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:03.398701 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:03.398701 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:03.398701 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:03.398701 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:03.398701 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:03.398701 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:03.398701 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:03.398701 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:03.398701 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:45:03.398701 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:45:03.398701 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:45:03.398701 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:45:03.403997 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:45:03.403997 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:45:03.403997 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:45:03.403997 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:45:03.403997 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:03.403997 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:03.403997 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:03.403997 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:03.403997 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:03.403997 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:03.403997 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:03.403997 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:03.403997 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:03.403997 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:03.403997 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:03.403997 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:03.404794 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:03.404794 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:03.404794 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:03.404794 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:03.404794 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:45:03.404794 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:45:03.404794 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:45:03.404794 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:45:03.404794 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:45:03.404794 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:45:03.404794 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 11:45:03.404794 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:03.409762 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 174/338] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:45:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:03.416226 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c30b7-9614-43a4-b640-46df43b0726f None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:03.434758 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:03.516985 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:03.569064 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 165/339] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 11:45:03.585677 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c30b7-9614-43a4-b640-46df43b0726f None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:03.630403 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a6a35-c21a-4adc-a651-142bdbb11328 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:03.645076 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7073e-dfc4-489c-8a6c-0ac9e345605d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:03.646081 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7073e-dfc4-489c-8a6c-0ac9e345605d None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:03.646571 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7073e-dfc4-489c-8a6c-0ac9e345605d None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:03.647050 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7073e-dfc4-489c-8a6c-0ac9e345605d None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:03.648603 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7073e-dfc4-489c-8a6c-0ac9e345605d None admin] RBAC: Adding query filter params (name=member) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:03.649147 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7073e-dfc4-489c-8a6c-0ac9e345605d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:03.650992 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7073e-dfc4-489c-8a6c-0ac9e345605d None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:03.661659 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 175/340] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 3 11:45:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:03.667039 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7073e-dfc4-489c-8a6c-0ac9e345605d None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:03.768669 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:03.837933 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7073e-dfc4-489c-8a6c-0ac9e345605d None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:03.866956 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a6a35-c21a-4adc-a651-142bdbb11328 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:03.918574 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df76127-8601-445a-bcfa-0be01ab250a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:03.919151 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df76127-8601-445a-bcfa-0be01ab250a4 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:03.919433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df76127-8601-445a-bcfa-0be01ab250a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:03.919761 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df76127-8601-445a-bcfa-0be01ab250a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:03.946070 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a376ac-53d9-4cbe-bc2c-b6c38f4e15c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:03.946886 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a376ac-53d9-4cbe-bc2c-b6c38f4e15c2 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:03.947166 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a376ac-53d9-4cbe-bc2c-b6c38f4e15c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:03.947437 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a376ac-53d9-4cbe-bc2c-b6c38f4e15c2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:03.968712 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a376ac-53d9-4cbe-bc2c-b6c38f4e15c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:45:03.976939 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-63a376ac-53d9-4cbe-bc2c-b6c38f4e15c2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 11:45:03.976939 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:03.976939 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:03.976939 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:03.976939 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:03.976939 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:03.976939 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:03.976939 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:03.976939 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:03.976939 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:03.976939 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:03.976939 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:03.976939 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:45:03.976939 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:45:03.976939 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:45:03.976939 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:45:03.977937 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:45:03.977937 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:45:03.977937 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:45:03.977937 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:45:03.977937 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:03.977937 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:03.977937 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:03.977937 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:03.977937 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:03.977937 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:03.977937 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:03.977937 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:03.977937 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:03.977937 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:03.977937 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:03.977937 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:03.978753 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:03.978753 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:03.978753 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:03.978753 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:03.978753 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:45:03.978753 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:45:03.978753 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:45:03.978753 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:45:03.978753 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:45:03.978753 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:45:03.978753 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 11:45:03.978753 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:03.981002 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 166/341] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Jun 3 11:45:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:03.989467 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86562f-83df-4388-9ca2-cfbc276c23b4 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:03.989791 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86562f-83df-4388-9ca2-cfbc276c23b4 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:03.990013 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86562f-83df-4388-9ca2-cfbc276c23b4 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:03.991650 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 167/342] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:03 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:45:03.993357 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86562f-83df-4388-9ca2-cfbc276c23b4 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:04.060634 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df76127-8601-445a-bcfa-0be01ab250a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:04.062125 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df76127-8601-445a-bcfa-0be01ab250a4 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:04.081916 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:04.135826 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86562f-83df-4388-9ca2-cfbc276c23b4 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:04.177617 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ff0c6-f69d-42b1-8e99-9b8d65cb1791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:04.178213 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ff0c6-f69d-42b1-8e99-9b8d65cb1791 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:04.178498 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ff0c6-f69d-42b1-8e99-9b8d65cb1791 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:04.178781 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ff0c6-f69d-42b1-8e99-9b8d65cb1791 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:04.179612 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ff0c6-f69d-42b1-8e99-9b8d65cb1791 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:04.180069 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ff0c6-f69d-42b1-8e99-9b8d65cb1791 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:04.182236 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ff0c6-f69d-42b1-8e99-9b8d65cb1791 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:04.192151 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 168/343] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:45:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:04.196101 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5d963-8cb9-450e-bae5-6465f8f055ad None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:04.196393 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5d963-8cb9-450e-bae5-6465f8f055ad None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:04.196673 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5d963-8cb9-450e-bae5-6465f8f055ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:04.219062 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-5ac5d963-8cb9-450e-bae5-6465f8f055ad None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:04.220423 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-5ac5d963-8cb9-450e-bae5-6465f8f055ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:04.252142 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:04.298613 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 176/344] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:45:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 03 11:45:04.304037 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df76127-8601-445a-bcfa-0be01ab250a4 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:04.316287 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 169/345] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:45:04.317567 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea3651-2a6d-424e-996f-9d521bbfb088 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:04.317926 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea3651-2a6d-424e-996f-9d521bbfb088 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:04.318274 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea3651-2a6d-424e-996f-9d521bbfb088 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:04.320473 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 170/346] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:45:04.321615 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea3651-2a6d-424e-996f-9d521bbfb088 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:04.389545 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:04.437312 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df76127-8601-445a-bcfa-0be01ab250a4 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:04.461732 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea3651-2a6d-424e-996f-9d521bbfb088 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:04.481438 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87fb1c-265c-4c26-b47d-2263391fc590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:04.482556 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87fb1c-265c-4c26-b47d-2263391fc590 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:04.483061 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87fb1c-265c-4c26-b47d-2263391fc590 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:04.483596 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87fb1c-265c-4c26-b47d-2263391fc590 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:04.505190 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c8488-54d2-4d7f-84d1-314de850d9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:04.506239 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c8488-54d2-4d7f-84d1-314de850d9aa None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:04.506523 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c8488-54d2-4d7f-84d1-314de850d9aa None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:04.506797 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c8488-54d2-4d7f-84d1-314de850d9aa None admin] PATH_INFO: `/v3/projects/437ab37ab6104629b1199c45fdd0b804` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:04.508045 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99c8488-54d2-4d7f-84d1-314de850d9aa None admin] RBAC: Authorizing `identity:get_project(project_id=437ab37ab6104629b1199c45fdd0b804)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:04.509602 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99c8488-54d2-4d7f-84d1-314de850d9aa None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:04.513012 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 171/347] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:45:04 2022] GET /identity/v3/projects/437ab37ab6104629b1199c45fdd0b804 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:04.514230 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c9080-e4a9-4f8b-ae6d-bfe6a9a9cb22 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:04.514520 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c9080-e4a9-4f8b-ae6d-bfe6a9a9cb22 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:04.514797 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c9080-e4a9-4f8b-ae6d-bfe6a9a9cb22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:04.532484 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:04.535720 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-817c9080-e4a9-4f8b-ae6d-bfe6a9a9cb22 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:04.537076 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-817c9080-e4a9-4f8b-ae6d-bfe6a9a9cb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:04.573693 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df87fb1c-265c-4c26-b47d-2263391fc590 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:04.575593 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df87fb1c-265c-4c26-b47d-2263391fc590 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:04.622873 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 172/348] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:45:04.623922 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c9080-e4a9-4f8b-ae6d-bfe6a9a9cb22 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:04.679630 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:04.699490 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 177/349] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:45:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 11:45:04.700874 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79588c2-0803-43df-8fcf-02e89d5bbf27 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:04.701165 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79588c2-0803-43df-8fcf-02e89d5bbf27 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:04.701435 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79588c2-0803-43df-8fcf-02e89d5bbf27 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:04.702685 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 178/350] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:45:04.707000 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79588c2-0803-43df-8fcf-02e89d5bbf27 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:04.761278 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c9080-e4a9-4f8b-ae6d-bfe6a9a9cb22 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:04.798948 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:04.808874 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7d47d-61ce-4eb7-986b-edc0a1e914c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:04.809880 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7d47d-61ce-4eb7-986b-edc0a1e914c0 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:04.810003 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7d47d-61ce-4eb7-986b-edc0a1e914c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:04.810233 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7d47d-61ce-4eb7-986b-edc0a1e914c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:04.825319 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f7d47d-61ce-4eb7-986b-edc0a1e914c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:45:04.833639 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-d6f7d47d-61ce-4eb7-986b-edc0a1e914c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 11:45:04.833639 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:04.833639 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:04.833639 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:04.833639 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:04.833639 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:04.833639 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:04.833639 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:04.833639 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:04.833639 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:04.833639 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:04.833639 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:04.833639 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:45:04.833639 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:45:04.833639 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:45:04.833639 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:45:04.834606 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:45:04.834606 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:45:04.834606 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:45:04.834606 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:45:04.834606 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:04.834606 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:04.834606 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:04.834606 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:04.834606 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:04.834606 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:04.834606 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:04.834606 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:04.834606 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:04.834606 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:04.834606 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:04.834606 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:04.835455 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:04.835455 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:04.835455 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:04.835455 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:04.835455 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:45:04.835455 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:45:04.835455 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:45:04.835455 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:45:04.835455 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:45:04.835455 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:45:04.835455 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 11:45:04.835455 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:04.835455 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 173/351] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:45:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:04.836198 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7d47d-61ce-4eb7-986b-edc0a1e914c0 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:04.848536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79588c2-0803-43df-8fcf-02e89d5bbf27 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:04.898464 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48823494-0d19-4aaf-bf99-c44ae3714984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:04.903037 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48823494-0d19-4aaf-bf99-c44ae3714984 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:04.903037 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48823494-0d19-4aaf-bf99-c44ae3714984 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:04.903240 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48823494-0d19-4aaf-bf99-c44ae3714984 None admin] PATH_INFO: `/v3/groups/b4219b09bb644bd88819e4cb2f7e6f93` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:04.913236 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48823494-0d19-4aaf-bf99-c44ae3714984 None admin] RBAC: Authorizing `identity:get_group(group_id=b4219b09bb644bd88819e4cb2f7e6f93)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:04.914834 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48823494-0d19-4aaf-bf99-c44ae3714984 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:04.919563 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 179/352] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Jun 3 11:45:04 2022] GET /identity/v3/groups/b4219b09bb644bd88819e4cb2f7e6f93 => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:04.919563 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48823494-0d19-4aaf-bf99-c44ae3714984 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:04.981894 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7d47d-61ce-4eb7-986b-edc0a1e914c0 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:04.984887 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:05.035368 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3587a3b7-98e8-4107-8e60-d362c5a51cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:05.036575 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587a3b7-98e8-4107-8e60-d362c5a51cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:05.037085 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587a3b7-98e8-4107-8e60-d362c5a51cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:05.037575 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587a3b7-98e8-4107-8e60-d362c5a51cd4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:05.046775 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48823494-0d19-4aaf-bf99-c44ae3714984 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:05.050682 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3587a3b7-98e8-4107-8e60-d362c5a51cd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:45:05.065975 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-3587a3b7-98e8-4107-8e60-d362c5a51cd4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 11:45:05.065975 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:05.065975 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:05.065975 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:05.065975 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:05.065975 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:05.065975 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:05.065975 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:05.065975 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:05.065975 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:05.065975 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:05.065975 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:05.065975 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:45:05.065975 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:45:05.065975 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:45:05.065975 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:45:05.066938 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:45:05.066938 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:45:05.066938 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:45:05.066938 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:45:05.066938 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:05.066938 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:05.066938 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:05.066938 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:05.066938 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:05.066938 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:05.066938 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:05.066938 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:05.066938 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:05.066938 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:05.066938 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:05.066938 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:05.067755 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:05.067755 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:05.067755 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:05.067755 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:05.067755 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:45:05.067755 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:45:05.067755 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:45:05.067755 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:45:05.067755 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:45:05.067755 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:45:05.067755 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 03 11:45:05.067755 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:05.067755 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 174/353] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:45:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:05.068912 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71224a52-bab8-4df8-8a55-26300da42a93 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:05.068912 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71224a52-bab8-4df8-8a55-26300da42a93 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:05.069070 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71224a52-bab8-4df8-8a55-26300da42a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:05.089906 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d3650-5e3b-4fe2-a34b-acd5ec641c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:05.091458 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d3650-5e3b-4fe2-a34b-acd5ec641c5e None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:05.092023 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d3650-5e3b-4fe2-a34b-acd5ec641c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:05.092524 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d3650-5e3b-4fe2-a34b-acd5ec641c5e None admin] PATH_INFO: `/v3/projects/437ab37ab6104629b1199c45fdd0b804` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:05.092664 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-71224a52-bab8-4df8-8a55-26300da42a93 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:05.093730 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d3650-5e3b-4fe2-a34b-acd5ec641c5e None admin] RBAC: Authorizing `identity:get_project(project_id=437ab37ab6104629b1199c45fdd0b804)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:05.093854 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-71224a52-bab8-4df8-8a55-26300da42a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:05.095193 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d3650-5e3b-4fe2-a34b-acd5ec641c5e None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:05.097983 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 180/354] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:45:04 2022] GET /identity/v3/projects/437ab37ab6104629b1199c45fdd0b804 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:05.098570 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d3650-5e3b-4fe2-a34b-acd5ec641c5e None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:05.103558 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:05.186445 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 175/355] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:45:05.187308 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71224a52-bab8-4df8-8a55-26300da42a93 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:05.231021 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d3650-5e3b-4fe2-a34b-acd5ec641c5e None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:05.272662 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9734494-7153-4faa-b3db-8e9a6880eb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:05.273733 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9734494-7153-4faa-b3db-8e9a6880eb9d None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:05.274160 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9734494-7153-4faa-b3db-8e9a6880eb9d None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:05.274600 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9734494-7153-4faa-b3db-8e9a6880eb9d None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:05.275659 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9734494-7153-4faa-b3db-8e9a6880eb9d None admin] RBAC: Adding query filter params (name=member) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:05.276025 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9734494-7153-4faa-b3db-8e9a6880eb9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:05.277540 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9734494-7153-4faa-b3db-8e9a6880eb9d None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:05.286341 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 181/356] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 3 11:45:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:05.286505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:05.287160 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9734494-7153-4faa-b3db-8e9a6880eb9d None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:05.298808 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71224a52-bab8-4df8-8a55-26300da42a93 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:05.340762 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178884e-2203-4532-90b5-36a55a897b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:05.341453 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178884e-2203-4532-90b5-36a55a897b3d None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:05.341738 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178884e-2203-4532-90b5-36a55a897b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:05.342013 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178884e-2203-4532-90b5-36a55a897b3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:05.342851 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9178884e-2203-4532-90b5-36a55a897b3d None admin] RBAC: Adding query filter params (group.id=b4219b09bb644bd88819e4cb2f7e6f93, role.id=781e2d573ee94afaae05b3cc0bba8768, scope.project.id=437ab37ab6104629b1199c45fdd0b804) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:05.343165 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9178884e-2203-4532-90b5-36a55a897b3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:05.344709 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9178884e-2203-4532-90b5-36a55a897b3d None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:05.355652 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 176/357] 10.222.0.15 () {56 vars in 1376 bytes} [Fri Jun 3 11:45:05 2022] GET /identity/v3/role_assignments?group.id=b4219b09bb644bd88819e4cb2f7e6f93&scope.project.id=437ab37ab6104629b1199c45fdd0b804&role.id=781e2d573ee94afaae05b3cc0bba8768 => generated 260 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:05.355652 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178884e-2203-4532-90b5-36a55a897b3d None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:05.365307 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:05.420093 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9734494-7153-4faa-b3db-8e9a6880eb9d None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:05.474844 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679e3a7-509e-4c03-b6fd-e75f883e9500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:05.475194 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679e3a7-509e-4c03-b6fd-e75f883e9500 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:05.475387 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679e3a7-509e-4c03-b6fd-e75f883e9500 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:05.475726 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679e3a7-509e-4c03-b6fd-e75f883e9500 None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:05.476494 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1679e3a7-509e-4c03-b6fd-e75f883e9500 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:05.477250 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1679e3a7-509e-4c03-b6fd-e75f883e9500 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:05.478662 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1679e3a7-509e-4c03-b6fd-e75f883e9500 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:05.495763 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 182/358] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 3 11:45:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:05.497117 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b945a51-9e49-495c-a29d-84781be2a392 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:05.497420 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b945a51-9e49-495c-a29d-84781be2a392 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:05.497680 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b945a51-9e49-495c-a29d-84781be2a392 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:05.498950 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 183/359] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:45:05.499667 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b945a51-9e49-495c-a29d-84781be2a392 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:05.501388 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178884e-2203-4532-90b5-36a55a897b3d None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:05.552433 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6048e-e079-4b2a-ae40-812478c8b1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:05.553247 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6048e-e079-4b2a-ae40-812478c8b1bd None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:05.553536 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6048e-e079-4b2a-ae40-812478c8b1bd None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:05.553818 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6048e-e079-4b2a-ae40-812478c8b1bd None admin] PATH_INFO: `/v3/groups/b4219b09bb644bd88819e4cb2f7e6f93` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:05.555441 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6048e-e079-4b2a-ae40-812478c8b1bd None admin] RBAC: Authorizing `identity:get_group(group_id=b4219b09bb644bd88819e4cb2f7e6f93)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:05.558054 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6048e-e079-4b2a-ae40-812478c8b1bd None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:05.560674 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 177/360] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Jun 3 11:45:05 2022] GET /identity/v3/groups/b4219b09bb644bd88819e4cb2f7e6f93 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:05.560674 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6048e-e079-4b2a-ae40-812478c8b1bd None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:05.590123 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:05.640683 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b945a51-9e49-495c-a29d-84781be2a392 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:05.675212 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:05.682971 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1b126-0ae9-41fd-b856-893cc2e98e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:05.683827 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1b126-0ae9-41fd-b856-893cc2e98e1f None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:05.684111 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1b126-0ae9-41fd-b856-893cc2e98e1f None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:05.684386 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1b126-0ae9-41fd-b856-893cc2e98e1f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:05.693416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6048e-e079-4b2a-ae40-812478c8b1bd None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:05.698113 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b1b126-0ae9-41fd-b856-893cc2e98e1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:45:05.706765 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-b0b1b126-0ae9-41fd-b856-893cc2e98e1f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 11:45:05.706765 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:05.706765 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:05.706765 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:05.706765 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:05.706765 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:05.706765 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:05.706765 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:05.706765 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:05.706765 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:05.706765 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:05.706765 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:05.706765 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:45:05.706765 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:45:05.706765 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:45:05.706765 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:45:05.707757 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:45:05.707757 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:45:05.707757 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:45:05.707757 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:45:05.707757 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:05.707757 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:05.707757 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:05.707757 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:05.707757 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:05.707757 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:05.707757 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:05.707757 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:05.707757 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:05.707757 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:05.707757 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:05.707757 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:05.709541 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:05.709541 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:05.709541 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:05.709541 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:05.709541 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:45:05.709541 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:45:05.709541 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:45:05.709541 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:45:05.709541 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:45:05.709541 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:45:05.709541 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 11:45:05.709541 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:05.709541 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 184/361] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Jun 3 11:45:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:05.710249 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1b126-0ae9-41fd-b856-893cc2e98e1f None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:05.739662 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda2676-c29f-4744-96ec-31602087b5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:05.740747 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda2676-c29f-4744-96ec-31602087b5b2 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:05.741245 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda2676-c29f-4744-96ec-31602087b5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:05.741707 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda2676-c29f-4744-96ec-31602087b5b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:05.838759 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda2676-c29f-4744-96ec-31602087b5b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:05.840356 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda2676-c29f-4744-96ec-31602087b5b2 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:05.844771 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1b126-0ae9-41fd-b856-893cc2e98e1f None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:05.870153 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:05.885849 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14981e-f541-4316-afff-9256cd701d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:05.886832 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14981e-f541-4316-afff-9256cd701d33 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:05.887191 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14981e-f541-4316-afff-9256cd701d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:05.888159 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14981e-f541-4316-afff-9256cd701d33 None admin] PATH_INFO: `/v3/users/e5ba766e7bab403fb54261621ece8de3` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:05.889023 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df14981e-f541-4316-afff-9256cd701d33 None admin] RBAC: Authorizing `identity:get_user(user_id=e5ba766e7bab403fb54261621ece8de3)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:05.890563 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df14981e-f541-4316-afff-9256cd701d33 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:05.892486 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 185/362] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:45:05 2022] GET /identity/v3/users/e5ba766e7bab403fb54261621ece8de3 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:05.894203 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f90bf5-5309-46b6-ac3b-a6ad279f442c None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:05.894561 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f90bf5-5309-46b6-ac3b-a6ad279f442c None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:05.894914 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f90bf5-5309-46b6-ac3b-a6ad279f442c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:05.922604 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-31f90bf5-5309-46b6-ac3b-a6ad279f442c None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:05.924819 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-31f90bf5-5309-46b6-ac3b-a6ad279f442c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:05.981030 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 178/363] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:45:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 11:45:05.981030 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda2676-c29f-4744-96ec-31602087b5b2 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:05.991295 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:06.015392 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 186/364] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:45:06.016719 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f90bf5-5309-46b6-ac3b-a6ad279f442c None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:06.117950 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda2676-c29f-4744-96ec-31602087b5b2 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:06.146099 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f90bf5-5309-46b6-ac3b-a6ad279f442c None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:06.147000 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:06.165473 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c394a2-30f9-44b4-92fc-f01a1ee4fc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:06.166223 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c394a2-30f9-44b4-92fc-f01a1ee4fc51 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:06.166574 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c394a2-30f9-44b4-92fc-f01a1ee4fc51 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:06.166912 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c394a2-30f9-44b4-92fc-f01a1ee4fc51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:06.168068 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c394a2-30f9-44b4-92fc-f01a1ee4fc51 None admin] RBAC: Adding query filter params (group.id=b4219b09bb644bd88819e4cb2f7e6f93, role.id=5d1199580aaa485bb120b35e6f771ff9, scope.project.id=437ab37ab6104629b1199c45fdd0b804) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:06.168189 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c394a2-30f9-44b4-92fc-f01a1ee4fc51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:06.170063 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c394a2-30f9-44b4-92fc-f01a1ee4fc51 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:06.178054 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 179/365] 10.222.0.15 () {56 vars in 1376 bytes} [Fri Jun 3 11:45:05 2022] GET /identity/v3/role_assignments?group.id=b4219b09bb644bd88819e4cb2f7e6f93&scope.project.id=437ab37ab6104629b1199c45fdd0b804&role.id=5d1199580aaa485bb120b35e6f771ff9 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:06.178869 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c394a2-30f9-44b4-92fc-f01a1ee4fc51 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:06.218463 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d31aa-5fc3-4556-96e0-ebbe9990f33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:06.219155 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d31aa-5fc3-4556-96e0-ebbe9990f33b None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:06.219431 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d31aa-5fc3-4556-96e0-ebbe9990f33b None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:06.219733 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d31aa-5fc3-4556-96e0-ebbe9990f33b None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:06.220511 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d31aa-5fc3-4556-96e0-ebbe9990f33b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:06.220811 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d31aa-5fc3-4556-96e0-ebbe9990f33b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:06.222817 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d31aa-5fc3-4556-96e0-ebbe9990f33b None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:06.232756 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 187/366] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:45:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:06.233454 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d31aa-5fc3-4556-96e0-ebbe9990f33b None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:06.305685 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:06.329507 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c394a2-30f9-44b4-92fc-f01a1ee4fc51 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:06.372369 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a4640-d185-47f8-999d-b9566ae9f8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:06.373048 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a4640-d185-47f8-999d-b9566ae9f8c5 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:06.373335 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a4640-d185-47f8-999d-b9566ae9f8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:06.373607 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a4640-d185-47f8-999d-b9566ae9f8c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:06.374696 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a4640-d185-47f8-999d-b9566ae9f8c5 None admin] RBAC: Adding query filter params (role.id=c2a1a291255141b3b6eee6132725bfff, user.id=e5ba766e7bab403fb54261621ece8de3, scope.system=all) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:06.374890 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a4640-d185-47f8-999d-b9566ae9f8c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:06.376365 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a4640-d185-47f8-999d-b9566ae9f8c5 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:06.386712 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d31aa-5fc3-4556-96e0-ebbe9990f33b None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:06.392012 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 180/367] 10.222.0.15 () {56 vars in 1308 bytes} [Fri Jun 3 11:45:06 2022] GET /identity/v3/role_assignments?user.id=e5ba766e7bab403fb54261621ece8de3&scope.system=all&role.id=c2a1a291255141b3b6eee6132725bfff => generated 510 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:06.393516 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a4640-d185-47f8-999d-b9566ae9f8c5 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:06.434927 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2ee3a-d6dc-471f-8b0e-cc1c7fec7a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:06.436112 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2ee3a-d6dc-471f-8b0e-cc1c7fec7a96 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:06.436393 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2ee3a-d6dc-471f-8b0e-cc1c7fec7a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:06.436667 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2ee3a-d6dc-471f-8b0e-cc1c7fec7a96 None admin] PATH_INFO: `/v3/projects/deb1496445dd47a6ba9ad9fb02737115` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:06.439330 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd2ee3a-d6dc-471f-8b0e-cc1c7fec7a96 None admin] RBAC: Authorizing `identity:get_project(project_id=deb1496445dd47a6ba9ad9fb02737115)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:06.444978 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd2ee3a-d6dc-471f-8b0e-cc1c7fec7a96 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:06.444978 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 188/368] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:45:06 2022] GET /identity/v3/projects/deb1496445dd47a6ba9ad9fb02737115 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:06.448717 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2ee3a-d6dc-471f-8b0e-cc1c7fec7a96 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:06.469431 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:06.545438 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a4640-d185-47f8-999d-b9566ae9f8c5 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:06.588547 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b845b88-e1e7-481f-bafa-67adca4220aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:06.589867 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b845b88-e1e7-481f-bafa-67adca4220aa None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:06.589867 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b845b88-e1e7-481f-bafa-67adca4220aa None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:06.589867 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b845b88-e1e7-481f-bafa-67adca4220aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:06.603633 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b845b88-e1e7-481f-bafa-67adca4220aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:45:06.606716 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2ee3a-d6dc-471f-8b0e-cc1c7fec7a96 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:06.611692 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-6b845b88-e1e7-481f-bafa-67adca4220aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:45:06.611692 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:06.611692 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:06.611692 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:06.611692 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:06.611692 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:06.611692 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:06.611692 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:06.611692 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:06.611692 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:06.611692 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:06.611692 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:06.611692 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:45:06.611692 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:45:06.611692 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:45:06.611692 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:45:06.613171 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:45:06.613171 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:45:06.613171 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:45:06.613171 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:45:06.613171 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:06.613171 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:06.613171 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:06.613171 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:06.613171 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:06.613171 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:06.613171 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:06.613171 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:06.613171 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:06.613171 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:06.613171 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:06.613171 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:06.613956 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:06.613956 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:06.613956 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:06.613956 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:06.613956 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:45:06.613956 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:45:06.613956 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:45:06.613956 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:45:06.613956 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:45:06.613956 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:45:06.613956 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:45:06.613956 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:06.613956 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 181/369] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 3 11:45:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:06.614665 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b845b88-e1e7-481f-bafa-67adca4220aa None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:06.632973 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:06.673172 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f62f9-380c-42bc-984f-ce63a8cfea31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:06.673845 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f62f9-380c-42bc-984f-ce63a8cfea31 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:06.674203 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f62f9-380c-42bc-984f-ce63a8cfea31 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:06.674479 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f62f9-380c-42bc-984f-ce63a8cfea31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:06.738554 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b845b88-e1e7-481f-bafa-67adca4220aa None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:06.749010 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:06.784536 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ebc7a-ac66-4a41-934b-9ef32f0c3444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:06.785404 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ebc7a-ac66-4a41-934b-9ef32f0c3444 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:06.785681 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ebc7a-ac66-4a41-934b-9ef32f0c3444 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:06.785951 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ebc7a-ac66-4a41-934b-9ef32f0c3444 None admin] PATH_INFO: `/v3/groups/b4219b09bb644bd88819e4cb2f7e6f93` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:06.788112 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529ebc7a-ac66-4a41-934b-9ef32f0c3444 None admin] RBAC: Authorizing `identity:get_group(group_id=b4219b09bb644bd88819e4cb2f7e6f93)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:06.789552 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529ebc7a-ac66-4a41-934b-9ef32f0c3444 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:06.791384 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 182/370] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Jun 3 11:45:06 2022] GET /identity/v3/groups/b4219b09bb644bd88819e4cb2f7e6f93 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:06.791967 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ebc7a-ac66-4a41-934b-9ef32f0c3444 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:06.811441 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f62f9-380c-42bc-984f-ce63a8cfea31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:06.813865 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f62f9-380c-42bc-984f-ce63a8cfea31 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:06.923691 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ebc7a-ac66-4a41-934b-9ef32f0c3444 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:06.963873 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 189/371] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:45:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 11:45:06.964737 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f62f9-380c-42bc-984f-ce63a8cfea31 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:06.970944 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ddbfa3-e371-42ca-8b4a-18cbac00cf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:06.972123 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ddbfa3-e371-42ca-8b4a-18cbac00cf90 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:06.972123 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ddbfa3-e371-42ca-8b4a-18cbac00cf90 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:06.972123 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ddbfa3-e371-42ca-8b4a-18cbac00cf90 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:06.972740 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ddbfa3-e371-42ca-8b4a-18cbac00cf90 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:06.973045 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ddbfa3-e371-42ca-8b4a-18cbac00cf90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:06.974434 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ddbfa3-e371-42ca-8b4a-18cbac00cf90 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:06.985359 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 183/372] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:45:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:06.986191 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ddbfa3-e371-42ca-8b4a-18cbac00cf90 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:06.990767 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:07.031804 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:07.104476 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f62f9-380c-42bc-984f-ce63a8cfea31 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:07.115017 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ddbfa3-e371-42ca-8b4a-18cbac00cf90 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:07.155074 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e2875-fc39-4c90-ab9e-8f254aff158e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:07.155733 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e2875-fc39-4c90-ab9e-8f254aff158e None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:07.155952 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e2875-fc39-4c90-ab9e-8f254aff158e None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:07.156219 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e2875-fc39-4c90-ab9e-8f254aff158e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:07.157053 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e2875-fc39-4c90-ab9e-8f254aff158e None admin] RBAC: Adding query filter params (group.id=b4219b09bb644bd88819e4cb2f7e6f93, role.id=781e2d573ee94afaae05b3cc0bba8768, scope.project.id=deb1496445dd47a6ba9ad9fb02737115) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:07.157363 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e2875-fc39-4c90-ab9e-8f254aff158e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:07.158826 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e2875-fc39-4c90-ab9e-8f254aff158e None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:07.165025 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 190/373] 10.222.0.15 () {56 vars in 1376 bytes} [Fri Jun 3 11:45:06 2022] GET /identity/v3/role_assignments?group.id=b4219b09bb644bd88819e4cb2f7e6f93&scope.project.id=deb1496445dd47a6ba9ad9fb02737115&role.id=781e2d573ee94afaae05b3cc0bba8768 => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:07.165818 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e2875-fc39-4c90-ab9e-8f254aff158e None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:07.166492 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8068e2c-6365-40f8-ac04-4cedb7a86e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:07.167951 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8068e2c-6365-40f8-ac04-4cedb7a86e65 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:07.168453 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8068e2c-6365-40f8-ac04-4cedb7a86e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:07.168928 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8068e2c-6365-40f8-ac04-4cedb7a86e65 None admin] PATH_INFO: `/v3/projects/deb1496445dd47a6ba9ad9fb02737115` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:07.170512 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8068e2c-6365-40f8-ac04-4cedb7a86e65 None admin] RBAC: Authorizing `identity:get_project(project_id=deb1496445dd47a6ba9ad9fb02737115)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:07.172244 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8068e2c-6365-40f8-ac04-4cedb7a86e65 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:07.174251 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 184/374] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:45:06 2022] GET /identity/v3/projects/deb1496445dd47a6ba9ad9fb02737115 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:07.181046 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8068e2c-6365-40f8-ac04-4cedb7a86e65 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:07.279287 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:07.313114 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e2875-fc39-4c90-ab9e-8f254aff158e None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:07.314640 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8068e2c-6365-40f8-ac04-4cedb7a86e65 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:07.318022 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:07.356436 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37cf2b-79f9-4145-ac04-e0cb56122227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:07.357643 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37cf2b-79f9-4145-ac04-e0cb56122227 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:07.358182 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37cf2b-79f9-4145-ac04-e0cb56122227 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:07.358777 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37cf2b-79f9-4145-ac04-e0cb56122227 None admin] PATH_INFO: `/v3/groups/b4219b09bb644bd88819e4cb2f7e6f93` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:07.360195 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc37cf2b-79f9-4145-ac04-e0cb56122227 None admin] RBAC: Authorizing `identity:get_group(group_id=b4219b09bb644bd88819e4cb2f7e6f93)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:07.362177 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc37cf2b-79f9-4145-ac04-e0cb56122227 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:07.364185 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 185/375] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Jun 3 11:45:07 2022] GET /identity/v3/groups/b4219b09bb644bd88819e4cb2f7e6f93 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:45:07.371064 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a6a72-397c-4c2a-a06d-5a214fcad7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:07.372088 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a6a72-397c-4c2a-a06d-5a214fcad7eb None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:07.373500 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37cf2b-79f9-4145-ac04-e0cb56122227 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:07.378969 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a6a72-397c-4c2a-a06d-5a214fcad7eb None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:07.379766 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a6a72-397c-4c2a-a06d-5a214fcad7eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:07.544774 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a6a72-397c-4c2a-a06d-5a214fcad7eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:07.549087 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a6a72-397c-4c2a-a06d-5a214fcad7eb None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:07.589581 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37cf2b-79f9-4145-ac04-e0cb56122227 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:07.649754 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:07.667851 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19079f8-3da1-4b5f-aaa8-8044ae1c4b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:07.668522 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19079f8-3da1-4b5f-aaa8-8044ae1c4b05 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:07.668801 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19079f8-3da1-4b5f-aaa8-8044ae1c4b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:07.669148 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19079f8-3da1-4b5f-aaa8-8044ae1c4b05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:07.669986 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19079f8-3da1-4b5f-aaa8-8044ae1c4b05 None admin] RBAC: Adding query filter params (group.id=b4219b09bb644bd88819e4cb2f7e6f93, role.id=5d1199580aaa485bb120b35e6f771ff9, scope.project.id=deb1496445dd47a6ba9ad9fb02737115) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:07.670406 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19079f8-3da1-4b5f-aaa8-8044ae1c4b05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:07.672066 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19079f8-3da1-4b5f-aaa8-8044ae1c4b05 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:07.683666 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 191/376] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:45:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 11:45:07.687902 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 186/377] 10.222.0.15 () {56 vars in 1376 bytes} [Fri Jun 3 11:45:07 2022] GET /identity/v3/role_assignments?group.id=b4219b09bb644bd88819e4cb2f7e6f93&scope.project.id=deb1496445dd47a6ba9ad9fb02737115&role.id=5d1199580aaa485bb120b35e6f771ff9 => generated 260 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:45:07.689499 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a6a72-397c-4c2a-a06d-5a214fcad7eb None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:07.838134 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a6a72-397c-4c2a-a06d-5a214fcad7eb None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:07.880977 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2da597-271d-4721-a987-3cb2ac2c67ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:07.882231 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2da597-271d-4721-a987-3cb2ac2c67ef None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:07.882720 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2da597-271d-4721-a987-3cb2ac2c67ef None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:07.883212 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2da597-271d-4721-a987-3cb2ac2c67ef None admin] PATH_INFO: `/v3/projects/6db62e59d8164100b9d96eb446461cfc` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:07.884635 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2da597-271d-4721-a987-3cb2ac2c67ef None admin] RBAC: Authorizing `identity:get_project(project_id=6db62e59d8164100b9d96eb446461cfc)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:07.886287 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2da597-271d-4721-a987-3cb2ac2c67ef None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:07.888648 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 192/378] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:45:07 2022] GET /identity/v3/projects/6db62e59d8164100b9d96eb446461cfc => generated 344 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:07.896269 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19079f8-3da1-4b5f-aaa8-8044ae1c4b05 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:07.951697 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:08.022052 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19079f8-3da1-4b5f-aaa8-8044ae1c4b05 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:08.062979 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efc8f11-225c-40f2-8c46-f630e9a8795f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:08.063862 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc8f11-225c-40f2-8c46-f630e9a8795f None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:08.064143 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc8f11-225c-40f2-8c46-f630e9a8795f None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:08.064416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc8f11-225c-40f2-8c46-f630e9a8795f None admin] PATH_INFO: `/v3/groups/610b0482dcf74f368f5c5620936603fe` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:08.076166 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efc8f11-225c-40f2-8c46-f630e9a8795f None admin] RBAC: Authorizing `identity:get_group(group_id=610b0482dcf74f368f5c5620936603fe)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:08.077628 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efc8f11-225c-40f2-8c46-f630e9a8795f None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:08.079325 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 187/379] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Jun 3 11:45:07 2022] GET /identity/v3/groups/610b0482dcf74f368f5c5620936603fe => generated 229 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:08.085331 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2da597-271d-4721-a987-3cb2ac2c67ef None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:08.149360 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:08.212692 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a071d3-c7a6-4aaf-9063-01f99323475e None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:08.213207 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a071d3-c7a6-4aaf-9063-01f99323475e None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:08.213615 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a071d3-c7a6-4aaf-9063-01f99323475e None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:08.215356 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 188/380] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:45:08.220761 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39167fc6-6230-4ee3-90d6-f2da7b0945b8 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:08.221186 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39167fc6-6230-4ee3-90d6-f2da7b0945b8 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:08.221586 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39167fc6-6230-4ee3-90d6-f2da7b0945b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:08.246687 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-39167fc6-6230-4ee3-90d6-f2da7b0945b8 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:08.249908 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2da597-271d-4721-a987-3cb2ac2c67ef None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:08.251558 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-39167fc6-6230-4ee3-90d6-f2da7b0945b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:08.318519 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03c669-b892-4ea7-b233-16b778afbf46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:08.319180 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03c669-b892-4ea7-b233-16b778afbf46 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:08.321372 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03c669-b892-4ea7-b233-16b778afbf46 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:08.321653 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03c669-b892-4ea7-b233-16b778afbf46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:08.322498 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f03c669-b892-4ea7-b233-16b778afbf46 None admin] RBAC: Adding query filter params (group.id=610b0482dcf74f368f5c5620936603fe, role.id=c486e164840b41a59fd118dece2ce572, scope.project.id=6db62e59d8164100b9d96eb446461cfc) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:08.322812 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f03c669-b892-4ea7-b233-16b778afbf46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:08.324279 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f03c669-b892-4ea7-b233-16b778afbf46 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:08.340208 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 193/381] 10.222.0.15 () {56 vars in 1376 bytes} [Fri Jun 3 11:45:08 2022] GET /identity/v3/role_assignments?group.id=610b0482dcf74f368f5c5620936603fe&scope.project.id=6db62e59d8164100b9d96eb446461cfc&role.id=c486e164840b41a59fd118dece2ce572 => generated 260 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:08.363153 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 189/382] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:45:08.398858 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03c669-b892-4ea7-b233-16b778afbf46 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:08.513011 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03c669-b892-4ea7-b233-16b778afbf46 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:08.525172 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:08.552408 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec495f61-a0c0-4650-baf7-4503e34bdee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:08.553240 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec495f61-a0c0-4650-baf7-4503e34bdee1 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:08.553521 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec495f61-a0c0-4650-baf7-4503e34bdee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:08.553797 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec495f61-a0c0-4650-baf7-4503e34bdee1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:08.567001 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec495f61-a0c0-4650-baf7-4503e34bdee1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:45:08.574951 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-ec495f61-a0c0-4650-baf7-4503e34bdee1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 11:45:08.574951 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:08.574951 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:08.574951 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:08.574951 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:08.574951 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:08.574951 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:08.574951 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:08.574951 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:08.574951 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:08.574951 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:08.574951 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:08.574951 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:45:08.574951 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:45:08.574951 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:45:08.574951 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:45:08.575927 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:45:08.575927 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:45:08.575927 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:45:08.575927 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:45:08.575927 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:08.575927 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:08.575927 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:08.575927 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:08.575927 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:08.575927 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:08.575927 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:08.575927 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:08.575927 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:08.575927 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:08.575927 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:08.575927 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:08.576708 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:08.576708 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:08.576708 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:08.576708 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:08.576708 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:45:08.576708 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:45:08.576708 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:45:08.576708 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:45:08.576708 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:45:08.576708 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:45:08.576708 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 11:45:08.576708 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:08.576708 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 194/383] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:45:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:08.582509 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39167fc6-6230-4ee3-90d6-f2da7b0945b8 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:08.622410 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:08.715176 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39167fc6-6230-4ee3-90d6-f2da7b0945b8 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:08.766010 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e96a4a-03cb-4315-9dd7-afb66452ffd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:08.766617 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e96a4a-03cb-4315-9dd7-afb66452ffd0 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:08.766898 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e96a4a-03cb-4315-9dd7-afb66452ffd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:08.767172 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e96a4a-03cb-4315-9dd7-afb66452ffd0 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:08.768603 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e96a4a-03cb-4315-9dd7-afb66452ffd0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:08.768912 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e96a4a-03cb-4315-9dd7-afb66452ffd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:08.770330 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e96a4a-03cb-4315-9dd7-afb66452ffd0 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:08.780356 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 190/384] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 3 11:45:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:08.785654 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec495f61-a0c0-4650-baf7-4503e34bdee1 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:08.938859 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1376004-8ca8-4922-b52b-7770e92ff6b6 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:08.939198 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1376004-8ca8-4922-b52b-7770e92ff6b6 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:08.939420 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1376004-8ca8-4922-b52b-7770e92ff6b6 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:08.942710 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec495f61-a0c0-4650-baf7-4503e34bdee1 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:08.945124 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 191/385] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:45:08.949923 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe1a8a-3f1f-4b6e-bae3-b601cab4805c None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:08.950211 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe1a8a-3f1f-4b6e-bae3-b601cab4805c None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:08.950486 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe1a8a-3f1f-4b6e-bae3-b601cab4805c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:08.979128 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba93a07-e2eb-49b6-a69c-15c27829370a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:08.980392 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba93a07-e2eb-49b6-a69c-15c27829370a None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:08.980900 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba93a07-e2eb-49b6-a69c-15c27829370a None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:08.981376 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba93a07-e2eb-49b6-a69c-15c27829370a None admin] PATH_INFO: `/v3/groups/b4219b09bb644bd88819e4cb2f7e6f93` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:08.982970 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba93a07-e2eb-49b6-a69c-15c27829370a None admin] RBAC: Authorizing `identity:get_group(group_id=b4219b09bb644bd88819e4cb2f7e6f93)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:08.984737 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba93a07-e2eb-49b6-a69c-15c27829370a None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:08.988098 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 195/386] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Jun 3 11:45:08 2022] GET /identity/v3/groups/b4219b09bb644bd88819e4cb2f7e6f93 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:08.992730 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-7dbe1a8a-3f1f-4b6e-bae3-b601cab4805c None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:08.993979 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba93a07-e2eb-49b6-a69c-15c27829370a None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:08.996127 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-7dbe1a8a-3f1f-4b6e-bae3-b601cab4805c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:09.079861 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:09.086784 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 192/387] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:45:09.116972 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe1a8a-3f1f-4b6e-bae3-b601cab4805c None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:09.132144 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba93a07-e2eb-49b6-a69c-15c27829370a None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:09.170482 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e106469-db4c-47b1-a297-4b9eac324c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:09.171354 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e106469-db4c-47b1-a297-4b9eac324c0a None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:09.171674 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e106469-db4c-47b1-a297-4b9eac324c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:09.171959 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e106469-db4c-47b1-a297-4b9eac324c0a None admin] PATH_INFO: `/v3/projects/437ab37ab6104629b1199c45fdd0b804` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:09.173707 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e106469-db4c-47b1-a297-4b9eac324c0a None admin] RBAC: Authorizing `identity:get_project(project_id=437ab37ab6104629b1199c45fdd0b804)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:09.175817 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e106469-db4c-47b1-a297-4b9eac324c0a None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:09.177868 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 196/388] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:45:08 2022] GET /identity/v3/projects/437ab37ab6104629b1199c45fdd0b804 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:09.183336 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e106469-db4c-47b1-a297-4b9eac324c0a None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:09.185311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:09.354633 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e106469-db4c-47b1-a297-4b9eac324c0a None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:09.361098 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe1a8a-3f1f-4b6e-bae3-b601cab4805c None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:09.371835 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:09.428599 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9fd94-7fe1-4b51-8fbf-bb173254a9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:09.429990 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9fd94-7fe1-4b51-8fbf-bb173254a9d4 None admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:09.430275 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9fd94-7fe1-4b51-8fbf-bb173254a9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:09.430555 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9fd94-7fe1-4b51-8fbf-bb173254a9d4 None admin] PATH_INFO: `/v3/projects/437ab37ab6104629b1199c45fdd0b804/groups/b4219b09bb644bd88819e4cb2f7e6f93/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:09.434242 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9fd94-7fe1-4b51-8fbf-bb173254a9d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=437ab37ab6104629b1199c45fdd0b804, group_id=b4219b09bb644bd88819e4cb2f7e6f93, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:09.435714 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9fd94-7fe1-4b51-8fbf-bb173254a9d4 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:09.438506 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0f0ba-c034-485f-a5be-0c39bb162981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:09.439312 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0f0ba-c034-485f-a5be-0c39bb162981 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:09.439659 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0f0ba-c034-485f-a5be-0c39bb162981 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:09.439919 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0f0ba-c034-485f-a5be-0c39bb162981 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:09.453017 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e0f0ba-c034-485f-a5be-0c39bb162981 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:45:09.463650 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 197/389] 10.222.0.15 () {58 vars in 1442 bytes} [Fri Jun 3 11:45:09 2022] PUT /identity/v3/projects/437ab37ab6104629b1199c45fdd0b804/groups/b4219b09bb644bd88819e4cb2f7e6f93/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:45:09.471994 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-36e0f0ba-c034-485f-a5be-0c39bb162981 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 11:45:09.471994 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:09.471994 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:09.471994 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:09.471994 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:09.471994 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:09.471994 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:09.471994 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:09.471994 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:09.471994 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:09.471994 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:09.471994 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:09.471994 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:45:09.471994 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:45:09.471994 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:45:09.471994 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:45:09.472973 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:45:09.472973 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:45:09.472973 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:45:09.472973 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:45:09.472973 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:09.472973 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:09.472973 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:09.472973 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:09.472973 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:09.472973 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:09.472973 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:09.472973 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:09.472973 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:09.472973 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:09.472973 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:09.472973 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:09.473795 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:09.473795 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:09.473795 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:09.473795 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:09.473795 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:45:09.473795 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:45:09.473795 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:45:09.473795 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:45:09.473795 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:45:09.473795 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:45:09.473795 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 11:45:09.473795 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:09.473795 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 193/390] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Jun 3 11:45:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:09.479286 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9fd94-7fe1-4b51-8fbf-bb173254a9d4 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:09.623693 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9fd94-7fe1-4b51-8fbf-bb173254a9d4 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:09.673648 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e9cc9-b844-4daa-a361-0b7ee8ac207d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:09.674899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e9cc9-b844-4daa-a361-0b7ee8ac207d None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:09.675182 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e9cc9-b844-4daa-a361-0b7ee8ac207d None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:09.675457 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e9cc9-b844-4daa-a361-0b7ee8ac207d None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:09.676247 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e9cc9-b844-4daa-a361-0b7ee8ac207d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:09.676553 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e9cc9-b844-4daa-a361-0b7ee8ac207d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:09.677957 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e9cc9-b844-4daa-a361-0b7ee8ac207d None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:09.691444 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 198/391] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:45:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:09.697356 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0f0ba-c034-485f-a5be-0c39bb162981 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:09.796605 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:09.816899 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0f0ba-c034-485f-a5be-0c39bb162981 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:09.853435 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d92a4f-a78d-4cf5-a643-c3bcda859057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:09.854294 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d92a4f-a78d-4cf5-a643-c3bcda859057 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:09.854576 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d92a4f-a78d-4cf5-a643-c3bcda859057 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:09.854854 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d92a4f-a78d-4cf5-a643-c3bcda859057 None admin] PATH_INFO: `/v3/groups/b4219b09bb644bd88819e4cb2f7e6f93` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:09.856064 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d92a4f-a78d-4cf5-a643-c3bcda859057 None admin] RBAC: Authorizing `identity:get_group(group_id=b4219b09bb644bd88819e4cb2f7e6f93)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:09.857503 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d92a4f-a78d-4cf5-a643-c3bcda859057 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:09.859578 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 194/392] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Jun 3 11:45:09 2022] GET /identity/v3/groups/b4219b09bb644bd88819e4cb2f7e6f93 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:09.865347 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e9cc9-b844-4daa-a361-0b7ee8ac207d None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:09.904996 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:10.007582 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e9cc9-b844-4daa-a361-0b7ee8ac207d None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:10.043989 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4499b55-dc67-4620-aa19-5d66e0a8ba54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:10.044855 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4499b55-dc67-4620-aa19-5d66e0a8ba54 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:10.045142 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4499b55-dc67-4620-aa19-5d66e0a8ba54 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:10.045419 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4499b55-dc67-4620-aa19-5d66e0a8ba54 None admin] PATH_INFO: `/v3/projects/437ab37ab6104629b1199c45fdd0b804` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:10.046602 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4499b55-dc67-4620-aa19-5d66e0a8ba54 None admin] RBAC: Authorizing `identity:get_project(project_id=437ab37ab6104629b1199c45fdd0b804)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:10.048282 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4499b55-dc67-4620-aa19-5d66e0a8ba54 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:10.050924 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 199/393] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:45:09 2022] GET /identity/v3/projects/437ab37ab6104629b1199c45fdd0b804 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:10.056452 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d92a4f-a78d-4cf5-a643-c3bcda859057 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:10.166562 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d92a4f-a78d-4cf5-a643-c3bcda859057 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:10.201734 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82cc2d-b67b-40f6-9585-e0295b66f807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:10.202616 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82cc2d-b67b-40f6-9585-e0295b66f807 None admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:10.202902 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82cc2d-b67b-40f6-9585-e0295b66f807 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:10.203179 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82cc2d-b67b-40f6-9585-e0295b66f807 None admin] PATH_INFO: `/v3/projects/437ab37ab6104629b1199c45fdd0b804/groups/b4219b09bb644bd88819e4cb2f7e6f93/roles/5d1199580aaa485bb120b35e6f771ff9` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:10.205516 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e82cc2d-b67b-40f6-9585-e0295b66f807 None admin] RBAC: Authorizing `identity:create_grant(project_id=437ab37ab6104629b1199c45fdd0b804, group_id=b4219b09bb644bd88819e4cb2f7e6f93, role_id=5d1199580aaa485bb120b35e6f771ff9)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:10.207006 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e82cc2d-b67b-40f6-9585-e0295b66f807 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:10.225337 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466279a-d13e-4975-abb4-a97e40a38320 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:10.225620 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466279a-d13e-4975-abb4-a97e40a38320 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:10.225899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466279a-d13e-4975-abb4-a97e40a38320 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:10.227536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 200/394] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 11:45:10.234697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f997f-94a7-4bc5-816d-6aed3557d5bb None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:10.234697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f997f-94a7-4bc5-816d-6aed3557d5bb None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:10.234697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f997f-94a7-4bc5-816d-6aed3557d5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:10.237735 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 195/395] 10.222.0.15 () {58 vars in 1442 bytes} [Fri Jun 3 11:45:10 2022] PUT /identity/v3/projects/437ab37ab6104629b1199c45fdd0b804/groups/b4219b09bb644bd88819e4cb2f7e6f93/roles/5d1199580aaa485bb120b35e6f771ff9 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:45:10.253520 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-153f997f-94a7-4bc5-816d-6aed3557d5bb None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:10.255290 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-153f997f-94a7-4bc5-816d-6aed3557d5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:10.332659 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 201/396] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 11:45:10.345423 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f28e3f-7d5b-482c-8b2a-3a8432ddc332 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:10.345747 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f28e3f-7d5b-482c-8b2a-3a8432ddc332 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:10.346518 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f28e3f-7d5b-482c-8b2a-3a8432ddc332 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:10.348409 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 196/397] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:45:10.356481 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7cc1f-07d5-410f-83a4-bc05dce031d7 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:10.356986 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7cc1f-07d5-410f-83a4-bc05dce031d7 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:10.357059 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7cc1f-07d5-410f-83a4-bc05dce031d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:10.359297 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f28e3f-7d5b-482c-8b2a-3a8432ddc332 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:10.376884 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-97e7cc1f-07d5-410f-83a4-bc05dce031d7 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:10.378598 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-97e7cc1f-07d5-410f-83a4-bc05dce031d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:10.379930 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:10.405354 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:10.464477 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 202/398] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:45:10.494751 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7cc1f-07d5-410f-83a4-bc05dce031d7 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:10.497709 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f28e3f-7d5b-482c-8b2a-3a8432ddc332 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:10.539425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866bcfe5-0c13-41b6-b7df-1e032ea677e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:10.540267 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bcfe5-0c13-41b6-b7df-1e032ea677e2 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:10.540544 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bcfe5-0c13-41b6-b7df-1e032ea677e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:10.540820 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bcfe5-0c13-41b6-b7df-1e032ea677e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:10.553151 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866bcfe5-0c13-41b6-b7df-1e032ea677e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:45:10.566573 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-866bcfe5-0c13-41b6-b7df-1e032ea677e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 11:45:10.566573 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:10.566573 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:10.566573 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:10.566573 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:10.566573 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:10.566573 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:10.566573 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:10.566573 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:10.566573 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:10.566573 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:10.566573 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:10.566573 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:45:10.566573 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:45:10.566573 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:45:10.566573 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:45:10.567589 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:45:10.567589 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:45:10.567589 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:45:10.567589 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:45:10.567589 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:10.567589 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:10.567589 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:10.567589 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:10.567589 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:10.567589 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:10.567589 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:10.567589 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:10.567589 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:10.567589 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:10.567589 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:10.567589 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:10.568367 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:10.568367 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:10.568367 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:10.568367 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:10.568367 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:45:10.568367 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:45:10.568367 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:45:10.568367 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:45:10.568367 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:45:10.568367 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:45:10.568367 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 11:45:10.568367 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:10.568367 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 197/399] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:45:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:10.575064 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866bcfe5-0c13-41b6-b7df-1e032ea677e2 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:10.620760 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7cc1f-07d5-410f-83a4-bc05dce031d7 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:10.688585 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7375d13-fe28-49d4-8f04-8712e2bb8256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:10.689411 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7375d13-fe28-49d4-8f04-8712e2bb8256 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:10.689731 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7375d13-fe28-49d4-8f04-8712e2bb8256 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:10.690012 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7375d13-fe28-49d4-8f04-8712e2bb8256 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:10.709647 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:10.710026 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7375d13-fe28-49d4-8f04-8712e2bb8256 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:45:10.718578 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-e7375d13-fe28-49d4-8f04-8712e2bb8256 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 11:45:10.718578 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:10.718578 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:10.718578 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:10.718578 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:10.718578 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:10.718578 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:10.718578 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:10.718578 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:10.718578 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:10.718578 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:10.718578 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:10.718578 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:45:10.718578 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:45:10.718578 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:45:10.718578 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:45:10.719437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:45:10.719437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:45:10.719437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:45:10.719437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:45:10.719437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:10.719437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:10.719437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:10.719437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:10.719437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:10.719437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:10.719437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:10.719437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:10.719437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:10.719437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:10.719437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:10.719437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:10.720250 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:10.720250 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:10.720250 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:10.720250 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:10.720250 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:45:10.720250 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:45:10.720250 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:45:10.720250 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:45:10.720250 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:45:10.720250 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:45:10.720250 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 11:45:10.720250 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:10.721943 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 203/400] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Jun 3 11:45:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:45:10.729111 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7375d13-fe28-49d4-8f04-8712e2bb8256 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:10.749118 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:10.802385 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866bcfe5-0c13-41b6-b7df-1e032ea677e2 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:10.867328 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c0e66-4073-4962-b16a-9320832de14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:10.868031 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c0e66-4073-4962-b16a-9320832de14d None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:10.868317 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c0e66-4073-4962-b16a-9320832de14d None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:10.868611 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c0e66-4073-4962-b16a-9320832de14d None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:10.869343 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c0e66-4073-4962-b16a-9320832de14d None admin] RBAC: Adding query filter params (name=member) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:10.869649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c0e66-4073-4962-b16a-9320832de14d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:10.871363 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c0e66-4073-4962-b16a-9320832de14d None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:10.874220 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7375d13-fe28-49d4-8f04-8712e2bb8256 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:10.886876 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 198/401] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 3 11:45:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:10.892836 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c0e66-4073-4962-b16a-9320832de14d None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:10.911903 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea258f-1bb7-4961-a95a-f0847961983e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:10.912805 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea258f-1bb7-4961-a95a-f0847961983e None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:10.913309 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea258f-1bb7-4961-a95a-f0847961983e None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:10.913772 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea258f-1bb7-4961-a95a-f0847961983e None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:10.914726 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea258f-1bb7-4961-a95a-f0847961983e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:10.915224 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea258f-1bb7-4961-a95a-f0847961983e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:10.916877 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea258f-1bb7-4961-a95a-f0847961983e None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:10.926505 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 204/402] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:45:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:45:10.941773 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea258f-1bb7-4961-a95a-f0847961983e None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:11.029356 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:11.052347 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea258f-1bb7-4961-a95a-f0847961983e None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:11.068834 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c0e66-4073-4962-b16a-9320832de14d None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:11.096810 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd05e89-df1b-4b54-a0b4-b2e06276da0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:11.097688 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd05e89-df1b-4b54-a0b4-b2e06276da0a None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:11.098016 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd05e89-df1b-4b54-a0b4-b2e06276da0a None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:11.098303 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd05e89-df1b-4b54-a0b4-b2e06276da0a None admin] PATH_INFO: `/v3/groups/b4219b09bb644bd88819e4cb2f7e6f93` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:11.103789 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd05e89-df1b-4b54-a0b4-b2e06276da0a None admin] RBAC: Authorizing `identity:get_group(group_id=b4219b09bb644bd88819e4cb2f7e6f93)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:11.105320 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd05e89-df1b-4b54-a0b4-b2e06276da0a None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:11.106979 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 205/403] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Jun 3 11:45:10 2022] GET /identity/v3/groups/b4219b09bb644bd88819e4cb2f7e6f93 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:45:11.109042 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:11.110003 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e4777-c24f-43f1-891a-65fb7f425077 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:11.110252 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e4777-c24f-43f1-891a-65fb7f425077 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:11.110535 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e4777-c24f-43f1-891a-65fb7f425077 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:11.112890 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 206/404] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 11:45:11.113645 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e4777-c24f-43f1-891a-65fb7f425077 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:11.120129 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef4879-9500-4665-bb82-d1158034d31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:11.120986 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef4879-9500-4665-bb82-d1158034d31d None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:11.121271 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef4879-9500-4665-bb82-d1158034d31d None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:11.121547 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef4879-9500-4665-bb82-d1158034d31d None admin] PATH_INFO: `/v3/groups/b4219b09bb644bd88819e4cb2f7e6f93` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:11.122734 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef4879-9500-4665-bb82-d1158034d31d None admin] RBAC: Authorizing `identity:get_group(group_id=b4219b09bb644bd88819e4cb2f7e6f93)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:11.124204 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef4879-9500-4665-bb82-d1158034d31d None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:11.126101 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 199/405] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Jun 3 11:45:10 2022] GET /identity/v3/groups/b4219b09bb644bd88819e4cb2f7e6f93 => generated 226 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:11.127896 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170fffd-89ff-468d-9240-a6ed4cbe5fb3 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:11.128184 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170fffd-89ff-468d-9240-a6ed4cbe5fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:11.128461 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170fffd-89ff-468d-9240-a6ed4cbe5fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:11.145368 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-2170fffd-89ff-468d-9240-a6ed4cbe5fb3 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:11.146541 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-2170fffd-89ff-468d-9240-a6ed4cbe5fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:11.214755 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 200/406] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:45:11.222978 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e4777-c24f-43f1-891a-65fb7f425077 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:11.223863 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170fffd-89ff-468d-9240-a6ed4cbe5fb3 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:11.258772 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913e7d4-f21a-4558-89b7-3ff1d5f2978a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:11.259674 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913e7d4-f21a-4558-89b7-3ff1d5f2978a None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:11.259957 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913e7d4-f21a-4558-89b7-3ff1d5f2978a None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:11.260237 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913e7d4-f21a-4558-89b7-3ff1d5f2978a None admin] PATH_INFO: `/v3/projects/deb1496445dd47a6ba9ad9fb02737115` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:11.261450 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b913e7d4-f21a-4558-89b7-3ff1d5f2978a None admin] RBAC: Authorizing `identity:get_project(project_id=deb1496445dd47a6ba9ad9fb02737115)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:11.263006 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b913e7d4-f21a-4558-89b7-3ff1d5f2978a None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:11.265117 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 207/407] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:45:11 2022] GET /identity/v3/projects/deb1496445dd47a6ba9ad9fb02737115 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:11.265889 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913e7d4-f21a-4558-89b7-3ff1d5f2978a None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:11.299990 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:11.351877 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170fffd-89ff-468d-9240-a6ed4cbe5fb3 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:11.388478 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:11.390820 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913e7d4-f21a-4558-89b7-3ff1d5f2978a None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:11.396215 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32fedb-14db-47c5-af08-cd2a113f6b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:11.397078 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32fedb-14db-47c5-af08-cd2a113f6b79 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:11.397363 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32fedb-14db-47c5-af08-cd2a113f6b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:11.397640 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32fedb-14db-47c5-af08-cd2a113f6b79 None admin] PATH_INFO: `/v3/projects/deb1496445dd47a6ba9ad9fb02737115` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:11.398831 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b32fedb-14db-47c5-af08-cd2a113f6b79 None admin] RBAC: Authorizing `identity:get_project(project_id=deb1496445dd47a6ba9ad9fb02737115)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:11.401091 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b32fedb-14db-47c5-af08-cd2a113f6b79 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:11.403493 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 201/408] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:45:11 2022] GET /identity/v3/projects/deb1496445dd47a6ba9ad9fb02737115 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:11.404367 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32fedb-14db-47c5-af08-cd2a113f6b79 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:11.431395 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b7227-9a65-4f16-bca1-57849726e33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:11.432614 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b7227-9a65-4f16-bca1-57849726e33b None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:11.433079 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b7227-9a65-4f16-bca1-57849726e33b None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:11.433556 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b7227-9a65-4f16-bca1-57849726e33b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:11.447208 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b7227-9a65-4f16-bca1-57849726e33b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:45:11.457263 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-047b7227-9a65-4f16-bca1-57849726e33b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:45:11.457263 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:11.457263 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:11.457263 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:11.457263 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:11.457263 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:11.457263 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:11.457263 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:11.457263 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:11.457263 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:11.457263 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:11.457263 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:11.457263 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:45:11.457263 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:45:11.457263 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:45:11.457263 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:45:11.458153 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:45:11.458153 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:45:11.458153 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:45:11.458153 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:45:11.458153 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:11.458153 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:11.458153 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:11.458153 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:11.458153 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:11.458153 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:11.458153 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:11.458153 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:11.458153 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:11.458153 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:11.458153 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:11.458153 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:11.459014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:11.459014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:11.459014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:11.459014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:11.459014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:45:11.459014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:45:11.459014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:45:11.459014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:45:11.459014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:45:11.459014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:45:11.459014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:45:11.459014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:11.463626 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 208/409] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 3 11:45:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:11.463626 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b7227-9a65-4f16-bca1-57849726e33b None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:11.524575 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32fedb-14db-47c5-af08-cd2a113f6b79 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:11.543318 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:11.561116 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59b69d-8a4a-4ab9-967e-797b06c482cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:11.562057 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59b69d-8a4a-4ab9-967e-797b06c482cc None admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:11.562448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59b69d-8a4a-4ab9-967e-797b06c482cc None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:11.562832 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59b69d-8a4a-4ab9-967e-797b06c482cc None admin] PATH_INFO: `/v3/projects/deb1496445dd47a6ba9ad9fb02737115/groups/b4219b09bb644bd88819e4cb2f7e6f93/roles/5d1199580aaa485bb120b35e6f771ff9` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:11.565942 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d59b69d-8a4a-4ab9-967e-797b06c482cc None admin] RBAC: Authorizing `identity:create_grant(project_id=deb1496445dd47a6ba9ad9fb02737115, group_id=b4219b09bb644bd88819e4cb2f7e6f93, role_id=5d1199580aaa485bb120b35e6f771ff9)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:11.567616 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d59b69d-8a4a-4ab9-967e-797b06c482cc None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:11.574391 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b7227-9a65-4f16-bca1-57849726e33b None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:11.585366 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 202/410] 10.222.0.15 () {58 vars in 1442 bytes} [Fri Jun 3 11:45:11 2022] PUT /identity/v3/projects/deb1496445dd47a6ba9ad9fb02737115/groups/b4219b09bb644bd88819e4cb2f7e6f93/roles/5d1199580aaa485bb120b35e6f771ff9 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:45:11.586650 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59b69d-8a4a-4ab9-967e-797b06c482cc None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:11.663220 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:11.668988 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999dd6e-bb83-4574-b767-9794dee1f4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:11.669888 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999dd6e-bb83-4574-b767-9794dee1f4d6 None admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:11.670175 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999dd6e-bb83-4574-b767-9794dee1f4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:11.670449 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999dd6e-bb83-4574-b767-9794dee1f4d6 None admin] PATH_INFO: `/v3/projects/deb1496445dd47a6ba9ad9fb02737115/groups/b4219b09bb644bd88819e4cb2f7e6f93/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:11.676013 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a999dd6e-bb83-4574-b767-9794dee1f4d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=deb1496445dd47a6ba9ad9fb02737115, group_id=b4219b09bb644bd88819e4cb2f7e6f93, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:11.677752 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a999dd6e-bb83-4574-b767-9794dee1f4d6 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:11.714924 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 209/411] 10.222.0.15 () {58 vars in 1442 bytes} [Fri Jun 3 11:45:11 2022] PUT /identity/v3/projects/deb1496445dd47a6ba9ad9fb02737115/groups/b4219b09bb644bd88819e4cb2f7e6f93/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:45:11.721514 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59b69d-8a4a-4ab9-967e-797b06c482cc None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:11.764241 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05ac57-c40a-490b-b980-21a6a5fb08f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:11.765438 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05ac57-c40a-490b-b980-21a6a5fb08f7 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:11.765954 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05ac57-c40a-490b-b980-21a6a5fb08f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:11.766525 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05ac57-c40a-490b-b980-21a6a5fb08f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:11.767798 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05ac57-c40a-490b-b980-21a6a5fb08f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:11.768946 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05ac57-c40a-490b-b980-21a6a5fb08f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:11.770575 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05ac57-c40a-490b-b980-21a6a5fb08f7 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:11.781654 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 203/412] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:45:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:11.793489 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999dd6e-bb83-4574-b767-9794dee1f4d6 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:11.931169 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999dd6e-bb83-4574-b767-9794dee1f4d6 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:11.969184 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d662ce2b-3dab-4b1a-84a6-3a6b126ef848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:11.970059 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662ce2b-3dab-4b1a-84a6-3a6b126ef848 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:11.970340 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662ce2b-3dab-4b1a-84a6-3a6b126ef848 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:11.970709 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662ce2b-3dab-4b1a-84a6-3a6b126ef848 None admin] PATH_INFO: `/v3/groups/610b0482dcf74f368f5c5620936603fe` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:11.971960 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d662ce2b-3dab-4b1a-84a6-3a6b126ef848 None admin] RBAC: Authorizing `identity:get_group(group_id=610b0482dcf74f368f5c5620936603fe)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:11.975184 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d662ce2b-3dab-4b1a-84a6-3a6b126ef848 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:11.975184 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 210/413] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Jun 3 11:45:11 2022] GET /identity/v3/groups/610b0482dcf74f368f5c5620936603fe => generated 229 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:11.984686 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05ac57-c40a-490b-b980-21a6a5fb08f7 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:12.101760 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05ac57-c40a-490b-b980-21a6a5fb08f7 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:12.122821 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:12.138058 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46921eb-d4d6-44f3-b73b-6d7d1f721718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:12.139175 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46921eb-d4d6-44f3-b73b-6d7d1f721718 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:12.139460 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46921eb-d4d6-44f3-b73b-6d7d1f721718 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:12.139774 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46921eb-d4d6-44f3-b73b-6d7d1f721718 None admin] PATH_INFO: `/v3/projects/6db62e59d8164100b9d96eb446461cfc` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:12.140979 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46921eb-d4d6-44f3-b73b-6d7d1f721718 None admin] RBAC: Authorizing `identity:get_project(project_id=6db62e59d8164100b9d96eb446461cfc)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:12.142437 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46921eb-d4d6-44f3-b73b-6d7d1f721718 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:12.144571 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 204/414] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:45:11 2022] GET /identity/v3/projects/6db62e59d8164100b9d96eb446461cfc => generated 344 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:12.149847 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d662ce2b-3dab-4b1a-84a6-3a6b126ef848 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:12.157708 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:12.341488 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d662ce2b-3dab-4b1a-84a6-3a6b126ef848 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:12.392268 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ae659-3828-4691-8b86-b4e515f4868f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:12.393192 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ae659-3828-4691-8b86-b4e515f4868f None admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:12.393472 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ae659-3828-4691-8b86-b4e515f4868f None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:12.393742 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ae659-3828-4691-8b86-b4e515f4868f None admin] PATH_INFO: `/v3/projects/6db62e59d8164100b9d96eb446461cfc/groups/610b0482dcf74f368f5c5620936603fe/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:12.395756 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ae659-3828-4691-8b86-b4e515f4868f None admin] RBAC: Authorizing `identity:create_grant(project_id=6db62e59d8164100b9d96eb446461cfc, group_id=610b0482dcf74f368f5c5620936603fe, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:12.397202 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ae659-3828-4691-8b86-b4e515f4868f None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:12.428093 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 211/415] 10.222.0.15 () {58 vars in 1442 bytes} [Fri Jun 3 11:45:12 2022] PUT /identity/v3/projects/6db62e59d8164100b9d96eb446461cfc/groups/610b0482dcf74f368f5c5620936603fe/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:45:12.611228 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08ef95-e31c-49e5-9b0e-3161dd599478 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:12.612925 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08ef95-e31c-49e5-9b0e-3161dd599478 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:12.613445 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08ef95-e31c-49e5-9b0e-3161dd599478 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:12.615205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 205/416] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:45:12.621156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf4017-b304-4b5a-affc-3657b301ab4a None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:12.621438 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf4017-b304-4b5a-affc-3657b301ab4a None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:12.621722 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf4017-b304-4b5a-affc-3657b301ab4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:12.652802 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-d0cf4017-b304-4b5a-affc-3657b301ab4a None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:12.654028 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-d0cf4017-b304-4b5a-affc-3657b301ab4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:12.731034 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:12.746645 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 212/417] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 11:45:12.770538 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08ef95-e31c-49e5-9b0e-3161dd599478 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:12.931255 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08ef95-e31c-49e5-9b0e-3161dd599478 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:12.968572 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d3030-0be0-441b-acf4-5ad4f395f0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:12.969369 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d3030-0be0-441b-acf4-5ad4f395f0ce None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:12.969652 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d3030-0be0-441b-acf4-5ad4f395f0ce None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:12.969928 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d3030-0be0-441b-acf4-5ad4f395f0ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:12.980565 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d3030-0be0-441b-acf4-5ad4f395f0ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:45:12.988987 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-ee6d3030-0be0-441b-acf4-5ad4f395f0ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 11:45:12.988987 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:12.988987 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:12.988987 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:12.988987 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:12.988987 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:12.988987 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:12.988987 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:12.988987 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:12.988987 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:12.988987 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:12.988987 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:12.988987 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:45:12.988987 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:45:12.988987 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:45:12.988987 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:45:12.989833 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:45:12.989833 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:45:12.989833 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:45:12.989833 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:45:12.989833 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:12.989833 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:12.989833 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:12.989833 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:12.989833 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:12.989833 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:12.989833 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:12.989833 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:12.989833 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:12.989833 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:12.989833 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:12.989833 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:12.990649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:12.990649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:12.990649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:12.990649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:12.990649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:45:12.990649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:45:12.990649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:45:12.990649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:45:12.990649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:45:12.990649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:45:12.990649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 11:45:12.990649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:12.990649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 206/418] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:45:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:12.995913 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf4017-b304-4b5a-affc-3657b301ab4a None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:13.001533 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5eaaef-1c41-4e0f-a9bc-dd11bcddf1d1 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:13.001820 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5eaaef-1c41-4e0f-a9bc-dd11bcddf1d1 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:13.002178 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5eaaef-1c41-4e0f-a9bc-dd11bcddf1d1 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:13.004056 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 207/419] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 11:45:13.010885 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8896c5a-bef0-4a47-a134-a8d21058474a None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:13.011173 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8896c5a-bef0-4a47-a134-a8d21058474a None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:13.011456 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8896c5a-bef0-4a47-a134-a8d21058474a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:13.042862 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-f8896c5a-bef0-4a47-a134-a8d21058474a None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:13.044076 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-f8896c5a-bef0-4a47-a134-a8d21058474a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:13.121712 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:13.180342 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 208/420] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 11:45:13.188784 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf4017-b304-4b5a-affc-3657b301ab4a None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:13.229151 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8896c5a-bef0-4a47-a134-a8d21058474a None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:13.266093 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97476f-45f0-474d-a224-b8c0cd11c065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:13.266693 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97476f-45f0-474d-a224-b8c0cd11c065 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:13.266977 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97476f-45f0-474d-a224-b8c0cd11c065 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:13.267254 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97476f-45f0-474d-a224-b8c0cd11c065 None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:13.268611 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf97476f-45f0-474d-a224-b8c0cd11c065 None admin] RBAC: Adding query filter params (name=member) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:13.268921 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf97476f-45f0-474d-a224-b8c0cd11c065 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:13.270323 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf97476f-45f0-474d-a224-b8c0cd11c065 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:13.295231 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 213/421] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 3 11:45:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:13.300408 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97476f-45f0-474d-a224-b8c0cd11c065 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:13.407248 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8896c5a-bef0-4a47-a134-a8d21058474a None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:13.410385 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:13.446395 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fea038-1449-404f-9605-7e3c806d5041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:13.447204 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fea038-1449-404f-9605-7e3c806d5041 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:13.447489 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fea038-1449-404f-9605-7e3c806d5041 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:13.447807 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fea038-1449-404f-9605-7e3c806d5041 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:13.459162 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fea038-1449-404f-9605-7e3c806d5041 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:45:13.468005 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-50fea038-1449-404f-9605-7e3c806d5041 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 11:45:13.468005 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:13.468005 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:13.468005 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:13.468005 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:13.468005 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:13.468005 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:13.468005 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:13.468005 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:13.468005 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:13.468005 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:13.468005 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:13.468005 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:45:13.468005 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:45:13.468005 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:45:13.468005 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:45:13.468895 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:45:13.468895 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:45:13.468895 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:45:13.468895 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:45:13.468895 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:13.468895 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:13.468895 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:13.468895 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:13.468895 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:13.468895 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:13.468895 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:13.468895 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:13.468895 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:13.468895 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:13.468895 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:13.468895 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:13.469676 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:13.469676 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:13.469676 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:13.469676 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:13.469676 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:45:13.469676 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:45:13.469676 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:45:13.469676 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:45:13.469676 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:45:13.469676 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:45:13.469676 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 11:45:13.469676 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:13.474536 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 209/422] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Jun 3 11:45:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:13.475759 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fea038-1449-404f-9605-7e3c806d5041 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:13.493043 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97476f-45f0-474d-a224-b8c0cd11c065 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:13.518292 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:13.560296 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380d5755-6220-4ae4-9e73-bc57db933da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:13.560950 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d5755-6220-4ae4-9e73-bc57db933da1 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:13.561234 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d5755-6220-4ae4-9e73-bc57db933da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:13.561568 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d5755-6220-4ae4-9e73-bc57db933da1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:13.582971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fea038-1449-404f-9605-7e3c806d5041 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:13.619928 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e784a9-f675-4050-9d88-5767440295db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:13.620682 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e784a9-f675-4050-9d88-5767440295db None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:13.620967 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e784a9-f675-4050-9d88-5767440295db None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:13.621252 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e784a9-f675-4050-9d88-5767440295db None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:13.621994 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e784a9-f675-4050-9d88-5767440295db None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:13.622385 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e784a9-f675-4050-9d88-5767440295db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:13.623905 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e784a9-f675-4050-9d88-5767440295db None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:13.637510 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 210/423] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:45:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:45:13.638721 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e784a9-f675-4050-9d88-5767440295db None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:13.639834 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380d5755-6220-4ae4-9e73-bc57db933da1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:13.641364 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380d5755-6220-4ae4-9e73-bc57db933da1 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:13.741753 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:13.744936 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e784a9-f675-4050-9d88-5767440295db None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:13.754629 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:13.782709 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b90c9-4a56-492b-a8a7-be807f4a5cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:13.783287 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b90c9-4a56-492b-a8a7-be807f4a5cba None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:13.783632 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b90c9-4a56-492b-a8a7-be807f4a5cba None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:13.783914 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b90c9-4a56-492b-a8a7-be807f4a5cba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:13.846531 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 214/424] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:45:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 03 11:45:13.852048 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380d5755-6220-4ae4-9e73-bc57db933da1 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:13.856536 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708b90c9-4a56-492b-a8a7-be807f4a5cba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:13.858007 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708b90c9-4a56-492b-a8a7-be807f4a5cba None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:13.968220 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:13.971973 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 211/425] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:45:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 11:45:13.974614 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b90c9-4a56-492b-a8a7-be807f4a5cba None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:14.079969 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380d5755-6220-4ae4-9e73-bc57db933da1 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:14.129309 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b90c9-4a56-492b-a8a7-be807f4a5cba None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:14.145975 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0ac60-73f9-4b6a-98a1-d2fa44d8cfcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:14.146847 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0ac60-73f9-4b6a-98a1-d2fa44d8cfcd None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:14.147123 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0ac60-73f9-4b6a-98a1-d2fa44d8cfcd None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:14.147393 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0ac60-73f9-4b6a-98a1-d2fa44d8cfcd None admin] PATH_INFO: `/v3/projects/437ab37ab6104629b1199c45fdd0b804` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:14.148612 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a0ac60-73f9-4b6a-98a1-d2fa44d8cfcd None admin] RBAC: Authorizing `identity:get_project(project_id=437ab37ab6104629b1199c45fdd0b804)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:14.150446 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a0ac60-73f9-4b6a-98a1-d2fa44d8cfcd None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:14.152569 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 215/426] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:45:13 2022] GET /identity/v3/projects/437ab37ab6104629b1199c45fdd0b804 => generated 298 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:45:14.157719 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0ac60-73f9-4b6a-98a1-d2fa44d8cfcd None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:14.183079 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:14.190759 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecefaa66-9eb8-4381-a550-1a76f81daaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:14.191655 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefaa66-9eb8-4381-a550-1a76f81daaa5 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:14.191939 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefaa66-9eb8-4381-a550-1a76f81daaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:14.192220 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefaa66-9eb8-4381-a550-1a76f81daaa5 None admin] PATH_INFO: `/v3/projects/437ab37ab6104629b1199c45fdd0b804` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:14.193435 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecefaa66-9eb8-4381-a550-1a76f81daaa5 None admin] RBAC: Authorizing `identity:get_project(project_id=437ab37ab6104629b1199c45fdd0b804)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:14.194885 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecefaa66-9eb8-4381-a550-1a76f81daaa5 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:14.205158 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 212/427] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:45:13 2022] GET /identity/v3/projects/437ab37ab6104629b1199c45fdd0b804 => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:45:14.211037 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecefaa66-9eb8-4381-a550-1a76f81daaa5 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:14.310228 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0ac60-73f9-4b6a-98a1-d2fa44d8cfcd None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:14.318051 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:14.356033 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecefaa66-9eb8-4381-a550-1a76f81daaa5 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:14.396481 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a52ae-48d4-4da7-838a-11afe6425da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:14.398004 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a52ae-48d4-4da7-838a-11afe6425da1 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:14.398999 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a52ae-48d4-4da7-838a-11afe6425da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:14.399815 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699d93f-e995-49a5-88c2-c376d597b994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:14.399937 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a52ae-48d4-4da7-838a-11afe6425da1 None admin] PATH_INFO: `/v3/groups/b4219b09bb644bd88819e4cb2f7e6f93` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:14.401260 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699d93f-e995-49a5-88c2-c376d597b994 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:14.401731 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699d93f-e995-49a5-88c2-c376d597b994 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:14.402192 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699d93f-e995-49a5-88c2-c376d597b994 None admin] PATH_INFO: `/v3/groups/b4219b09bb644bd88819e4cb2f7e6f93` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:14.403586 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3699d93f-e995-49a5-88c2-c376d597b994 None admin] RBAC: Authorizing `identity:get_group(group_id=b4219b09bb644bd88819e4cb2f7e6f93)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:14.404241 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a52ae-48d4-4da7-838a-11afe6425da1 None admin] RBAC: Authorizing `identity:get_group(group_id=b4219b09bb644bd88819e4cb2f7e6f93)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:14.405464 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3699d93f-e995-49a5-88c2-c376d597b994 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:14.405683 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a52ae-48d4-4da7-838a-11afe6425da1 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:14.407539 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 213/428] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Jun 3 11:45:14 2022] GET /identity/v3/groups/b4219b09bb644bd88819e4cb2f7e6f93 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:45:14.408252 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 216/429] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Jun 3 11:45:14 2022] GET /identity/v3/groups/b4219b09bb644bd88819e4cb2f7e6f93 => generated 226 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:45:14.413242 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a52ae-48d4-4da7-838a-11afe6425da1 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:14.414288 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699d93f-e995-49a5-88c2-c376d597b994 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:14.512780 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:14.524732 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699d93f-e995-49a5-88c2-c376d597b994 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:14.562623 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceece94a-aa62-42f2-bdd5-c72859f989ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:14.563730 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceece94a-aa62-42f2-bdd5-c72859f989ce None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:14.564303 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceece94a-aa62-42f2-bdd5-c72859f989ce None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:14.565684 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceece94a-aa62-42f2-bdd5-c72859f989ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:14.566707 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceece94a-aa62-42f2-bdd5-c72859f989ce None admin] RBAC: Adding query filter params (group.id=b4219b09bb644bd88819e4cb2f7e6f93, role.id=781e2d573ee94afaae05b3cc0bba8768, scope.project.id=437ab37ab6104629b1199c45fdd0b804) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:14.567232 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceece94a-aa62-42f2-bdd5-c72859f989ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:14.568820 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a52ae-48d4-4da7-838a-11afe6425da1 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:14.569100 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceece94a-aa62-42f2-bdd5-c72859f989ce None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:14.583566 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 217/430] 10.222.0.15 () {56 vars in 1376 bytes} [Fri Jun 3 11:45:14 2022] GET /identity/v3/role_assignments?group.id=b4219b09bb644bd88819e4cb2f7e6f93&scope.project.id=437ab37ab6104629b1199c45fdd0b804&role.id=781e2d573ee94afaae05b3cc0bba8768 => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:45:14.583566 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b1be8-9c84-4d43-935c-b52e56223a7f None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:14.583566 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b1be8-9c84-4d43-935c-b52e56223a7f None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:14.583566 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b1be8-9c84-4d43-935c-b52e56223a7f None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:14.585227 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 218/431] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:45:14.586711 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf47b1-6829-429e-a692-0c8b1d03a11b None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:14.587000 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf47b1-6829-429e-a692-0c8b1d03a11b None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:14.587281 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf47b1-6829-429e-a692-0c8b1d03a11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:14.608064 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-faaf47b1-6829-429e-a692-0c8b1d03a11b None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:14.609669 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-faaf47b1-6829-429e-a692-0c8b1d03a11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:14.631242 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f525ed-f86c-42f4-9f59-28135b8485a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:14.631966 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f525ed-f86c-42f4-9f59-28135b8485a6 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:14.632251 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f525ed-f86c-42f4-9f59-28135b8485a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:14.632527 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f525ed-f86c-42f4-9f59-28135b8485a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:14.633376 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f525ed-f86c-42f4-9f59-28135b8485a6 None admin] RBAC: Adding query filter params (group.id=b4219b09bb644bd88819e4cb2f7e6f93, role.id=5d1199580aaa485bb120b35e6f771ff9, scope.project.id=437ab37ab6104629b1199c45fdd0b804) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:14.633693 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f525ed-f86c-42f4-9f59-28135b8485a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:14.635249 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f525ed-f86c-42f4-9f59-28135b8485a6 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:14.643883 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:14.648050 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 214/432] 10.222.0.15 () {56 vars in 1376 bytes} [Fri Jun 3 11:45:14 2022] GET /identity/v3/role_assignments?group.id=b4219b09bb644bd88819e4cb2f7e6f93&scope.project.id=437ab37ab6104629b1199c45fdd0b804&role.id=5d1199580aaa485bb120b35e6f771ff9 => generated 611 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:14.649579 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42523a84-9c5d-4aa2-9459-d8e7a9c34b66 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:14.651653 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42523a84-9c5d-4aa2-9459-d8e7a9c34b66 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:14.651653 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42523a84-9c5d-4aa2-9459-d8e7a9c34b66 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:14.656871 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 215/433] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:45:14.662239 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a35b4c-e52b-4ee6-a0cd-f41926703ac2 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:14.662551 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a35b4c-e52b-4ee6-a0cd-f41926703ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:14.662810 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a35b4c-e52b-4ee6-a0cd-f41926703ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:14.705914 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-29a35b4c-e52b-4ee6-a0cd-f41926703ac2 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:14.707261 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-29a35b4c-e52b-4ee6-a0cd-f41926703ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:14.714349 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 219/434] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:45:14.755698 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf47b1-6829-429e-a692-0c8b1d03a11b None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:14.787705 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 216/435] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:45:14.828654 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a35b4c-e52b-4ee6-a0cd-f41926703ac2 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:14.909044 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf47b1-6829-429e-a692-0c8b1d03a11b None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:14.959837 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad5918-bb4b-4d9b-9f6f-190c9d3a86d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:14.960649 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad5918-bb4b-4d9b-9f6f-190c9d3a86d8 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:14.960930 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad5918-bb4b-4d9b-9f6f-190c9d3a86d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:14.961266 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad5918-bb4b-4d9b-9f6f-190c9d3a86d8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:14.974415 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad5918-bb4b-4d9b-9f6f-190c9d3a86d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:45:14.980394 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:14.984894 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a35b4c-e52b-4ee6-a0cd-f41926703ac2 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:14.985511 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-26ad5918-bb4b-4d9b-9f6f-190c9d3a86d8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 03 11:45:14.985511 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:14.985511 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:14.985511 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:14.985511 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:14.985511 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:14.985511 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:14.985511 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:14.985511 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:14.985511 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:14.985511 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:14.985511 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:14.985511 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:45:14.985511 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:45:14.985511 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:45:14.985511 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:45:14.987059 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:45:14.987059 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:45:14.987059 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:45:14.987059 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:45:14.987059 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:14.987059 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:14.987059 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:14.987059 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:14.987059 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:14.987059 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:14.987059 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:14.987059 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:14.987059 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:14.987059 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:14.987059 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:14.987059 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:14.988264 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:14.988264 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:14.988264 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:14.988264 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:14.988264 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:45:14.988264 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:45:14.988264 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:45:14.988264 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:45:14.988264 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:45:14.988264 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:45:14.988264 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 03 11:45:14.988264 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:14.990850 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 220/436] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:45:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:45:14.996155 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad5918-bb4b-4d9b-9f6f-190c9d3a86d8 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:15.030699 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:15.039906 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7799640-69bd-4dbb-826d-59e1ef69c85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:15.041010 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7799640-69bd-4dbb-826d-59e1ef69c85f None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:15.041483 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7799640-69bd-4dbb-826d-59e1ef69c85f None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:15.042116 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7799640-69bd-4dbb-826d-59e1ef69c85f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:15.057681 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7799640-69bd-4dbb-826d-59e1ef69c85f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:45:15.069088 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-a7799640-69bd-4dbb-826d-59e1ef69c85f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 11:45:15.069088 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:15.069088 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:15.069088 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:15.069088 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:15.069088 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:15.069088 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:15.069088 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:15.069088 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:15.069088 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:15.069088 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:15.069088 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:15.069088 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:45:15.069088 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:45:15.069088 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:45:15.069088 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:45:15.069991 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:45:15.069991 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:45:15.069991 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:45:15.069991 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:45:15.069991 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:15.069991 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:15.069991 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:15.069991 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:15.069991 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:15.069991 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:15.069991 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:15.069991 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:15.069991 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:15.069991 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:15.069991 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:15.069991 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:15.071187 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:15.071187 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:15.071187 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:15.071187 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:15.071187 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:45:15.071187 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:45:15.071187 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:45:15.071187 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:45:15.071187 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:45:15.071187 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:45:15.071187 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 11:45:15.071187 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:15.071187 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 217/437] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Jun 3 11:45:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:15.076001 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7799640-69bd-4dbb-826d-59e1ef69c85f None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:15.136511 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad5918-bb4b-4d9b-9f6f-190c9d3a86d8 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:15.180790 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4de0be3-16dc-472d-8247-baff4d3b76c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:15.181658 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de0be3-16dc-472d-8247-baff4d3b76c1 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:15.181952 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de0be3-16dc-472d-8247-baff4d3b76c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:15.182614 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de0be3-16dc-472d-8247-baff4d3b76c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:15.183383 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4de0be3-16dc-472d-8247-baff4d3b76c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:15.183727 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4de0be3-16dc-472d-8247-baff4d3b76c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:15.185115 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4de0be3-16dc-472d-8247-baff4d3b76c1 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:15.199130 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 221/438] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 3 11:45:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:45:15.202397 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4de0be3-16dc-472d-8247-baff4d3b76c1 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:15.208323 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7799640-69bd-4dbb-826d-59e1ef69c85f None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:15.212446 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:15.248419 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa1b1c-50de-4fa0-83cd-d1bb4f717b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:15.249091 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa1b1c-50de-4fa0-83cd-d1bb4f717b14 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:15.249370 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa1b1c-50de-4fa0-83cd-d1bb4f717b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:15.249669 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa1b1c-50de-4fa0-83cd-d1bb4f717b14 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:15.250408 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa1b1c-50de-4fa0-83cd-d1bb4f717b14 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:15.250703 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa1b1c-50de-4fa0-83cd-d1bb4f717b14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:15.252170 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa1b1c-50de-4fa0-83cd-d1bb4f717b14 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:15.261352 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 218/439] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:45:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:15.262622 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b536df-a2d1-43ec-a138-4c3576080ff9 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:15.262983 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b536df-a2d1-43ec-a138-4c3576080ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:15.263268 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b536df-a2d1-43ec-a138-4c3576080ff9 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:15.264531 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 219/440] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:45:15.266741 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b536df-a2d1-43ec-a138-4c3576080ff9 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:15.329253 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:15.329959 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4de0be3-16dc-472d-8247-baff4d3b76c1 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:15.370430 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b2ccc-8ef0-4f20-b036-9743ac1c80dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:15.371083 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b2ccc-8ef0-4f20-b036-9743ac1c80dd None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:15.371366 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b2ccc-8ef0-4f20-b036-9743ac1c80dd None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:15.371681 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b2ccc-8ef0-4f20-b036-9743ac1c80dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:15.382437 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b536df-a2d1-43ec-a138-4c3576080ff9 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:15.416538 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feaed7a-c406-4028-bd2f-145e45afe553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:15.417179 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feaed7a-c406-4028-bd2f-145e45afe553 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:15.417464 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feaed7a-c406-4028-bd2f-145e45afe553 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:15.417743 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feaed7a-c406-4028-bd2f-145e45afe553 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:15.440545 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b2ccc-8ef0-4f20-b036-9743ac1c80dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:15.441961 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b2ccc-8ef0-4f20-b036-9743ac1c80dd None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:15.449407 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:15.484791 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feaed7a-c406-4028-bd2f-145e45afe553 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:15.486225 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feaed7a-c406-4028-bd2f-145e45afe553 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:15.536511 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:15.540918 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 222/441] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:45:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 11:45:15.542180 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077db26-7320-49dc-97d5-314e86fcf3e2 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:15.542473 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077db26-7320-49dc-97d5-314e86fcf3e2 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:15.542754 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077db26-7320-49dc-97d5-314e86fcf3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:15.560590 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-5077db26-7320-49dc-97d5-314e86fcf3e2 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:15.561768 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-5077db26-7320-49dc-97d5-314e86fcf3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:15.585530 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 220/442] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:45:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 11:45:15.586360 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feaed7a-c406-4028-bd2f-145e45afe553 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:15.633178 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 223/443] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:45:15.634006 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077db26-7320-49dc-97d5-314e86fcf3e2 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:15.668703 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:15.692888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feaed7a-c406-4028-bd2f-145e45afe553 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:15.726600 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53a25b-eddd-486d-96a1-72545449fe81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:15.727448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53a25b-eddd-486d-96a1-72545449fe81 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:15.727766 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53a25b-eddd-486d-96a1-72545449fe81 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:15.728035 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53a25b-eddd-486d-96a1-72545449fe81 None admin] PATH_INFO: `/v3/projects/deb1496445dd47a6ba9ad9fb02737115` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:15.729221 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a53a25b-eddd-486d-96a1-72545449fe81 None admin] RBAC: Authorizing `identity:get_project(project_id=deb1496445dd47a6ba9ad9fb02737115)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:15.730663 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a53a25b-eddd-486d-96a1-72545449fe81 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:15.732361 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 221/444] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:45:15 2022] GET /identity/v3/projects/deb1496445dd47a6ba9ad9fb02737115 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:15.732651 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077db26-7320-49dc-97d5-314e86fcf3e2 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:15.733119 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53a25b-eddd-486d-96a1-72545449fe81 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:15.754303 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:15.766886 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a4c30-c331-4568-9bef-e9daad844ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:15.768321 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a4c30-c331-4568-9bef-e9daad844ace None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:15.768602 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a4c30-c331-4568-9bef-e9daad844ace None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:15.768874 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a4c30-c331-4568-9bef-e9daad844ace None admin] PATH_INFO: `/v3/projects/deb1496445dd47a6ba9ad9fb02737115` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:15.770049 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a4c30-c331-4568-9bef-e9daad844ace None admin] RBAC: Authorizing `identity:get_project(project_id=deb1496445dd47a6ba9ad9fb02737115)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:15.771485 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a4c30-c331-4568-9bef-e9daad844ace None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:15.773183 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 224/445] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:45:15 2022] GET /identity/v3/projects/deb1496445dd47a6ba9ad9fb02737115 => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:15.773938 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a4c30-c331-4568-9bef-e9daad844ace None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:15.830975 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53a25b-eddd-486d-96a1-72545449fe81 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:15.863804 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd688d9-ed41-4828-a55a-a88f53f64f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:15.864582 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd688d9-ed41-4828-a55a-a88f53f64f95 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:15.864868 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd688d9-ed41-4828-a55a-a88f53f64f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:15.865142 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd688d9-ed41-4828-a55a-a88f53f64f95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:15.871158 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a4c30-c331-4568-9bef-e9daad844ace None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:15.873493 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:15.875121 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd688d9-ed41-4828-a55a-a88f53f64f95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:45:15.882776 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-7cd688d9-ed41-4828-a55a-a88f53f64f95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:45:15.882776 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:15.882776 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:15.882776 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:15.882776 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:15.882776 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:15.882776 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:15.882776 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:15.882776 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:15.882776 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:15.882776 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:15.882776 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:15.882776 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:45:15.882776 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:45:15.882776 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:45:15.882776 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:45:15.883700 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:45:15.883700 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:45:15.883700 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:45:15.883700 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:45:15.883700 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:15.883700 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:15.883700 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:15.883700 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:15.883700 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:15.883700 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:15.883700 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:15.883700 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:15.883700 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:15.883700 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:15.883700 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:15.883700 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:15.884505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:15.884505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:15.884505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:15.884505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:15.884505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:45:15.884505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:45:15.884505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:45:15.884505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:45:15.884505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:45:15.884505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:45:15.884505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:45:15.884505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:15.884505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 222/446] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 3 11:45:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:15.885179 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd688d9-ed41-4828-a55a-a88f53f64f95 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:15.911736 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc874c-55e0-4566-ae57-0dd44e7b63f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:15.912596 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc874c-55e0-4566-ae57-0dd44e7b63f7 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:15.912875 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc874c-55e0-4566-ae57-0dd44e7b63f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:15.913145 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc874c-55e0-4566-ae57-0dd44e7b63f7 None admin] PATH_INFO: `/v3/groups/b4219b09bb644bd88819e4cb2f7e6f93` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:15.914317 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edc874c-55e0-4566-ae57-0dd44e7b63f7 None admin] RBAC: Authorizing `identity:get_group(group_id=b4219b09bb644bd88819e4cb2f7e6f93)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:15.915786 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edc874c-55e0-4566-ae57-0dd44e7b63f7 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:15.917388 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 225/447] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Jun 3 11:45:15 2022] GET /identity/v3/groups/b4219b09bb644bd88819e4cb2f7e6f93 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:15.918137 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc874c-55e0-4566-ae57-0dd44e7b63f7 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:15.968445 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:15.987482 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd688d9-ed41-4828-a55a-a88f53f64f95 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:16.015585 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc874c-55e0-4566-ae57-0dd44e7b63f7 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:16.020668 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407a415-b166-4fcd-83f3-70b3f5e3b786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:16.021516 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407a415-b166-4fcd-83f3-70b3f5e3b786 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:16.021798 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407a415-b166-4fcd-83f3-70b3f5e3b786 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:16.022072 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407a415-b166-4fcd-83f3-70b3f5e3b786 None admin] PATH_INFO: `/v3/groups/b4219b09bb644bd88819e4cb2f7e6f93` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:16.023245 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407a415-b166-4fcd-83f3-70b3f5e3b786 None admin] RBAC: Authorizing `identity:get_group(group_id=b4219b09bb644bd88819e4cb2f7e6f93)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:16.024720 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407a415-b166-4fcd-83f3-70b3f5e3b786 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:16.026576 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 223/448] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Jun 3 11:45:15 2022] GET /identity/v3/groups/b4219b09bb644bd88819e4cb2f7e6f93 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:16.027322 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407a415-b166-4fcd-83f3-70b3f5e3b786 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:16.048327 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379f2d5-b745-49cb-a9ac-26eb7648183f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:16.049510 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379f2d5-b745-49cb-a9ac-26eb7648183f None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:16.049790 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379f2d5-b745-49cb-a9ac-26eb7648183f None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:16.050067 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379f2d5-b745-49cb-a9ac-26eb7648183f None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:16.050794 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b379f2d5-b745-49cb-a9ac-26eb7648183f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:16.051195 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b379f2d5-b745-49cb-a9ac-26eb7648183f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:16.052591 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b379f2d5-b745-49cb-a9ac-26eb7648183f None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:16.060367 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 226/449] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:45:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:16.061124 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379f2d5-b745-49cb-a9ac-26eb7648183f None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:16.095171 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:16.129331 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407a415-b166-4fcd-83f3-70b3f5e3b786 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:16.161472 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379f2d5-b745-49cb-a9ac-26eb7648183f None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:16.163389 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27df0b-2b83-4c49-a98b-49b934ee1d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:16.164062 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27df0b-2b83-4c49-a98b-49b934ee1d13 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:16.164343 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27df0b-2b83-4c49-a98b-49b934ee1d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:16.164618 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27df0b-2b83-4c49-a98b-49b934ee1d13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:16.165434 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe27df0b-2b83-4c49-a98b-49b934ee1d13 None admin] RBAC: Adding query filter params (group.id=b4219b09bb644bd88819e4cb2f7e6f93, role.id=781e2d573ee94afaae05b3cc0bba8768, scope.project.id=deb1496445dd47a6ba9ad9fb02737115) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:16.165745 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe27df0b-2b83-4c49-a98b-49b934ee1d13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:16.167168 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe27df0b-2b83-4c49-a98b-49b934ee1d13 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:16.172883 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 224/450] 10.222.0.15 () {56 vars in 1376 bytes} [Fri Jun 3 11:45:16 2022] GET /identity/v3/role_assignments?group.id=b4219b09bb644bd88819e4cb2f7e6f93&scope.project.id=deb1496445dd47a6ba9ad9fb02737115&role.id=781e2d573ee94afaae05b3cc0bba8768 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:16.173647 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27df0b-2b83-4c49-a98b-49b934ee1d13 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:16.190838 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:16.208559 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804bc68-b69d-47c9-b814-83b3de613233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:16.209238 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804bc68-b69d-47c9-b814-83b3de613233 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:16.209520 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804bc68-b69d-47c9-b814-83b3de613233 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:16.209835 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804bc68-b69d-47c9-b814-83b3de613233 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:16.210761 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804bc68-b69d-47c9-b814-83b3de613233 None admin] RBAC: Adding query filter params (group.id=b4219b09bb644bd88819e4cb2f7e6f93, role.id=5d1199580aaa485bb120b35e6f771ff9, scope.project.id=deb1496445dd47a6ba9ad9fb02737115) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:16.210940 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804bc68-b69d-47c9-b814-83b3de613233 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:16.212458 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804bc68-b69d-47c9-b814-83b3de613233 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:16.219483 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 227/451] 10.222.0.15 () {56 vars in 1376 bytes} [Fri Jun 3 11:45:16 2022] GET /identity/v3/role_assignments?group.id=b4219b09bb644bd88819e4cb2f7e6f93&scope.project.id=deb1496445dd47a6ba9ad9fb02737115&role.id=5d1199580aaa485bb120b35e6f771ff9 => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:16.295688 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27df0b-2b83-4c49-a98b-49b934ee1d13 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:16.334964 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097934d0-d5d1-47a2-a890-75aabf48a75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:16.335691 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097934d0-d5d1-47a2-a890-75aabf48a75b None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:16.335964 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097934d0-d5d1-47a2-a890-75aabf48a75b None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:16.336241 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097934d0-d5d1-47a2-a890-75aabf48a75b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:16.414035 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097934d0-d5d1-47a2-a890-75aabf48a75b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:16.415944 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097934d0-d5d1-47a2-a890-75aabf48a75b None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:16.431888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:16.522676 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 225/452] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:45:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 11:45:16.528453 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804bc68-b69d-47c9-b814-83b3de613233 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:16.626651 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:16.630661 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804bc68-b69d-47c9-b814-83b3de613233 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:16.665475 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5654cf-486b-4565-9b89-50fa5c0df814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:16.666350 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5654cf-486b-4565-9b89-50fa5c0df814 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:16.666631 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5654cf-486b-4565-9b89-50fa5c0df814 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:16.666908 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5654cf-486b-4565-9b89-50fa5c0df814 None admin] PATH_INFO: `/v3/projects/6db62e59d8164100b9d96eb446461cfc` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:16.668135 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5654cf-486b-4565-9b89-50fa5c0df814 None admin] RBAC: Authorizing `identity:get_project(project_id=6db62e59d8164100b9d96eb446461cfc)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:16.669574 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5654cf-486b-4565-9b89-50fa5c0df814 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:16.671263 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 228/453] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:45:16 2022] GET /identity/v3/projects/6db62e59d8164100b9d96eb446461cfc => generated 344 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:16.676974 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097934d0-d5d1-47a2-a890-75aabf48a75b None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:16.779327 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097934d0-d5d1-47a2-a890-75aabf48a75b None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:16.792594 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:16.812959 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3acf743-850c-4533-bbe4-4b273bde798e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:16.813792 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3acf743-850c-4533-bbe4-4b273bde798e None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:16.814073 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3acf743-850c-4533-bbe4-4b273bde798e None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:16.814348 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3acf743-850c-4533-bbe4-4b273bde798e None admin] PATH_INFO: `/v3/groups/610b0482dcf74f368f5c5620936603fe` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:16.815552 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3acf743-850c-4533-bbe4-4b273bde798e None admin] RBAC: Authorizing `identity:get_group(group_id=610b0482dcf74f368f5c5620936603fe)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:16.817003 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3acf743-850c-4533-bbe4-4b273bde798e None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:16.818598 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 226/454] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Jun 3 11:45:16 2022] GET /identity/v3/groups/610b0482dcf74f368f5c5620936603fe => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:16.824398 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5654cf-486b-4565-9b89-50fa5c0df814 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:16.923005 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5654cf-486b-4565-9b89-50fa5c0df814 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:16.955086 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7dcd1a-63bb-4dd1-9a69-43ae226ee7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:16.956295 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7dcd1a-63bb-4dd1-9a69-43ae226ee7fb None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:16.956582 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7dcd1a-63bb-4dd1-9a69-43ae226ee7fb None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:16.956860 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7dcd1a-63bb-4dd1-9a69-43ae226ee7fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:16.957687 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7dcd1a-63bb-4dd1-9a69-43ae226ee7fb None admin] RBAC: Adding query filter params (group.id=610b0482dcf74f368f5c5620936603fe, role.id=c486e164840b41a59fd118dece2ce572, scope.project.id=6db62e59d8164100b9d96eb446461cfc) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:16.958002 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7dcd1a-63bb-4dd1-9a69-43ae226ee7fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:16.959424 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7dcd1a-63bb-4dd1-9a69-43ae226ee7fb None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:16.965098 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 229/455] 10.222.0.15 () {56 vars in 1376 bytes} [Fri Jun 3 11:45:16 2022] GET /identity/v3/role_assignments?group.id=610b0482dcf74f368f5c5620936603fe&scope.project.id=6db62e59d8164100b9d96eb446461cfc&role.id=c486e164840b41a59fd118dece2ce572 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:19.582042 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb3064-fae8-4cc5-8d18-c1575545f32d None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:19.582565 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb3064-fae8-4cc5-8d18-c1575545f32d None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:19.582565 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb3064-fae8-4cc5-8d18-c1575545f32d None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:19.584220 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 227/456] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:45:19.589875 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff33d75-4d0b-4406-978f-68b60e642ab6 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:19.590648 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff33d75-4d0b-4406-978f-68b60e642ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:19.591096 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff33d75-4d0b-4406-978f-68b60e642ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:19.616230 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-5ff33d75-4d0b-4406-978f-68b60e642ab6 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:19.617439 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-5ff33d75-4d0b-4406-978f-68b60e642ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:19.654995 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:19.712142 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 230/457] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 11:45:19.748846 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb3064-fae8-4cc5-8d18-c1575545f32d None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:19.802021 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc247d-4393-4814-a0a4-4d2313f7b5b0 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:19.802341 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc247d-4393-4814-a0a4-4d2313f7b5b0 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:19.802582 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc247d-4393-4814-a0a4-4d2313f7b5b0 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:19.803986 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 231/458] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:45:19.842290 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b99fe0-9be7-4c51-9d3f-261ac238a192 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:19.842499 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b99fe0-9be7-4c51-9d3f-261ac238a192 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:19.842928 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b99fe0-9be7-4c51-9d3f-261ac238a192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:19.876726 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-30b99fe0-9be7-4c51-9d3f-261ac238a192 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:19.877994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-30b99fe0-9be7-4c51-9d3f-261ac238a192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:19.912143 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb3064-fae8-4cc5-8d18-c1575545f32d None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:19.979647 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee07f5e-2662-47ec-8d65-f3b03c879a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:19.980677 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee07f5e-2662-47ec-8d65-f3b03c879a51 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:19.981100 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee07f5e-2662-47ec-8d65-f3b03c879a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:19.981538 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee07f5e-2662-47ec-8d65-f3b03c879a51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:20.002272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee07f5e-2662-47ec-8d65-f3b03c879a51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:20.004034 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee07f5e-2662-47ec-8d65-f3b03c879a51 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:20.032283 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-aee07f5e-2662-47ec-8d65-f3b03c879a51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:20.032283 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:20.032283 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:20.032283 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:20.032283 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:20.032283 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:20.032283 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:20.032283 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:20.032283 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:20.032283 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:20.032283 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:20.032283 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:20.032283 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:20.032283 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:20.032283 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:20.033890 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:20.033890 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:20.033890 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:20.033890 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:20.033890 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:20.033890 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:20.033890 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:20.033890 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:20.033890 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:20.033890 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:20.033890 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:20.033890 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:20.033890 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:20.033890 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:20.033890 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:20.033890 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:20.033890 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:20.034925 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:20.034925 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:20.034925 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:20.034925 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:20.036905 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 232/459] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:45:20.038594 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 228/460] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:20.044707 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b99fe0-9be7-4c51-9d3f-261ac238a192 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:20.064852 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee07f5e-2662-47ec-8d65-f3b03c879a51 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:20.147606 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:20.155869 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:20.164173 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b99fe0-9be7-4c51-9d3f-261ac238a192 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:20.271345 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee07f5e-2662-47ec-8d65-f3b03c879a51 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:20.276224 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62973446-fa4a-410e-814c-af232a2a1960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:20.276917 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62973446-fa4a-410e-814c-af232a2a1960 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:20.277210 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62973446-fa4a-410e-814c-af232a2a1960 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:20.277489 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62973446-fa4a-410e-814c-af232a2a1960 None admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:20.278232 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62973446-fa4a-410e-814c-af232a2a1960 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:20.278543 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62973446-fa4a-410e-814c-af232a2a1960 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:20.280048 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62973446-fa4a-410e-814c-af232a2a1960 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:20.319559 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 233/461] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:45:20.321465 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb171c-13cc-4947-b3d4-79844adc93a1 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:20.321863 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb171c-13cc-4947-b3d4-79844adc93a1 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:20.322248 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb171c-13cc-4947-b3d4-79844adc93a1 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:20.328724 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea63c25-d4cd-49dc-947e-0c6d4f6dabac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:20.328724 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea63c25-d4cd-49dc-947e-0c6d4f6dabac None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:20.328969 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 234/462] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:45:20.329056 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea63c25-d4cd-49dc-947e-0c6d4f6dabac None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:20.329056 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea63c25-d4cd-49dc-947e-0c6d4f6dabac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:20.329201 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849be2a7-93aa-46ca-98dd-ddb3c97501d4 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:20.329575 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849be2a7-93aa-46ca-98dd-ddb3c97501d4 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:20.329947 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849be2a7-93aa-46ca-98dd-ddb3c97501d4 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:20.333398 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 235/463] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:45:20.333398 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849be2a7-93aa-46ca-98dd-ddb3c97501d4 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:20.357778 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea63c25-d4cd-49dc-947e-0c6d4f6dabac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:20.357778 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea63c25-d4cd-49dc-947e-0c6d4f6dabac None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:20.375747 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-aea63c25-d4cd-49dc-947e-0c6d4f6dabac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:20.375747 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:20.375747 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:20.375747 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:20.375747 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:20.375747 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:20.375747 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:20.375747 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:20.375747 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:20.375747 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:20.375747 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:20.375747 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:20.375747 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:20.375747 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:20.375747 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:20.376791 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:20.376791 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:20.376791 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:20.376791 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:20.376791 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:20.376791 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:20.376791 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:20.376791 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:20.376791 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:20.376791 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:20.376791 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:20.376791 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:20.376791 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:20.376791 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:20.376791 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:20.376791 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:20.376791 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:20.377892 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:20.377892 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:20.377892 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:20.377892 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:20.379408 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 229/464] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:20.380757 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc7eaf-af9c-412d-be84-d15693a672da None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:20.381041 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc7eaf-af9c-412d-be84-d15693a672da None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:20.381316 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc7eaf-af9c-412d-be84-d15693a672da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:20.401570 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-1efc7eaf-af9c-412d-be84-d15693a672da None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:20.402294 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-1efc7eaf-af9c-412d-be84-d15693a672da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:20.458214 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849be2a7-93aa-46ca-98dd-ddb3c97501d4 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:20.484766 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 230/465] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:45:20.486335 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728a6ce-94c7-40f9-bb6a-daeaa6d9743d None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:20.487251 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728a6ce-94c7-40f9-bb6a-daeaa6d9743d None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:20.487661 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728a6ce-94c7-40f9-bb6a-daeaa6d9743d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:20.498988 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f5b14-06db-4af8-9ae6-61ff315bde37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:20.500238 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f5b14-06db-4af8-9ae6-61ff315bde37 None admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:20.500778 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f5b14-06db-4af8-9ae6-61ff315bde37 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:20.501717 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f5b14-06db-4af8-9ae6-61ff315bde37 None admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:20.503009 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f5b14-06db-4af8-9ae6-61ff315bde37 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:20.504506 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f5b14-06db-4af8-9ae6-61ff315bde37 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:20.514072 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-3728a6ce-94c7-40f9-bb6a-daeaa6d9743d None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:20.516174 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-3728a6ce-94c7-40f9-bb6a-daeaa6d9743d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:20.529715 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:20.539536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 236/466] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Jun 3 11:45:20 2022] POST /identity/v3/users => generated 246 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:45:20.539536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f5b14-06db-4af8-9ae6-61ff315bde37 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:20.545798 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:20.616580 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 231/467] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:45:20.617937 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728a6ce-94c7-40f9-bb6a-daeaa6d9743d None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:20.724080 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f5b14-06db-4af8-9ae6-61ff315bde37 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:20.787996 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241df484-5d83-4a3e-8e46-2e3a3190947f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:20.788674 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241df484-5d83-4a3e-8e46-2e3a3190947f None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:20.788987 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241df484-5d83-4a3e-8e46-2e3a3190947f None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:20.789254 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241df484-5d83-4a3e-8e46-2e3a3190947f None admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:20.789969 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241df484-5d83-4a3e-8e46-2e3a3190947f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:20.790280 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241df484-5d83-4a3e-8e46-2e3a3190947f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:20.794265 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241df484-5d83-4a3e-8e46-2e3a3190947f None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:20.796450 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728a6ce-94c7-40f9-bb6a-daeaa6d9743d None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:20.812867 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 237/468] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:20.812867 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241df484-5d83-4a3e-8e46-2e3a3190947f None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:20.907928 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:20.938075 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241df484-5d83-4a3e-8e46-2e3a3190947f None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:20.957842 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2eb00f-cd1f-43ca-9aa8-78cef6645118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:20.958631 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2eb00f-cd1f-43ca-9aa8-78cef6645118 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:20.958908 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2eb00f-cd1f-43ca-9aa8-78cef6645118 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:20.959181 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2eb00f-cd1f-43ca-9aa8-78cef6645118 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:20.969906 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2eb00f-cd1f-43ca-9aa8-78cef6645118 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:20.971416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2eb00f-cd1f-43ca-9aa8-78cef6645118 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:20.974336 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:20.976228 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d762c6f-8fc4-4814-906e-396218452af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:20.977047 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d762c6f-8fc4-4814-906e-396218452af6 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:20.977326 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d762c6f-8fc4-4814-906e-396218452af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:20.977687 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d762c6f-8fc4-4814-906e-396218452af6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:20.989146 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d762c6f-8fc4-4814-906e-396218452af6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:20.990608 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d762c6f-8fc4-4814-906e-396218452af6 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:20.991540 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-6f2eb00f-cd1f-43ca-9aa8-78cef6645118 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:20.991540 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:20.991540 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:20.991540 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:20.991540 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:20.991540 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:20.991540 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:20.991540 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:20.991540 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:20.991540 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:20.991540 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:20.991540 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:20.991540 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:20.991540 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:20.991540 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:20.992525 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:20.992525 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:20.992525 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:20.992525 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:20.992525 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:20.992525 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:20.992525 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:20.992525 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:20.992525 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:20.992525 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:20.992525 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:20.992525 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:20.992525 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:20.992525 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:20.992525 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:20.992525 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:20.992525 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:20.993380 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:20.993380 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:20.993380 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:20.993380 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:20.993833 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 232/469] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:20.995535 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2eb00f-cd1f-43ca-9aa8-78cef6645118 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:21.012939 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-7d762c6f-8fc4-4814-906e-396218452af6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:21.012939 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:21.012939 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:21.012939 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:21.012939 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:21.012939 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:21.012939 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:21.012939 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:21.012939 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:21.012939 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:21.012939 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:21.012939 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:21.012939 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:21.012939 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:21.012939 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:21.014038 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:21.014038 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:21.014038 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:21.014038 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:21.014038 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:21.014038 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:21.014038 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:21.014038 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:21.014038 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:21.014038 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:21.014038 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:21.014038 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:21.014038 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:21.014038 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:21.014038 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:21.014038 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:21.014038 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:21.015097 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:21.015097 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:21.015097 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:21.015097 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:21.017198 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 238/470] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:21.018384 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d762c6f-8fc4-4814-906e-396218452af6 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:21.103496 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2eb00f-cd1f-43ca-9aa8-78cef6645118 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:21.139890 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093dfb00-7b7d-41a0-a072-241242a14cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:21.140653 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093dfb00-7b7d-41a0-a072-241242a14cf8 None admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:21.141004 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093dfb00-7b7d-41a0-a072-241242a14cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:21.141671 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093dfb00-7b7d-41a0-a072-241242a14cf8 None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:21.142086 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093dfb00-7b7d-41a0-a072-241242a14cf8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:21.143651 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093dfb00-7b7d-41a0-a072-241242a14cf8 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:21.157218 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d762c6f-8fc4-4814-906e-396218452af6 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:21.175532 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 233/471] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Jun 3 11:45:20 2022] POST /identity/v3/users => generated 248 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:45:21.175532 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093dfb00-7b7d-41a0-a072-241242a14cf8 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:21.200881 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:21.234742 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad31fe48-2e91-4079-8fc9-0db9bb9307ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:21.235350 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31fe48-2e91-4079-8fc9-0db9bb9307ed None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:21.235684 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31fe48-2e91-4079-8fc9-0db9bb9307ed None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:21.235968 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31fe48-2e91-4079-8fc9-0db9bb9307ed None admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:21.237324 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad31fe48-2e91-4079-8fc9-0db9bb9307ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:21.237638 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad31fe48-2e91-4079-8fc9-0db9bb9307ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:21.239893 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad31fe48-2e91-4079-8fc9-0db9bb9307ed None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:21.258160 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:21.262025 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 239/472] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:21.262025 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5087d6e-0980-4c6a-a48d-6d857b635a09 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:21.262025 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5087d6e-0980-4c6a-a48d-6d857b635a09 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:21.262025 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5087d6e-0980-4c6a-a48d-6d857b635a09 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:21.271536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 240/473] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:45:21.271536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5087d6e-0980-4c6a-a48d-6d857b635a09 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:21.334701 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093dfb00-7b7d-41a0-a072-241242a14cf8 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:21.379106 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1e501-f453-4199-a060-44dbc5be9d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:21.380397 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1e501-f453-4199-a060-44dbc5be9d8b None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:21.380397 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1e501-f453-4199-a060-44dbc5be9d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:21.380397 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1e501-f453-4199-a060-44dbc5be9d8b None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:21.381038 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1e501-f453-4199-a060-44dbc5be9d8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:21.381342 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1e501-f453-4199-a060-44dbc5be9d8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:21.384428 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1e501-f453-4199-a060-44dbc5be9d8b None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:21.397189 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 234/474] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:21.398471 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc39ef5-c944-49c7-9fb3-e4616704f961 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:21.398757 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc39ef5-c944-49c7-9fb3-e4616704f961 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:21.399032 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc39ef5-c944-49c7-9fb3-e4616704f961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:21.414707 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5087d6e-0980-4c6a-a48d-6d857b635a09 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:21.418404 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-3bc39ef5-c944-49c7-9fb3-e4616704f961 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:21.419659 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-3bc39ef5-c944-49c7-9fb3-e4616704f961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:21.456259 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089cd08e-5c10-4511-8bed-6f7dbd7b440e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:21.456935 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089cd08e-5c10-4511-8bed-6f7dbd7b440e None admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:21.457301 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089cd08e-5c10-4511-8bed-6f7dbd7b440e None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:21.457597 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089cd08e-5c10-4511-8bed-6f7dbd7b440e None admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:21.458242 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089cd08e-5c10-4511-8bed-6f7dbd7b440e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:21.459782 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089cd08e-5c10-4511-8bed-6f7dbd7b440e None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:21.484094 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 241/475] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Jun 3 11:45:21 2022] POST /identity/v3/users => generated 248 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:45:21.485077 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089cd08e-5c10-4511-8bed-6f7dbd7b440e None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:21.524390 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 235/476] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:45:21.562040 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc39ef5-c944-49c7-9fb3-e4616704f961 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:21.679990 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:21.686074 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:21.779903 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc39ef5-c944-49c7-9fb3-e4616704f961 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:21.793940 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089cd08e-5c10-4511-8bed-6f7dbd7b440e None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:21.826986 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837fa73-0d39-45ea-8a80-900c6553e12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:21.828302 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837fa73-0d39-45ea-8a80-900c6553e12a None admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:21.829200 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837fa73-0d39-45ea-8a80-900c6553e12a None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:21.829653 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837fa73-0d39-45ea-8a80-900c6553e12a None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:21.830708 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837fa73-0d39-45ea-8a80-900c6553e12a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:21.832603 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837fa73-0d39-45ea-8a80-900c6553e12a None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:21.838488 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b4265-9384-4447-9227-e8502a9ffb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:21.839375 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b4265-9384-4447-9227-e8502a9ffb81 None admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:21.839977 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b4265-9384-4447-9227-e8502a9ffb81 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:21.840475 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b4265-9384-4447-9227-e8502a9ffb81 None admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:21.841494 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b4265-9384-4447-9227-e8502a9ffb81 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:21.843723 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b4265-9384-4447-9227-e8502a9ffb81 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:21.846726 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.sql.core [None req-0837fa73-0d39-45ea-8a80-900c6553e12a None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 03 11:45:21.846726 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 03 11:45:21.846726 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [parameters: {'id': 'b55b77693d0f4cfb96ef7942a8f3782a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 03 11:45:21.846726 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80110) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 03 11:45:21.866413 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-0837fa73-0d39-45ea-8a80-900c6553e12a None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 03 11:45:21.866413 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:21.866413 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 03 11:45:21.866413 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 03 11:45:21.866413 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 03 11:45:21.866413 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 03 11:45:21.866413 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 03 11:45:21.866413 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application result = self._query(query) Jun 03 11:45:21.866413 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 03 11:45:21.866413 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application conn.query(q) Jun 03 11:45:21.866413 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 03 11:45:21.866413 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 03 11:45:21.866413 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 03 11:45:21.866413 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application result.read() Jun 03 11:45:21.866413 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 03 11:45:21.867336 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 03 11:45:21.867336 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 03 11:45:21.867336 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 03 11:45:21.867336 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 03 11:45:21.867336 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 03 11:45:21.867336 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 03 11:45:21.867336 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 03 11:45:21.867336 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 03 11:45:21.867336 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:21.867336 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 03 11:45:21.867336 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:21.867336 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:21.867336 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 03 11:45:21.867336 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 03 11:45:21.867336 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 03 11:45:21.867336 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return ref.to_dict() Jun 03 11:45:21.867336 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 03 11:45:21.867336 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application next(self.gen) Jun 03 11:45:21.869239 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 03 11:45:21.869239 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application yield resource Jun 03 11:45:21.869239 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 03 11:45:21.869239 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application next(self.gen) Jun 03 11:45:21.869239 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 03 11:45:21.869239 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self.session.rollback() Jun 03 11:45:21.869239 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 03 11:45:21.869239 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self.force_reraise() Jun 03 11:45:21.869239 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 03 11:45:21.869239 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise self.value Jun 03 11:45:21.869239 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 03 11:45:21.869239 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 03 11:45:21.869239 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 03 11:45:21.869239 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application session.commit() Jun 03 11:45:21.869239 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 03 11:45:21.869239 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 03 11:45:21.869239 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 03 11:45:21.870114 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._prepare_impl() Jun 03 11:45:21.870114 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 03 11:45:21.870114 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self.session.flush() Jun 03 11:45:21.870114 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 03 11:45:21.870114 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._flush(objects) Jun 03 11:45:21.870114 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 03 11:45:21.870114 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 03 11:45:21.870114 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 03 11:45:21.870114 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application compat.raise_( Jun 03 11:45:21.870114 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 03 11:45:21.870114 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception Jun 03 11:45:21.870114 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 03 11:45:21.870114 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application flush_context.execute() Jun 03 11:45:21.870114 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 03 11:45:21.870114 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rec.execute(self) Jun 03 11:45:21.870114 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 03 11:45:21.870114 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 03 11:45:21.870978 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 03 11:45:21.870978 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 03 11:45:21.870978 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 03 11:45:21.870978 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 03 11:45:21.870978 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 03 11:45:21.870978 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 03 11:45:21.870978 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 03 11:45:21.870978 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 03 11:45:21.870978 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 03 11:45:21.870978 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 03 11:45:21.870978 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 03 11:45:21.870978 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 03 11:45:21.870978 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 03 11:45:21.870978 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 03 11:45:21.870978 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 03 11:45:21.870978 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception Jun 03 11:45:21.873030 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 03 11:45:21.873030 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 03 11:45:21.873030 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 03 11:45:21.873030 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 03 11:45:21.873030 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 03 11:45:21.873030 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application result = self._query(query) Jun 03 11:45:21.873030 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 03 11:45:21.873030 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application conn.query(q) Jun 03 11:45:21.873030 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 03 11:45:21.873030 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 03 11:45:21.873030 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 03 11:45:21.873030 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application result.read() Jun 03 11:45:21.873030 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 03 11:45:21.873030 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 03 11:45:21.873030 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 03 11:45:21.873030 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 03 11:45:21.875145 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 03 11:45:21.875145 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 03 11:45:21.875145 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 03 11:45:21.875145 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 03 11:45:21.875145 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 03 11:45:21.875145 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 03 11:45:21.875145 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [parameters: {'id': 'b55b77693d0f4cfb96ef7942a8f3782a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 03 11:45:21.875145 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 03 11:45:21.875145 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:21.875145 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 11:45:21.875145 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:21.875145 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:21.875145 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:21.875145 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:21.875145 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:21.875145 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:21.877894 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:21.877894 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:21.877894 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:21.877894 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:21.877894 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:21.877894 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:21.877894 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 03 11:45:21.877894 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 03 11:45:21.877894 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:21.877894 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:21.877894 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 03 11:45:21.877894 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 03 11:45:21.877894 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 03 11:45:21.877894 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 03 11:45:21.877894 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 03 11:45:21.877894 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:21.880447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 236/477] 10.222.0.15 () {60 vars in 1131 bytes} [Fri Jun 3 11:45:21 2022] POST /identity/v3/roles => generated 144 bytes in 307 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:45:21.880447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837fa73-0d39-45ea-8a80-900c6553e12a None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:21.893935 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 242/478] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Jun 3 11:45:21 2022] POST /identity/v3/users => generated 249 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:45:22.007693 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837fa73-0d39-45ea-8a80-900c6553e12a None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:22.016075 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:22.053879 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08249c5a-0238-4d8c-ab7a-86dd5c311963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:22.055111 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08249c5a-0238-4d8c-ab7a-86dd5c311963 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:22.055623 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08249c5a-0238-4d8c-ab7a-86dd5c311963 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:22.056116 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08249c5a-0238-4d8c-ab7a-86dd5c311963 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:22.070547 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08249c5a-0238-4d8c-ab7a-86dd5c311963 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:45:22.079294 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-08249c5a-0238-4d8c-ab7a-86dd5c311963 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 11:45:22.079294 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:22.079294 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:22.079294 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:22.079294 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:22.079294 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:22.079294 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:22.079294 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:22.079294 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:22.079294 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:22.079294 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:22.079294 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:22.079294 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:45:22.079294 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:45:22.079294 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:45:22.079294 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:45:22.080455 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:45:22.080455 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:45:22.080455 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:45:22.080455 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:45:22.080455 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:22.080455 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:22.080455 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:22.080455 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:22.080455 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:22.080455 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:22.080455 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:22.080455 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:22.080455 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:22.080455 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:22.080455 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:22.080455 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:22.081441 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:22.081441 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:22.081441 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:22.081441 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:22.081441 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:45:22.081441 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:45:22.081441 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:45:22.081441 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:45:22.081441 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:45:22.081441 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:45:22.081441 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 03 11:45:22.081441 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:22.084087 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 237/479] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Jun 3 11:45:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:22.089921 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b4265-9384-4447-9227-e8502a9ffb81 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:22.188257 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:22.198494 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b4265-9384-4447-9227-e8502a9ffb81 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:22.234964 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c30ff-8314-42cf-b21f-c7933f29f230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:22.235670 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c30ff-8314-42cf-b21f-c7933f29f230 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:22.236003 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c30ff-8314-42cf-b21f-c7933f29f230 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:22.236309 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c30ff-8314-42cf-b21f-c7933f29f230 None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:22.237047 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c30ff-8314-42cf-b21f-c7933f29f230 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:22.237354 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c30ff-8314-42cf-b21f-c7933f29f230 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:22.238769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c30ff-8314-42cf-b21f-c7933f29f230 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:22.247293 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 243/480] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:45:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:23.239631 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d52d97-1210-4a9e-a6f9-1b06b32ecb24 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:23.240145 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d52d97-1210-4a9e-a6f9-1b06b32ecb24 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:23.240145 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d52d97-1210-4a9e-a6f9-1b06b32ecb24 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:23.241571 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 238/481] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:45:23.247058 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd583d2-6d40-43ca-bd66-9d6c68ea4fb3 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:23.247470 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd583d2-6d40-43ca-bd66-9d6c68ea4fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:23.247703 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd583d2-6d40-43ca-bd66-9d6c68ea4fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:23.265469 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-abd583d2-6d40-43ca-bd66-9d6c68ea4fb3 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:23.267069 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-abd583d2-6d40-43ca-bd66-9d6c68ea4fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:23.352542 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 244/482] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:45:23.378939 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d52d97-1210-4a9e-a6f9-1b06b32ecb24 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:23.499992 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d52d97-1210-4a9e-a6f9-1b06b32ecb24 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:23.551160 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2db01c-eb47-472d-9cf6-c1396563ab87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:23.552320 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2db01c-eb47-472d-9cf6-c1396563ab87 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:23.552826 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2db01c-eb47-472d-9cf6-c1396563ab87 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:23.553298 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2db01c-eb47-472d-9cf6-c1396563ab87 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:23.576393 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2db01c-eb47-472d-9cf6-c1396563ab87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:45:23.584547 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-1f2db01c-eb47-472d-9cf6-c1396563ab87 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 11:45:23.584547 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:23.584547 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:23.584547 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:23.584547 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:23.584547 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:23.584547 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:23.584547 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:23.584547 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:23.584547 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:23.584547 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:23.584547 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:23.584547 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:45:23.584547 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:45:23.584547 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:45:23.584547 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:45:23.585417 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:45:23.585417 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:45:23.585417 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:45:23.585417 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:45:23.585417 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:23.585417 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:23.585417 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:23.585417 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:23.585417 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:23.585417 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:23.585417 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:23.585417 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:23.585417 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:23.585417 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:23.585417 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:23.585417 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:23.586210 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:23.586210 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:23.586210 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:23.586210 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:23.586210 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:45:23.586210 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:45:23.586210 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:45:23.586210 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:45:23.586210 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:45:23.586210 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:45:23.586210 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 11:45:23.586210 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:23.588972 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 239/483] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Jun 3 11:45:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:23.594989 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd583d2-6d40-43ca-bd66-9d6c68ea4fb3 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:23.710329 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:23.734563 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd583d2-6d40-43ca-bd66-9d6c68ea4fb3 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:23.785374 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bea9de-d1fa-4e47-98e1-912d7c3f521b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:23.786407 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bea9de-d1fa-4e47-98e1-912d7c3f521b None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:23.786891 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bea9de-d1fa-4e47-98e1-912d7c3f521b None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:23.787368 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bea9de-d1fa-4e47-98e1-912d7c3f521b None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:23.788340 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bea9de-d1fa-4e47-98e1-912d7c3f521b None admin] RBAC: Adding query filter params (name=service) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:23.788845 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bea9de-d1fa-4e47-98e1-912d7c3f521b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:23.790447 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bea9de-d1fa-4e47-98e1-912d7c3f521b None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:23.803296 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 245/484] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Jun 3 11:45:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:23.809090 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2db01c-eb47-472d-9cf6-c1396563ab87 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:23.841323 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0f645-75bf-4d35-8de4-72312d4a44f1 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:23.841947 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0f645-75bf-4d35-8de4-72312d4a44f1 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:23.842421 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0f645-75bf-4d35-8de4-72312d4a44f1 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:23.844037 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 246/485] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 11:45:23.850621 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:23.860423 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c0f2c-6ed0-4cec-9b62-d101cfd50ff9 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:23.860984 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c0f2c-6ed0-4cec-9b62-d101cfd50ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:23.862022 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c0f2c-6ed0-4cec-9b62-d101cfd50ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:23.886308 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-761c0f2c-6ed0-4cec-9b62-d101cfd50ff9 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:23.889369 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-761c0f2c-6ed0-4cec-9b62-d101cfd50ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:23.995848 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 247/486] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 11:45:24.013487 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2db01c-eb47-472d-9cf6-c1396563ab87 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:24.019409 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c0f2c-6ed0-4cec-9b62-d101cfd50ff9 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:24.095823 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7035ef7-045d-4b89-987d-a630afa9f8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:24.096643 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7035ef7-045d-4b89-987d-a630afa9f8b7 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:24.097234 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7035ef7-045d-4b89-987d-a630afa9f8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:24.097517 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7035ef7-045d-4b89-987d-a630afa9f8b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:24.106269 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:24.112170 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7035ef7-045d-4b89-987d-a630afa9f8b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:24.113671 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7035ef7-045d-4b89-987d-a630afa9f8b7 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:24.137529 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-e7035ef7-045d-4b89-987d-a630afa9f8b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:24.137529 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:24.137529 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:24.137529 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:24.137529 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:24.137529 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:24.137529 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:24.137529 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:24.137529 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:24.137529 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:24.137529 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:24.137529 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:24.137529 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:24.137529 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:24.137529 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:24.138454 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:24.138454 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:24.138454 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:24.138454 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:24.138454 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:24.138454 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:24.138454 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:24.138454 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:24.138454 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:24.138454 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:24.138454 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:24.138454 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:24.138454 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:24.138454 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:24.138454 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:24.138454 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:24.138454 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:24.139315 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:24.139315 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:24.139315 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:24.139315 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:24.139315 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 240/487] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:24.144453 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7035ef7-045d-4b89-987d-a630afa9f8b7 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:24.193138 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c0f2c-6ed0-4cec-9b62-d101cfd50ff9 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:24.232322 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:24.257343 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7035ef7-045d-4b89-987d-a630afa9f8b7 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:24.283563 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81dd93-b9d5-4845-a575-471e8426d206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:24.284380 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81dd93-b9d5-4845-a575-471e8426d206 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:24.284661 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81dd93-b9d5-4845-a575-471e8426d206 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:24.284932 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81dd93-b9d5-4845-a575-471e8426d206 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:24.295687 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55752a3d-1dba-4f87-b57d-bfaf47a061ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:24.296349 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55752a3d-1dba-4f87-b57d-bfaf47a061ad None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:24.296631 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55752a3d-1dba-4f87-b57d-bfaf47a061ad None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:24.296907 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55752a3d-1dba-4f87-b57d-bfaf47a061ad None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:24.297633 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55752a3d-1dba-4f87-b57d-bfaf47a061ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:24.300639 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55752a3d-1dba-4f87-b57d-bfaf47a061ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:24.302015 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55752a3d-1dba-4f87-b57d-bfaf47a061ad None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:24.314260 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d81dd93-b9d5-4845-a575-471e8426d206 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:45:24.325560 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-3d81dd93-b9d5-4845-a575-471e8426d206 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 11:45:24.325560 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:24.325560 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:24.325560 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:24.325560 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:24.325560 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:24.325560 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:24.325560 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:24.325560 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:24.325560 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:24.325560 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:24.325560 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:24.325560 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:45:24.325560 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:45:24.325560 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:45:24.325560 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:45:24.327751 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:45:24.327751 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:45:24.327751 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:45:24.327751 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:45:24.327751 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:24.327751 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:24.327751 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:24.327751 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:24.327751 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:24.327751 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:24.327751 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:24.327751 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:24.327751 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:24.327751 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:24.327751 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:24.327751 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:24.329732 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:24.329732 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:24.329732 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:24.329732 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:24.329732 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:45:24.329732 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:45:24.329732 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:45:24.329732 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:45:24.329732 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:45:24.329732 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:45:24.329732 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 11:45:24.329732 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:24.334659 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 241/488] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:24.334928 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 248/489] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Jun 3 11:45:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:24.336487 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55752a3d-1dba-4f87-b57d-bfaf47a061ad None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:24.342238 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81dd93-b9d5-4845-a575-471e8426d206 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:24.457221 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55752a3d-1dba-4f87-b57d-bfaf47a061ad None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:24.512359 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba86bbe8-da38-45b6-a9df-2581b02e6fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:24.513031 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba86bbe8-da38-45b6-a9df-2581b02e6fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:24.513422 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba86bbe8-da38-45b6-a9df-2581b02e6fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:24.513705 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba86bbe8-da38-45b6-a9df-2581b02e6fa0 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:24.514562 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba86bbe8-da38-45b6-a9df-2581b02e6fa0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:24.514871 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba86bbe8-da38-45b6-a9df-2581b02e6fa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:24.516378 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba86bbe8-da38-45b6-a9df-2581b02e6fa0 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:24.522112 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:24.522859 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81dd93-b9d5-4845-a575-471e8426d206 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:24.526708 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 242/490] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Jun 3 11:45:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:45:24.528013 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57baa707-a3c0-48b2-8f6e-eaef42094519 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:24.528300 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57baa707-a3c0-48b2-8f6e-eaef42094519 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:24.528576 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57baa707-a3c0-48b2-8f6e-eaef42094519 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:24.539583 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 243/491] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:24 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:45:24.540635 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57baa707-a3c0-48b2-8f6e-eaef42094519 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:24.560059 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153148c8-2b2a-454d-8168-b8bcbbeee40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:24.560861 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153148c8-2b2a-454d-8168-b8bcbbeee40d None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:24.561306 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153148c8-2b2a-454d-8168-b8bcbbeee40d None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:24.561589 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153148c8-2b2a-454d-8168-b8bcbbeee40d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:24.563879 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:24.572044 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153148c8-2b2a-454d-8168-b8bcbbeee40d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:24.574313 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153148c8-2b2a-454d-8168-b8bcbbeee40d None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:24.593524 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-153148c8-2b2a-454d-8168-b8bcbbeee40d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 11:45:24.593524 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:24.593524 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:24.593524 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:24.593524 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:24.593524 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:24.593524 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:24.593524 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:24.593524 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:24.593524 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:24.593524 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:24.593524 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:24.593524 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 11:45:24.593524 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 11:45:24.593524 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 11:45:24.593524 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 11:45:24.594524 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:24.594524 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:24.594524 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 11:45:24.594524 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:45:24.594524 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 11:45:24.594524 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:45:24.594524 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:24.594524 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:24.594524 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:24.594524 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:24.594524 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:24.594524 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:24.594524 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:24.594524 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:24.594524 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:24.594524 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:24.594524 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:24.594524 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:24.595418 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:24.595418 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:24.595418 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 11:45:24.595418 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 11:45:24.595418 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 11:45:24.595418 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 11:45:24.595418 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 11:45:24.595418 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 11:45:24.595418 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 11:45:24.595418 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:24.596833 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 249/492] 10.222.0.15 () {56 vars in 1093 bytes} [Fri Jun 3 11:45:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:24.601458 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906c67e-8c06-4c88-9c55-92e0a5613dbd None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:24.601458 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906c67e-8c06-4c88-9c55-92e0a5613dbd None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:24.601458 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906c67e-8c06-4c88-9c55-92e0a5613dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:24.623924 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-8906c67e-8c06-4c88-9c55-92e0a5613dbd None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:24.626401 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-8906c67e-8c06-4c88-9c55-92e0a5613dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:24.661418 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57baa707-a3c0-48b2-8f6e-eaef42094519 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:24.701412 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ed1c4-9f8d-4f29-977a-00967577f635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:24.702356 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ed1c4-9f8d-4f29-977a-00967577f635 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:24.702640 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ed1c4-9f8d-4f29-977a-00967577f635 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:24.702914 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ed1c4-9f8d-4f29-977a-00967577f635 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:24.711081 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 250/493] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:45:24.711777 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8906c67e-8c06-4c88-9c55-92e0a5613dbd None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:24.726200 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98ed1c4-9f8d-4f29-977a-00967577f635 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:24.728010 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98ed1c4-9f8d-4f29-977a-00967577f635 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:24.759916 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-f98ed1c4-9f8d-4f29-977a-00967577f635 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:24.759916 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:24.759916 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:24.759916 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:24.759916 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:24.759916 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:24.759916 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:24.759916 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:24.759916 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:24.759916 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:24.759916 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:24.759916 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:24.759916 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:24.759916 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:24.759916 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:24.762047 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:24.762047 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:24.762047 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:24.762047 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:24.762047 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:24.762047 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:24.762047 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:24.762047 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:24.762047 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:24.762047 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:24.762047 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:24.762047 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:24.762047 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:24.762047 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:24.762047 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:24.762047 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:24.762047 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:24.764274 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:24.764274 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:24.764274 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:24.764274 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:24.764274 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 244/494] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:24.764274 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ed1c4-9f8d-4f29-977a-00967577f635 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:24.830684 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:24.849535 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8906c67e-8c06-4c88-9c55-92e0a5613dbd None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:24.877990 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:24.892990 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade809b5-390d-4037-a6f6-fca9685816cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:24.892990 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade809b5-390d-4037-a6f6-fca9685816cf None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:24.892990 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade809b5-390d-4037-a6f6-fca9685816cf None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:24.892990 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade809b5-390d-4037-a6f6-fca9685816cf None admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:24.896880 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade809b5-390d-4037-a6f6-fca9685816cf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:24.896880 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade809b5-390d-4037-a6f6-fca9685816cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:24.899006 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade809b5-390d-4037-a6f6-fca9685816cf None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:24.902797 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ed1c4-9f8d-4f29-977a-00967577f635 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:24.940602 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af70f5-c062-4e24-93e8-d55a5a2b7a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:24.941404 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af70f5-c062-4e24-93e8-d55a5a2b7a28 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:24.941688 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af70f5-c062-4e24-93e8-d55a5a2b7a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:24.941965 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af70f5-c062-4e24-93e8-d55a5a2b7a28 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:24.948996 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 251/495] 10.222.0.15 () {56 vars in 1133 bytes} [Fri Jun 3 11:45:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:24.950212 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade809b5-390d-4037-a6f6-fca9685816cf None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:24.956499 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51af70f5-c062-4e24-93e8-d55a5a2b7a28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:45:24.965445 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-51af70f5-c062-4e24-93e8-d55a5a2b7a28 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 11:45:24.965445 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:24.965445 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:24.965445 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:24.965445 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:24.965445 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:24.965445 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:24.965445 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:24.965445 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:24.965445 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:24.965445 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:24.965445 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:24.965445 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:45:24.965445 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:45:24.965445 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:45:24.965445 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:45:24.966312 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:45:24.966312 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:45:24.966312 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:45:24.966312 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:45:24.966312 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:24.966312 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:24.966312 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:24.966312 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:24.966312 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:24.966312 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:24.966312 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:24.966312 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:24.966312 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:24.966312 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:24.966312 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:24.966312 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:24.967107 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:24.967107 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:24.967107 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:24.967107 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:24.967107 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:45:24.967107 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:45:24.967107 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:45:24.967107 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:45:24.967107 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:45:24.967107 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:45:24.967107 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 11:45:24.967107 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:24.967107 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 245/496] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Jun 3 11:45:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:24.968645 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92888435-dc99-4894-9c39-daa01a528517 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:24.968645 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92888435-dc99-4894-9c39-daa01a528517 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:24.968645 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92888435-dc99-4894-9c39-daa01a528517 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:24.969751 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 246/497] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:45:24.971554 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92888435-dc99-4894-9c39-daa01a528517 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:25.060579 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade809b5-390d-4037-a6f6-fca9685816cf None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:25.083021 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92888435-dc99-4894-9c39-daa01a528517 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:25.097879 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:25.098117 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c53a3f-2b53-44b4-ad8d-c2a1c47a4273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:25.099160 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c53a3f-2b53-44b4-ad8d-c2a1c47a4273 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:25.099576 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c53a3f-2b53-44b4-ad8d-c2a1c47a4273 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:25.099984 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c53a3f-2b53-44b4-ad8d-c2a1c47a4273 None admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:25.100756 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c53a3f-2b53-44b4-ad8d-c2a1c47a4273 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:25.101073 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c53a3f-2b53-44b4-ad8d-c2a1c47a4273 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:25.103058 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c53a3f-2b53-44b4-ad8d-c2a1c47a4273 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:25.115228 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 252/498] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:25.116227 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c53a3f-2b53-44b4-ad8d-c2a1c47a4273 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:25.125811 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be16ae9-6b65-4856-b99d-0dc62f77e048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:25.126543 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be16ae9-6b65-4856-b99d-0dc62f77e048 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:25.126920 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be16ae9-6b65-4856-b99d-0dc62f77e048 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:25.127205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be16ae9-6b65-4856-b99d-0dc62f77e048 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:25.162296 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:25.194411 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be16ae9-6b65-4856-b99d-0dc62f77e048 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:25.195912 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be16ae9-6b65-4856-b99d-0dc62f77e048 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:25.217499 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c53a3f-2b53-44b4-ad8d-c2a1c47a4273 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:25.250659 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee86bcb-af53-4d62-a586-ceefb47d3a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:25.251323 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee86bcb-af53-4d62-a586-ceefb47d3a07 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:25.251838 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee86bcb-af53-4d62-a586-ceefb47d3a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:25.252001 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee86bcb-af53-4d62-a586-ceefb47d3a07 None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:25.252756 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee86bcb-af53-4d62-a586-ceefb47d3a07 None admin] RBAC: Adding query filter params (name=service) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:25.253065 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee86bcb-af53-4d62-a586-ceefb47d3a07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:25.254426 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee86bcb-af53-4d62-a586-ceefb47d3a07 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:25.262339 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 253/499] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Jun 3 11:45:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:25.263850 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1cd0ae-adfb-4c67-a145-5e8d98e56466 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:25.264148 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1cd0ae-adfb-4c67-a145-5e8d98e56466 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:25.264424 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1cd0ae-adfb-4c67-a145-5e8d98e56466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:25.280415 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-0a1cd0ae-adfb-4c67-a145-5e8d98e56466 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:25.281589 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-0a1cd0ae-adfb-4c67-a145-5e8d98e56466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:25.294400 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 247/500] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:45:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 11:45:25.295320 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be16ae9-6b65-4856-b99d-0dc62f77e048 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:25.309720 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:25.352849 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 254/501] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:45:25.354162 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9fa2d0-80db-41e4-85b9-684081433fc6 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:25.354453 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9fa2d0-80db-41e4-85b9-684081433fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:25.354712 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9fa2d0-80db-41e4-85b9-684081433fc6 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:25.355998 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 255/502] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:45:25.356683 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9fa2d0-80db-41e4-85b9-684081433fc6 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:25.399778 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be16ae9-6b65-4856-b99d-0dc62f77e048 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:25.401862 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:25.434374 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6a857-6539-44bb-9ec1-eba42a1d6740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:25.435152 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6a857-6539-44bb-9ec1-eba42a1d6740 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:25.435431 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6a857-6539-44bb-9ec1-eba42a1d6740 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:25.435739 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6a857-6539-44bb-9ec1-eba42a1d6740 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:25.442800 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6a857-6539-44bb-9ec1-eba42a1d6740 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:25.444264 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6a857-6539-44bb-9ec1-eba42a1d6740 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:25.460211 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-50b6a857-6539-44bb-9ec1-eba42a1d6740 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 03 11:45:25.460211 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:25.460211 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:25.460211 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:25.460211 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:25.460211 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:25.460211 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:25.460211 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:25.460211 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:25.460211 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:25.460211 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:25.460211 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:25.460211 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 11:45:25.460211 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 11:45:25.460211 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 11:45:25.460211 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 11:45:25.461110 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:25.461110 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:25.461110 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 11:45:25.461110 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:45:25.461110 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 11:45:25.461110 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:45:25.461110 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:25.461110 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:25.461110 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:25.461110 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:25.461110 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:25.461110 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:25.461110 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:25.461110 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:25.461110 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:25.461110 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:25.461110 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:25.461110 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:25.461989 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:25.461989 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:25.461989 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 11:45:25.461989 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 11:45:25.461989 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 11:45:25.461989 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 11:45:25.461989 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 11:45:25.461989 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 11:45:25.461989 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 03 11:45:25.461989 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:25.461989 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 248/503] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:45:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:25.462564 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6a857-6539-44bb-9ec1-eba42a1d6740 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:25.472580 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9fa2d0-80db-41e4-85b9-684081433fc6 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:25.506217 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea354a0c-9c5d-4703-9856-4c9baa400bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:25.507004 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea354a0c-9c5d-4703-9856-4c9baa400bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:25.507290 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea354a0c-9c5d-4703-9856-4c9baa400bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:25.507604 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea354a0c-9c5d-4703-9856-4c9baa400bd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:25.517409 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea354a0c-9c5d-4703-9856-4c9baa400bd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:25.519389 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea354a0c-9c5d-4703-9856-4c9baa400bd3 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:25.532475 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:25.537828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-ea354a0c-9c5d-4703-9856-4c9baa400bd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:25.537828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:25.537828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:25.537828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:25.537828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:25.537828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:25.537828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:25.537828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:25.537828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:25.537828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:25.537828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:25.537828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:25.537828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:25.537828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:25.537828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:25.538688 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:25.538688 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:25.538688 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:25.538688 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:25.538688 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:25.538688 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:25.538688 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:25.538688 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:25.538688 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:25.538688 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:25.538688 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:25.538688 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:25.538688 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:25.538688 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:25.538688 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:25.538688 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:25.538688 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:25.539620 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:25.539620 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:25.539620 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:25.539620 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:25.539620 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 256/504] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:25.540322 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9b4d5-e548-46a6-bb5c-276d44aeb2f1 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:25.540564 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9b4d5-e548-46a6-bb5c-276d44aeb2f1 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:25.540840 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9b4d5-e548-46a6-bb5c-276d44aeb2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:25.556715 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-80a9b4d5-e548-46a6-bb5c-276d44aeb2f1 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:25.557873 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-80a9b4d5-e548-46a6-bb5c-276d44aeb2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:25.564043 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6a857-6539-44bb-9ec1-eba42a1d6740 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:25.597914 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb76844-aeae-4e9f-83fa-366f3f662c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:25.598692 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb76844-aeae-4e9f-83fa-366f3f662c9d None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:25.598976 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb76844-aeae-4e9f-83fa-366f3f662c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:25.599275 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb76844-aeae-4e9f-83fa-366f3f662c9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:25.609679 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb76844-aeae-4e9f-83fa-366f3f662c9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:25.611178 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb76844-aeae-4e9f-83fa-366f3f662c9d None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:25.623370 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 257/505] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:45:25.624239 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9b4d5-e548-46a6-bb5c-276d44aeb2f1 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:25.627781 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-ffb76844-aeae-4e9f-83fa-366f3f662c9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:25.627781 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:25.627781 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:25.627781 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:25.627781 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:25.627781 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:25.627781 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:25.627781 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:25.627781 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:25.627781 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:25.627781 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:25.627781 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:25.627781 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:25.627781 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:25.627781 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:25.628760 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:25.628760 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:25.628760 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:25.628760 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:25.628760 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:25.628760 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:25.628760 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:25.628760 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:25.628760 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:25.628760 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:25.628760 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:25.628760 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:25.628760 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:25.628760 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:25.628760 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:25.628760 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:25.628760 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:25.629640 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:25.629640 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:25.629640 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:25.629640 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:25.629640 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 249/506] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:25.630211 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb76844-aeae-4e9f-83fa-366f3f662c9d None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:25.655700 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:25.733757 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb76844-aeae-4e9f-83fa-366f3f662c9d None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:25.736749 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9b4d5-e548-46a6-bb5c-276d44aeb2f1 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:25.755974 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:25.767162 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61343161-f433-4d91-9de9-dc0a47de93e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:25.768397 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61343161-f433-4d91-9de9-dc0a47de93e2 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:25.768682 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61343161-f433-4d91-9de9-dc0a47de93e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:25.768967 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61343161-f433-4d91-9de9-dc0a47de93e2 None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:25.769788 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61343161-f433-4d91-9de9-dc0a47de93e2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:25.770099 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61343161-f433-4d91-9de9-dc0a47de93e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:25.770676 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d46d85-b3f3-4697-9e25-4f0b232e7ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:25.771469 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d46d85-b3f3-4697-9e25-4f0b232e7ba7 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:25.771597 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61343161-f433-4d91-9de9-dc0a47de93e2 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:25.771787 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d46d85-b3f3-4697-9e25-4f0b232e7ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:25.772062 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d46d85-b3f3-4697-9e25-4f0b232e7ba7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:25.782308 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d46d85-b3f3-4697-9e25-4f0b232e7ba7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:45:25.791457 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-30d46d85-b3f3-4697-9e25-4f0b232e7ba7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 11:45:25.791457 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:25.791457 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:25.791457 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:25.791457 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:25.791457 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:25.791457 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:25.791457 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:25.791457 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:25.791457 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:25.791457 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:25.791457 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:25.791457 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:45:25.791457 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:45:25.791457 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:45:25.791457 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:45:25.792536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:45:25.792536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:45:25.792536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:45:25.792536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:45:25.792536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:25.792536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:25.792536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:25.792536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:25.792536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:25.792536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:25.792536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:25.792536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:25.792536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:25.792536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:25.792536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:25.792536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:25.793352 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:25.793352 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:25.793352 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:25.793352 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:25.793352 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:45:25.793352 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:45:25.793352 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:45:25.793352 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:45:25.793352 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:45:25.793352 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:45:25.793352 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 11:45:25.793352 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:25.793352 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 258/507] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Jun 3 11:45:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:25.794280 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d46d85-b3f3-4697-9e25-4f0b232e7ba7 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:25.813576 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 250/508] 10.222.0.15 () {56 vars in 1137 bytes} [Fri Jun 3 11:45:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:25.813576 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61343161-f433-4d91-9de9-dc0a47de93e2 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:25.871922 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:25.897662 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d46d85-b3f3-4697-9e25-4f0b232e7ba7 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:25.912939 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61343161-f433-4d91-9de9-dc0a47de93e2 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:25.929783 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea29df-7c6a-4375-9623-51fc2ad7daa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:25.930438 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea29df-7c6a-4375-9623-51fc2ad7daa5 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:25.930722 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea29df-7c6a-4375-9623-51fc2ad7daa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:25.930997 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea29df-7c6a-4375-9623-51fc2ad7daa5 None admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:25.931752 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ea29df-7c6a-4375-9623-51fc2ad7daa5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:25.932062 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ea29df-7c6a-4375-9623-51fc2ad7daa5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:25.933433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ea29df-7c6a-4375-9623-51fc2ad7daa5 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:25.945583 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 259/509] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:25.946366 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e47cbb-88c8-457b-a2d1-2aa398c3dacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:25.946526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea29df-7c6a-4375-9623-51fc2ad7daa5 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:25.947086 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e47cbb-88c8-457b-a2d1-2aa398c3dacd None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:25.947374 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e47cbb-88c8-457b-a2d1-2aa398c3dacd None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:25.947678 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e47cbb-88c8-457b-a2d1-2aa398c3dacd None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:25.948392 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e47cbb-88c8-457b-a2d1-2aa398c3dacd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:25.948697 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e47cbb-88c8-457b-a2d1-2aa398c3dacd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:25.950425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e47cbb-88c8-457b-a2d1-2aa398c3dacd None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:25.962039 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 251/510] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:25.962834 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e47cbb-88c8-457b-a2d1-2aa398c3dacd None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:26.007020 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:26.043772 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea29df-7c6a-4375-9623-51fc2ad7daa5 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:26.062552 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e47cbb-88c8-457b-a2d1-2aa398c3dacd None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:26.078106 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0b6f9-cd5f-4398-9b5f-8a743fbe2676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:26.078900 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0b6f9-cd5f-4398-9b5f-8a743fbe2676 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:26.079180 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0b6f9-cd5f-4398-9b5f-8a743fbe2676 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:26.079455 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0b6f9-cd5f-4398-9b5f-8a743fbe2676 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:26.082684 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:26.090064 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c0b6f9-cd5f-4398-9b5f-8a743fbe2676 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:26.091860 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c0b6f9-cd5f-4398-9b5f-8a743fbe2676 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:26.096802 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab6344-9778-42c2-80b4-827979d60a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:26.097459 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab6344-9778-42c2-80b4-827979d60a49 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:26.097746 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab6344-9778-42c2-80b4-827979d60a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:26.098028 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab6344-9778-42c2-80b4-827979d60a49 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:26.098778 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab6344-9778-42c2-80b4-827979d60a49 None admin] RBAC: Adding query filter params (name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:26.099088 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab6344-9778-42c2-80b4-827979d60a49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:26.100475 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab6344-9778-42c2-80b4-827979d60a49 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:26.108286 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 252/511] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Jun 3 11:45:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:26.109061 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab6344-9778-42c2-80b4-827979d60a49 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:26.109249 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-90c0b6f9-cd5f-4398-9b5f-8a743fbe2676 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:26.109249 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:26.109249 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:26.109249 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:26.109249 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:26.109249 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:26.109249 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:26.109249 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:26.109249 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:26.109249 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:26.109249 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:26.109249 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:26.109249 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:26.109249 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:26.109249 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:26.110047 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:26.110047 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:26.110047 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:26.110047 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:26.110047 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:26.110047 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:26.110047 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:26.110047 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:26.110047 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:26.110047 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:26.110047 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:26.110047 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:26.110047 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:26.110047 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:26.110047 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:26.110047 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:26.110047 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:26.110885 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:26.110885 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:26.110885 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:26.110885 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:26.110885 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 260/512] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:26.111152 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0b6f9-cd5f-4398-9b5f-8a743fbe2676 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:26.211199 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0b6f9-cd5f-4398-9b5f-8a743fbe2676 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:26.214411 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab6344-9778-42c2-80b4-827979d60a49 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:26.216710 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:26.246263 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ce337-11b8-4020-92cb-390e8693d25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:26.247055 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ce337-11b8-4020-92cb-390e8693d25e None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:26.247341 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ce337-11b8-4020-92cb-390e8693d25e None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:26.247654 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ce337-11b8-4020-92cb-390e8693d25e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:26.249302 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fbe62-3c07-45e1-b8fb-d4538a9e9d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:26.249938 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fbe62-3c07-45e1-b8fb-d4538a9e9d5a None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:26.250223 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fbe62-3c07-45e1-b8fb-d4538a9e9d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:26.250497 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fbe62-3c07-45e1-b8fb-d4538a9e9d5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:26.255474 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ce337-11b8-4020-92cb-390e8693d25e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:26.256956 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ce337-11b8-4020-92cb-390e8693d25e None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:26.271197 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-696ce337-11b8-4020-92cb-390e8693d25e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 03 11:45:26.271197 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:26.271197 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:26.271197 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:26.271197 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:26.271197 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:26.271197 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:26.271197 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:26.271197 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:26.271197 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:26.271197 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:26.271197 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:26.271197 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 11:45:26.271197 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 11:45:26.271197 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 11:45:26.271197 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 11:45:26.272258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:26.272258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:26.272258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 11:45:26.272258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:45:26.272258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 11:45:26.272258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:45:26.272258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:26.272258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:26.272258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:26.272258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:26.272258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:26.272258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:26.272258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:26.272258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:26.272258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:26.272258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:26.272258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:26.272258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:26.273136 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:26.273136 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:26.273136 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 11:45:26.273136 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 11:45:26.273136 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 11:45:26.273136 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 11:45:26.273136 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 11:45:26.273136 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 11:45:26.273136 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 03 11:45:26.273136 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:26.273136 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 261/513] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:45:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:26.273136 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ce337-11b8-4020-92cb-390e8693d25e None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:26.321667 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:26.321829 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7fbe62-3c07-45e1-b8fb-d4538a9e9d5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:26.323331 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7fbe62-3c07-45e1-b8fb-d4538a9e9d5a None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:26.371155 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ce337-11b8-4020-92cb-390e8693d25e None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:26.404338 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b305039-0c7b-4044-9e67-8e8d95717440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:26.405121 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b305039-0c7b-4044-9e67-8e8d95717440 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:26.405408 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b305039-0c7b-4044-9e67-8e8d95717440 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:26.405685 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b305039-0c7b-4044-9e67-8e8d95717440 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:26.412301 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b305039-0c7b-4044-9e67-8e8d95717440 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:26.413737 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b305039-0c7b-4044-9e67-8e8d95717440 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:26.421184 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 253/514] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:45:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 11:45:26.422007 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fbe62-3c07-45e1-b8fb-d4538a9e9d5a None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:26.428032 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:26.428647 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-2b305039-0c7b-4044-9e67-8e8d95717440 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:45:26.428647 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:26.428647 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:26.428647 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:26.428647 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:26.428647 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:26.428647 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:26.428647 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:26.428647 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:26.428647 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:26.428647 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:26.428647 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:26.428647 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 11:45:26.428647 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 11:45:26.428647 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 11:45:26.429503 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 11:45:26.429503 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:26.429503 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:26.429503 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:26.429503 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:26.429503 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:26.429503 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:26.429503 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:26.429503 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:26.429503 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:26.429503 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:26.429503 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:26.429503 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:26.429503 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:26.429503 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:26.429503 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:26.429503 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:26.430396 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 11:45:26.430396 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 11:45:26.430396 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 11:45:26.430396 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 11:45:26.430396 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 11:45:26.430396 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 11:45:26.430396 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:45:26.430396 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:26.431756 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 262/515] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:45:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:26.432454 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b305039-0c7b-4044-9e67-8e8d95717440 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:26.521349 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fbe62-3c07-45e1-b8fb-d4538a9e9d5a None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:26.531492 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b305039-0c7b-4044-9e67-8e8d95717440 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:26.540686 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:26.554610 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec8815-c4a5-4d48-b5fa-17e3790093fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:26.555387 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec8815-c4a5-4d48-b5fa-17e3790093fc None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:26.555695 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec8815-c4a5-4d48-b5fa-17e3790093fc None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:26.555971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec8815-c4a5-4d48-b5fa-17e3790093fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:26.566763 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ec8815-c4a5-4d48-b5fa-17e3790093fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:26.566904 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45438419-e13c-407c-ab23-3038a80edc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:26.567587 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45438419-e13c-407c-ab23-3038a80edc3e None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:26.567871 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45438419-e13c-407c-ab23-3038a80edc3e None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:26.568143 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45438419-e13c-407c-ab23-3038a80edc3e None admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:26.568230 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ec8815-c4a5-4d48-b5fa-17e3790093fc None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:26.568858 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45438419-e13c-407c-ab23-3038a80edc3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:26.569164 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45438419-e13c-407c-ab23-3038a80edc3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:26.570511 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45438419-e13c-407c-ab23-3038a80edc3e None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:26.581886 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 263/516] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:26.582668 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45438419-e13c-407c-ab23-3038a80edc3e None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:26.584837 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-01ec8815-c4a5-4d48-b5fa-17e3790093fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:26.584837 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:26.584837 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:26.584837 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:26.584837 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:26.584837 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:26.584837 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:26.584837 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:26.584837 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:26.584837 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:26.584837 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:26.584837 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:26.584837 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:26.584837 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:26.584837 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:26.585819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:26.585819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:26.585819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:26.585819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:26.585819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:26.585819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:26.585819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:26.585819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:26.585819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:26.585819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:26.585819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:26.585819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:26.585819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:26.585819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:26.585819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:26.585819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:26.585819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:26.587422 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:26.587422 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:26.587422 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:26.587422 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:26.587422 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 254/517] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:26.587422 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec8815-c4a5-4d48-b5fa-17e3790093fc None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:26.647007 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:26.685563 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45438419-e13c-407c-ab23-3038a80edc3e None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:26.694599 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec8815-c4a5-4d48-b5fa-17e3790093fc None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:26.718358 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc68110-a603-4740-9c3b-bbc7366d328c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:26.719019 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc68110-a603-4740-9c3b-bbc7366d328c None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:26.719300 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc68110-a603-4740-9c3b-bbc7366d328c None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:26.719600 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc68110-a603-4740-9c3b-bbc7366d328c None admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:26.720424 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc68110-a603-4740-9c3b-bbc7366d328c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:26.721267 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc68110-a603-4740-9c3b-bbc7366d328c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:26.722710 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc68110-a603-4740-9c3b-bbc7366d328c None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:26.727445 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f645a-fe5f-4eda-9ff5-1bee6a2c618f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:26.728244 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f645a-fe5f-4eda-9ff5-1bee6a2c618f None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:26.728523 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f645a-fe5f-4eda-9ff5-1bee6a2c618f None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:26.728793 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f645a-fe5f-4eda-9ff5-1bee6a2c618f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:26.739725 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f645a-fe5f-4eda-9ff5-1bee6a2c618f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:26.739998 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 264/518] 10.222.0.15 () {56 vars in 1137 bytes} [Fri Jun 3 11:45:26 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:26.740795 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc68110-a603-4740-9c3b-bbc7366d328c None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:26.741157 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f645a-fe5f-4eda-9ff5-1bee6a2c618f None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:26.761040 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-ea3f645a-fe5f-4eda-9ff5-1bee6a2c618f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:26.761040 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:26.761040 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:26.761040 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:26.761040 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:26.761040 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:26.761040 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:26.761040 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:26.761040 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:26.761040 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:26.761040 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:26.761040 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:26.761040 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:26.761040 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:26.761040 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:26.761955 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:26.761955 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:26.761955 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:26.761955 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:26.761955 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:26.761955 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:26.761955 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:26.761955 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:26.761955 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:26.761955 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:26.761955 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:26.761955 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:26.761955 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:26.761955 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:26.761955 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:26.761955 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:26.761955 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:26.762799 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:26.762799 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:26.762799 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:26.762799 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:26.762799 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 255/519] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:26.763063 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f645a-fe5f-4eda-9ff5-1bee6a2c618f None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:26.773064 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:26.844681 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc68110-a603-4740-9c3b-bbc7366d328c None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:26.862598 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f645a-fe5f-4eda-9ff5-1bee6a2c618f None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:26.872222 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:26.878908 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e858267-f886-46f9-a136-4cf52062b38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:26.879589 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e858267-f886-46f9-a136-4cf52062b38d None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:26.879877 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e858267-f886-46f9-a136-4cf52062b38d None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:26.880156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e858267-f886-46f9-a136-4cf52062b38d None admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:26.880946 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e858267-f886-46f9-a136-4cf52062b38d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:26.881256 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e858267-f886-46f9-a136-4cf52062b38d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:26.882709 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e858267-f886-46f9-a136-4cf52062b38d None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:26.898942 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2d4be-2c20-4d89-81ea-b212cfeaab4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:26.899651 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2d4be-2c20-4d89-81ea-b212cfeaab4d None admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:26.899932 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2d4be-2c20-4d89-81ea-b212cfeaab4d None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:26.900200 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2d4be-2c20-4d89-81ea-b212cfeaab4d None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:26.901149 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e2d4be-2c20-4d89-81ea-b212cfeaab4d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:26.902511 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 265/520] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 3 11:45:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:26.902634 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e2d4be-2c20-4d89-81ea-b212cfeaab4d None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:26.903339 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e858267-f886-46f9-a136-4cf52062b38d None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:26.923850 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 256/521] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Jun 3 11:45:26 2022] POST /identity/v3/users => generated 247 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:45:26.924671 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2d4be-2c20-4d89-81ea-b212cfeaab4d None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:27.012361 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:27.029855 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e858267-f886-46f9-a136-4cf52062b38d None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:27.041208 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2d4be-2c20-4d89-81ea-b212cfeaab4d None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:27.066589 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37a8d8-8ece-4f41-844f-2e798dafafa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:27.067276 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37a8d8-8ece-4f41-844f-2e798dafafa9 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:27.067584 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37a8d8-8ece-4f41-844f-2e798dafafa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:27.067859 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37a8d8-8ece-4f41-844f-2e798dafafa9 None admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:27.068609 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c37a8d8-8ece-4f41-844f-2e798dafafa9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:27.068915 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c37a8d8-8ece-4f41-844f-2e798dafafa9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:27.070342 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c37a8d8-8ece-4f41-844f-2e798dafafa9 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:27.082612 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 266/522] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:27.083487 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37a8d8-8ece-4f41-844f-2e798dafafa9 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:27.091416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc9d24-9bc0-434d-8882-2298ea776144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:27.092451 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc9d24-9bc0-434d-8882-2298ea776144 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:27.092916 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc9d24-9bc0-434d-8882-2298ea776144 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:27.093964 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc9d24-9bc0-434d-8882-2298ea776144 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:27.130200 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:27.177741 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc9d24-9bc0-434d-8882-2298ea776144 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:27.179210 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc9d24-9bc0-434d-8882-2298ea776144 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:27.203159 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37a8d8-8ece-4f41-844f-2e798dafafa9 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:27.240505 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b46c8-d633-496c-9fef-4436c1b1c22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:27.241457 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b46c8-d633-496c-9fef-4436c1b1c22c None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:27.241743 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b46c8-d633-496c-9fef-4436c1b1c22c None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:27.242018 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b46c8-d633-496c-9fef-4436c1b1c22c None admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:27.242905 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b46c8-d633-496c-9fef-4436c1b1c22c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:27.243531 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b46c8-d633-496c-9fef-4436c1b1c22c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:27.245205 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b46c8-d633-496c-9fef-4436c1b1c22c None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:27.260119 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 267/523] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:27.260839 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b46c8-d633-496c-9fef-4436c1b1c22c None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:27.272650 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:27.294306 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 257/524] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:45:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 11:45:27.295031 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc9d24-9bc0-434d-8882-2298ea776144 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:27.360002 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:27.371215 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b46c8-d633-496c-9fef-4436c1b1c22c None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:27.400109 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc9d24-9bc0-434d-8882-2298ea776144 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:27.406189 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3cf4f4-78ba-4ab2-9302-351439443a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:27.406922 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cf4f4-78ba-4ab2-9302-351439443a73 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:27.407276 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cf4f4-78ba-4ab2-9302-351439443a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:27.407651 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cf4f4-78ba-4ab2-9302-351439443a73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:27.409079 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3cf4f4-78ba-4ab2-9302-351439443a73 None admin] RBAC: Adding query filter params (role.id=41158ae54c7a437284af718034e9b354, scope.project.id=cff223ee05524cf4bf3591fc5a39559e, user.id=6247bfb7aebd45eeb97ba5933be44c6d) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:27.409477 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3cf4f4-78ba-4ab2-9302-351439443a73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:27.411037 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3cf4f4-78ba-4ab2-9302-351439443a73 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:27.416710 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 268/525] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:45:27 2022] GET /identity/v3/role_assignments?user.id=6247bfb7aebd45eeb97ba5933be44c6d&scope.project.id=cff223ee05524cf4bf3591fc5a39559e&role.id=41158ae54c7a437284af718034e9b354 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:27.417582 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3cf4f4-78ba-4ab2-9302-351439443a73 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:27.450881 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2153b-72d6-4659-b917-1b8d6f5e1ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:27.451837 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2153b-72d6-4659-b917-1b8d6f5e1ae6 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:27.452196 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2153b-72d6-4659-b917-1b8d6f5e1ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:27.452551 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2153b-72d6-4659-b917-1b8d6f5e1ae6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:27.461441 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2153b-72d6-4659-b917-1b8d6f5e1ae6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:27.463028 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2153b-72d6-4659-b917-1b8d6f5e1ae6 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:27.480091 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-4dc2153b-72d6-4659-b917-1b8d6f5e1ae6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 03 11:45:27.480091 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:27.480091 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:27.480091 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:27.480091 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:27.480091 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:27.480091 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:27.480091 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:27.480091 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:27.480091 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:27.480091 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:27.480091 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:27.480091 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 11:45:27.480091 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 11:45:27.480091 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 11:45:27.480091 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 11:45:27.481036 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:27.481036 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:27.481036 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 11:45:27.481036 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:45:27.481036 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 11:45:27.481036 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:45:27.481036 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:27.481036 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:27.481036 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:27.481036 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:27.481036 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:27.481036 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:27.481036 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:27.481036 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:27.481036 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:27.481036 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:27.481036 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:27.481036 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:27.481916 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:27.481916 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:27.481916 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 11:45:27.481916 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 11:45:27.481916 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 11:45:27.481916 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 11:45:27.481916 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 11:45:27.481916 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 11:45:27.481916 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 03 11:45:27.481916 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:27.484501 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 258/526] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Jun 3 11:45:27 2022] GET /identity/v3/users/neutron => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:27.485648 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2153b-72d6-4659-b917-1b8d6f5e1ae6 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:27.519956 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:27.550818 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3cf4f4-78ba-4ab2-9302-351439443a73 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:27.589202 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954d3c51-c540-4ef1-b29a-df5ef5511284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:27.590176 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d3c51-c540-4ef1-b29a-df5ef5511284 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:27.590566 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d3c51-c540-4ef1-b29a-df5ef5511284 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:27.590965 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d3c51-c540-4ef1-b29a-df5ef5511284 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:27.599699 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954d3c51-c540-4ef1-b29a-df5ef5511284 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:27.600022 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2153b-72d6-4659-b917-1b8d6f5e1ae6 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:27.601728 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954d3c51-c540-4ef1-b29a-df5ef5511284 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:27.619376 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-954d3c51-c540-4ef1-b29a-df5ef5511284 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:45:27.619376 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:27.619376 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:27.619376 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:27.619376 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:27.619376 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:27.619376 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:27.619376 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:27.619376 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:27.619376 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:27.619376 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:27.619376 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:27.619376 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 11:45:27.619376 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 11:45:27.619376 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 11:45:27.620584 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 11:45:27.620584 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:27.620584 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:27.620584 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:27.620584 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:27.620584 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:27.620584 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:27.620584 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:27.620584 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:27.620584 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:27.620584 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:27.620584 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:27.620584 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:27.620584 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:27.620584 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:27.620584 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:27.620584 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:27.621617 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 11:45:27.621617 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 11:45:27.621617 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 11:45:27.621617 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 11:45:27.621617 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 11:45:27.621617 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 11:45:27.621617 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:45:27.621617 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:27.628463 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 269/527] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:45:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:27.628463 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954d3c51-c540-4ef1-b29a-df5ef5511284 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:27.636801 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:27.651978 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab2a350-6ab8-4d2b-9a0c-4b366d6da351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:27.652938 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2a350-6ab8-4d2b-9a0c-4b366d6da351 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:27.653218 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2a350-6ab8-4d2b-9a0c-4b366d6da351 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:27.653492 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2a350-6ab8-4d2b-9a0c-4b366d6da351 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:27.668118 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab2a350-6ab8-4d2b-9a0c-4b366d6da351 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:27.669590 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab2a350-6ab8-4d2b-9a0c-4b366d6da351 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:27.693508 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-4ab2a350-6ab8-4d2b-9a0c-4b366d6da351 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:27.693508 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:27.693508 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:27.693508 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:27.693508 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:27.693508 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:27.693508 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:27.693508 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:27.693508 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:27.693508 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:27.693508 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:27.693508 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:27.693508 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:27.693508 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:27.693508 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:27.694531 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:27.694531 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:27.694531 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:27.694531 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:27.694531 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:27.694531 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:27.694531 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:27.694531 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:27.694531 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:27.694531 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:27.694531 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:27.694531 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:27.694531 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:27.694531 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:27.694531 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:27.694531 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:27.694531 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:27.695375 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:27.695375 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:27.695375 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:27.695375 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:27.695619 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 259/528] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:27.699202 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab2a350-6ab8-4d2b-9a0c-4b366d6da351 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:27.751215 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954d3c51-c540-4ef1-b29a-df5ef5511284 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:27.782591 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:27.789958 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b621ee-811c-418c-b65e-c5ff7becce15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:27.790844 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b621ee-811c-418c-b65e-c5ff7becce15 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:27.791270 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b621ee-811c-418c-b65e-c5ff7becce15 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:27.791770 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b621ee-811c-418c-b65e-c5ff7becce15 None admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:27.792838 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b621ee-811c-418c-b65e-c5ff7becce15 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:27.793285 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b621ee-811c-418c-b65e-c5ff7becce15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:27.795928 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b621ee-811c-418c-b65e-c5ff7becce15 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:27.804765 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab2a350-6ab8-4d2b-9a0c-4b366d6da351 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:27.815614 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 270/529] 10.222.0.15 () {56 vars in 1139 bytes} [Fri Jun 3 11:45:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:27.816802 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b621ee-811c-418c-b65e-c5ff7becce15 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:27.841416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e7d00-3463-429c-9efa-81235f9f6ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:27.842060 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e7d00-3463-429c-9efa-81235f9f6ffd None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:27.842399 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e7d00-3463-429c-9efa-81235f9f6ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:27.842684 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e7d00-3463-429c-9efa-81235f9f6ffd None admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:27.843473 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e7d00-3463-429c-9efa-81235f9f6ffd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:27.843843 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e7d00-3463-429c-9efa-81235f9f6ffd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:27.845359 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e7d00-3463-429c-9efa-81235f9f6ffd None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:27.865069 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 260/530] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 3 11:45:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:27.866077 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e7d00-3463-429c-9efa-81235f9f6ffd None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:27.911997 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:27.931010 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b621ee-811c-418c-b65e-c5ff7becce15 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:27.974460 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a242372d-993b-4c53-baa5-4adfac5a98a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:27.975747 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242372d-993b-4c53-baa5-4adfac5a98a2 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:27.976477 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242372d-993b-4c53-baa5-4adfac5a98a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:27.976946 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242372d-993b-4c53-baa5-4adfac5a98a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:27.978450 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a242372d-993b-4c53-baa5-4adfac5a98a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:27.978932 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a242372d-993b-4c53-baa5-4adfac5a98a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:27.981178 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a242372d-993b-4c53-baa5-4adfac5a98a2 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:27.987310 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e7d00-3463-429c-9efa-81235f9f6ffd None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:27.996671 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 271/531] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:27.998146 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a242372d-993b-4c53-baa5-4adfac5a98a2 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:28.025254 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9780e2-8079-410f-a99f-2b1596316d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:28.026292 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9780e2-8079-410f-a99f-2b1596316d19 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:28.026622 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9780e2-8079-410f-a99f-2b1596316d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:28.026957 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9780e2-8079-410f-a99f-2b1596316d19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:28.059972 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:28.100699 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9780e2-8079-410f-a99f-2b1596316d19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:28.102299 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9780e2-8079-410f-a99f-2b1596316d19 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:28.103495 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a242372d-993b-4c53-baa5-4adfac5a98a2 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:28.139687 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f7e2f9-2548-407e-8a8c-42747a8efbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:28.140372 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:28.141222 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7e2f9-2548-407e-8a8c-42747a8efbff None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:28.141710 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7e2f9-2548-407e-8a8c-42747a8efbff None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:28.142199 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7e2f9-2548-407e-8a8c-42747a8efbff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:28.144043 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f7e2f9-2548-407e-8a8c-42747a8efbff None admin] RBAC: Adding query filter params (role.id=41158ae54c7a437284af718034e9b354, scope.project.id=cff223ee05524cf4bf3591fc5a39559e, user.id=9aa048aec48b4755ac13eae997bff2fc) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:28.144563 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f7e2f9-2548-407e-8a8c-42747a8efbff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:28.146245 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f7e2f9-2548-407e-8a8c-42747a8efbff None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:28.153712 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 272/532] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:45:27 2022] GET /identity/v3/role_assignments?user.id=9aa048aec48b4755ac13eae997bff2fc&scope.project.id=cff223ee05524cf4bf3591fc5a39559e&role.id=41158ae54c7a437284af718034e9b354 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:28.154877 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f7e2f9-2548-407e-8a8c-42747a8efbff None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:28.218212 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 261/533] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:45:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 11:45:28.223313 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9780e2-8079-410f-a99f-2b1596316d19 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:28.336647 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f7e2f9-2548-407e-8a8c-42747a8efbff None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:28.349571 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9780e2-8079-410f-a99f-2b1596316d19 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:28.390729 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:28.398490 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d6d85-2fe5-4dc9-941b-a306973513ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:28.399293 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d6d85-2fe5-4dc9-941b-a306973513ab None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:28.399605 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d6d85-2fe5-4dc9-941b-a306973513ab None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:28.399885 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d6d85-2fe5-4dc9-941b-a306973513ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:28.403154 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:28.411467 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4f11c-1ae6-43ef-b391-4b15ed97e132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:28.412325 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d6d85-2fe5-4dc9-941b-a306973513ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:28.412809 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4f11c-1ae6-43ef-b391-4b15ed97e132 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:28.413291 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4f11c-1ae6-43ef-b391-4b15ed97e132 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:28.413761 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4f11c-1ae6-43ef-b391-4b15ed97e132 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:28.414006 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d6d85-2fe5-4dc9-941b-a306973513ab None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:28.422705 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b4f11c-1ae6-43ef-b391-4b15ed97e132 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:28.424581 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b4f11c-1ae6-43ef-b391-4b15ed97e132 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:28.436007 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-fe9d6d85-2fe5-4dc9-941b-a306973513ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:28.436007 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:28.436007 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:28.436007 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:28.436007 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:28.436007 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:28.436007 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:28.436007 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:28.436007 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:28.436007 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:28.436007 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:28.436007 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:28.436007 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:28.436007 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:28.436007 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:28.436863 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:28.436863 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:28.436863 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:28.436863 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:28.436863 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:28.436863 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:28.436863 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:28.436863 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:28.436863 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:28.436863 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:28.436863 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:28.436863 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:28.436863 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:28.436863 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:28.436863 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:28.436863 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:28.436863 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:28.437707 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:28.437707 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:28.437707 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:28.437707 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:28.449637 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 262/534] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:45:28.449637 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d6d85-2fe5-4dc9-941b-a306973513ab None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:28.449858 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-70b4f11c-1ae6-43ef-b391-4b15ed97e132 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:45:28.449858 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:28.449858 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:28.449858 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:28.449858 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:28.449858 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:28.449858 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:28.449858 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:28.449858 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:28.449858 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:28.449858 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:28.449858 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:28.449858 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 11:45:28.449858 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 11:45:28.449858 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 11:45:28.450640 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 11:45:28.450640 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:28.450640 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:28.450640 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:28.450640 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:28.450640 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:28.450640 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:28.450640 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:28.450640 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:28.450640 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:28.450640 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:28.450640 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:28.450640 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:28.450640 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:28.450640 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:28.450640 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:28.450640 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:28.451492 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 11:45:28.451492 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 11:45:28.451492 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 11:45:28.451492 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 11:45:28.451492 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 11:45:28.451492 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 11:45:28.451492 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:45:28.451492 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:28.451937 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 273/535] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:45:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:28.458609 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4f11c-1ae6-43ef-b391-4b15ed97e132 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:28.629614 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d6d85-2fe5-4dc9-941b-a306973513ab None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:28.667172 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8607c34-a594-433d-9a50-adb5c6f46375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:28.667874 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8607c34-a594-433d-9a50-adb5c6f46375 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:28.668165 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8607c34-a594-433d-9a50-adb5c6f46375 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:28.668565 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8607c34-a594-433d-9a50-adb5c6f46375 None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:28.669302 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8607c34-a594-433d-9a50-adb5c6f46375 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:28.669614 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8607c34-a594-433d-9a50-adb5c6f46375 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:28.671153 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8607c34-a594-433d-9a50-adb5c6f46375 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:28.686701 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4f11c-1ae6-43ef-b391-4b15ed97e132 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:28.688536 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 263/536] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:45:28.690511 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8607c34-a594-433d-9a50-adb5c6f46375 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:28.746979 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:28.783149 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8156970b-0328-445c-b140-87d3944fd0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:28.784739 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156970b-0328-445c-b140-87d3944fd0c9 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:28.785241 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156970b-0328-445c-b140-87d3944fd0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:28.785819 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156970b-0328-445c-b140-87d3944fd0c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:28.786824 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8156970b-0328-445c-b140-87d3944fd0c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:28.787334 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8156970b-0328-445c-b140-87d3944fd0c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:28.789127 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8156970b-0328-445c-b140-87d3944fd0c9 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:28.803939 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8607c34-a594-433d-9a50-adb5c6f46375 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:28.809956 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 274/537] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 3 11:45:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:45:28.816039 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8156970b-0328-445c-b140-87d3944fd0c9 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:28.840869 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e130ae-5054-4b60-835e-695cdf5c7757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:28.841582 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e130ae-5054-4b60-835e-695cdf5c7757 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:28.841872 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e130ae-5054-4b60-835e-695cdf5c7757 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:28.842150 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e130ae-5054-4b60-835e-695cdf5c7757 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:28.856339 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:28.860002 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e130ae-5054-4b60-835e-695cdf5c7757 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:28.862153 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e130ae-5054-4b60-835e-695cdf5c7757 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:28.892272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-40e130ae-5054-4b60-835e-695cdf5c7757 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:45:28.892272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:28.892272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:28.892272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:28.892272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:28.892272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:28.892272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:28.892272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:28.892272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:28.892272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:28.892272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:28.892272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:28.892272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 11:45:28.892272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 11:45:28.892272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 11:45:28.893728 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 11:45:28.893728 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:28.893728 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:28.893728 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:28.893728 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:28.893728 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:28.893728 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:28.893728 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:28.893728 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:28.893728 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:28.893728 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:28.893728 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:28.893728 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:28.893728 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:28.893728 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:28.893728 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:28.893728 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:28.894551 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 11:45:28.894551 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 11:45:28.894551 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 11:45:28.894551 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 11:45:28.894551 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 11:45:28.894551 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 11:45:28.894551 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:45:28.894551 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:28.900049 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 264/538] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:45:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:45:28.907284 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e130ae-5054-4b60-835e-695cdf5c7757 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:28.936623 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8156970b-0328-445c-b140-87d3944fd0c9 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:28.972400 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d01268-86c4-4248-85fe-93768864c21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:28.973486 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d01268-86c4-4248-85fe-93768864c21c None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:28.973972 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d01268-86c4-4248-85fe-93768864c21c None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:28.974444 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d01268-86c4-4248-85fe-93768864c21c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:28.975519 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d01268-86c4-4248-85fe-93768864c21c None admin] RBAC: Adding query filter params (role.id=41158ae54c7a437284af718034e9b354, scope.project.id=cff223ee05524cf4bf3591fc5a39559e, user.id=978c834f137a4a6ab83a54af0239c137) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:28.976072 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d01268-86c4-4248-85fe-93768864c21c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:28.977795 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d01268-86c4-4248-85fe-93768864c21c None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:28.984044 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 275/539] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:45:28 2022] GET /identity/v3/role_assignments?user.id=978c834f137a4a6ab83a54af0239c137&scope.project.id=cff223ee05524cf4bf3591fc5a39559e&role.id=41158ae54c7a437284af718034e9b354 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:45:29.140192 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e130ae-5054-4b60-835e-695cdf5c7757 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:29.157741 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:29.200508 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e44a1-0783-4564-86cf-025423057646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:29.201177 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e44a1-0783-4564-86cf-025423057646 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:29.201462 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e44a1-0783-4564-86cf-025423057646 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:29.201739 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e44a1-0783-4564-86cf-025423057646 None admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:29.202529 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e44a1-0783-4564-86cf-025423057646 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:29.202833 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e44a1-0783-4564-86cf-025423057646 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:29.204319 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e44a1-0783-4564-86cf-025423057646 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:29.219042 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 265/540] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 3 11:45:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:29.225302 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d01268-86c4-4248-85fe-93768864c21c None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:29.359079 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:29.371330 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d01268-86c4-4248-85fe-93768864c21c None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:29.422166 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ecf145-42f8-4d67-8384-7b166fc1f75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:29.422794 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ecf145-42f8-4d67-8384-7b166fc1f75e None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:29.423025 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ecf145-42f8-4d67-8384-7b166fc1f75e None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:29.423283 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ecf145-42f8-4d67-8384-7b166fc1f75e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:29.424732 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ecf145-42f8-4d67-8384-7b166fc1f75e None admin] RBAC: Adding query filter params (role.id=41158ae54c7a437284af718034e9b354, scope.project.id=cff223ee05524cf4bf3591fc5a39559e, user.id=a78b4284099546cd9c126a5739380b8f) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:29.425043 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ecf145-42f8-4d67-8384-7b166fc1f75e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:29.426480 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ecf145-42f8-4d67-8384-7b166fc1f75e None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:29.436011 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 276/541] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:45:29 2022] GET /identity/v3/role_assignments?user.id=a78b4284099546cd9c126a5739380b8f&scope.project.id=cff223ee05524cf4bf3591fc5a39559e&role.id=41158ae54c7a437284af718034e9b354 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:29.557652 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1954e28-1fa8-402d-a702-af2c13d4214f None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:29.558162 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1954e28-1fa8-402d-a702-af2c13d4214f None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:29.558235 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1954e28-1fa8-402d-a702-af2c13d4214f None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:29.559901 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 266/542] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:45:29.566556 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd51b9-0acd-441c-87f0-3999c9abee88 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:29.566898 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd51b9-0acd-441c-87f0-3999c9abee88 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:29.567120 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd51b9-0acd-441c-87f0-3999c9abee88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:29.586187 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-b9fd51b9-0acd-441c-87f0-3999c9abee88 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:29.587407 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-b9fd51b9-0acd-441c-87f0-3999c9abee88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:29.695095 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 277/543] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:45:29.727665 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1954e28-1fa8-402d-a702-af2c13d4214f None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:29.855387 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1954e28-1fa8-402d-a702-af2c13d4214f None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:29.890888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f1a8f-fcea-499b-b566-2157c28cac8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:29.892108 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f1a8f-fcea-499b-b566-2157c28cac8c None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:29.893225 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f1a8f-fcea-499b-b566-2157c28cac8c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:29.893723 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f1a8f-fcea-499b-b566-2157c28cac8c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:29.921683 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f1a8f-fcea-499b-b566-2157c28cac8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:45:29.933944 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-e01f1a8f-fcea-499b-b566-2157c28cac8c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 11:45:29.933944 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:29.933944 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:29.933944 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:29.933944 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:29.933944 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:29.933944 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:29.933944 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:29.933944 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:29.933944 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:29.933944 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:29.933944 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:29.933944 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:45:29.933944 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:45:29.933944 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:45:29.933944 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:45:29.934855 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:45:29.934855 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:45:29.934855 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:45:29.934855 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:45:29.934855 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:29.934855 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:29.934855 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:29.934855 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:29.934855 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:29.934855 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:29.934855 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:29.934855 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:29.934855 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:29.934855 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:29.934855 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:29.934855 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:29.935673 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:29.935673 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:29.935673 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:29.935673 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:29.935673 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:45:29.935673 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:45:29.935673 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:45:29.935673 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:45:29.935673 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:45:29.935673 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:45:29.935673 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 11:45:29.935673 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:29.938372 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 267/544] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Jun 3 11:45:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:29.944316 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd51b9-0acd-441c-87f0-3999c9abee88 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:30.090135 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:30.104742 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd51b9-0acd-441c-87f0-3999c9abee88 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:30.105691 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a711c8-0ea8-43f9-98a9-970127fc3382 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:30.105989 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a711c8-0ea8-43f9-98a9-970127fc3382 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:30.106273 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a711c8-0ea8-43f9-98a9-970127fc3382 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:30.108031 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 268/545] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:45:30.114514 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c4145-0f91-4ac4-ba94-6f025aa79e1c None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:30.114807 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c4145-0f91-4ac4-ba94-6f025aa79e1c None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:30.115088 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c4145-0f91-4ac4-ba94-6f025aa79e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:30.144351 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-f20c4145-0f91-4ac4-ba94-6f025aa79e1c None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:30.145544 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-f20c4145-0f91-4ac4-ba94-6f025aa79e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:30.168202 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c9e4d-063e-4a2e-8745-b4e04a4a1436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:30.168877 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c9e4d-063e-4a2e-8745-b4e04a4a1436 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:30.169162 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c9e4d-063e-4a2e-8745-b4e04a4a1436 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:30.169432 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c9e4d-063e-4a2e-8745-b4e04a4a1436 None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:30.170180 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c9e4d-063e-4a2e-8745-b4e04a4a1436 None admin] RBAC: Adding query filter params (name=service) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:30.170483 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c9e4d-063e-4a2e-8745-b4e04a4a1436 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:30.171881 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c9e4d-063e-4a2e-8745-b4e04a4a1436 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:30.188215 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 278/546] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Jun 3 11:45:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:30.193686 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c9e4d-063e-4a2e-8745-b4e04a4a1436 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:30.196764 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:30.273482 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 269/547] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 11:45:30.334990 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c4145-0f91-4ac4-ba94-6f025aa79e1c None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:30.357919 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c9e4d-063e-4a2e-8745-b4e04a4a1436 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:30.399901 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dcbb4e-20b0-46a5-a731-96ab267928d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:30.401205 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dcbb4e-20b0-46a5-a731-96ab267928d5 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:30.401388 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dcbb4e-20b0-46a5-a731-96ab267928d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:30.401622 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dcbb4e-20b0-46a5-a731-96ab267928d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:30.425874 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dcbb4e-20b0-46a5-a731-96ab267928d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:30.427368 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dcbb4e-20b0-46a5-a731-96ab267928d5 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:30.442271 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c4145-0f91-4ac4-ba94-6f025aa79e1c None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:30.460899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-06dcbb4e-20b0-46a5-a731-96ab267928d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:30.460899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:30.460899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:30.460899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:30.460899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:30.460899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:30.460899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:30.460899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:30.460899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:30.460899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:30.460899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:30.460899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:30.460899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:30.460899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:30.460899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:30.461806 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:30.461806 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:30.461806 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:30.461806 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:30.461806 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:30.461806 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:30.461806 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:30.461806 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:30.461806 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:30.461806 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:30.461806 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:30.461806 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:30.461806 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:30.461806 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:30.461806 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:30.461806 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:30.461806 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:30.463073 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:30.463073 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:30.463073 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:30.463073 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:30.463073 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 279/548] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:30.467570 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dcbb4e-20b0-46a5-a731-96ab267928d5 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:30.482266 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891b310-d80a-4e96-a67a-46fc67ca812f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:30.483421 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891b310-d80a-4e96-a67a-46fc67ca812f None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:30.483556 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:30.484035 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891b310-d80a-4e96-a67a-46fc67ca812f None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:30.484535 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891b310-d80a-4e96-a67a-46fc67ca812f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:30.496893 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8891b310-d80a-4e96-a67a-46fc67ca812f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:45:30.508550 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-8891b310-d80a-4e96-a67a-46fc67ca812f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 11:45:30.508550 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:30.508550 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:30.508550 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:30.508550 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:30.508550 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:30.508550 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:30.508550 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:30.508550 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:30.508550 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:30.508550 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:30.508550 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:30.508550 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:45:30.508550 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:45:30.508550 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:45:30.508550 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:45:30.510033 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:45:30.510033 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:45:30.510033 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:45:30.510033 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:45:30.510033 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:30.510033 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:30.510033 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:30.510033 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:30.510033 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:30.510033 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:30.510033 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:30.510033 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:30.510033 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:30.510033 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:30.510033 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:30.510033 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:30.510981 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:30.510981 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:30.510981 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:30.510981 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:30.510981 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:45:30.510981 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:45:30.510981 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:45:30.510981 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:45:30.510981 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:45:30.510981 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:45:30.510981 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 11:45:30.510981 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:30.510981 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 270/549] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Jun 3 11:45:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:45:30.514226 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891b310-d80a-4e96-a67a-46fc67ca812f None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:30.547905 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:30.619628 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891b310-d80a-4e96-a67a-46fc67ca812f None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:30.655703 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e9d18-a8d5-4bc0-ab01-0111adffcfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:30.656759 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e9d18-a8d5-4bc0-ab01-0111adffcfb4 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:30.657256 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e9d18-a8d5-4bc0-ab01-0111adffcfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:30.657746 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e9d18-a8d5-4bc0-ab01-0111adffcfb4 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:30.659259 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e9d18-a8d5-4bc0-ab01-0111adffcfb4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:30.659827 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e9d18-a8d5-4bc0-ab01-0111adffcfb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:30.661489 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e9d18-a8d5-4bc0-ab01-0111adffcfb4 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:30.671418 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 271/550] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Jun 3 11:45:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:30.677429 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e9d18-a8d5-4bc0-ab01-0111adffcfb4 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:30.785419 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e9d18-a8d5-4bc0-ab01-0111adffcfb4 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:30.802381 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dcbb4e-20b0-46a5-a731-96ab267928d5 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:30.807920 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:30.838264 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f0c50-ef4b-4e40-988b-2ba90388426e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:30.838932 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f0c50-ef4b-4e40-988b-2ba90388426e None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:30.839217 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f0c50-ef4b-4e40-988b-2ba90388426e None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:30.839494 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f0c50-ef4b-4e40-988b-2ba90388426e None admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:30.840428 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365f0c50-ef4b-4e40-988b-2ba90388426e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:30.840742 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365f0c50-ef4b-4e40-988b-2ba90388426e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:30.842229 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365f0c50-ef4b-4e40-988b-2ba90388426e None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:30.848387 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a72043-9d89-43a1-b67b-cb3a4b3e1760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:30.849198 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a72043-9d89-43a1-b67b-cb3a4b3e1760 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:30.849486 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a72043-9d89-43a1-b67b-cb3a4b3e1760 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:30.849764 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a72043-9d89-43a1-b67b-cb3a4b3e1760 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:30.856103 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 280/551] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:30.861729 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f0c50-ef4b-4e40-988b-2ba90388426e None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:30.867277 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a72043-9d89-43a1-b67b-cb3a4b3e1760 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:30.868823 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a72043-9d89-43a1-b67b-cb3a4b3e1760 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:30.912969 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-a5a72043-9d89-43a1-b67b-cb3a4b3e1760 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:30.912969 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:30.912969 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:30.912969 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:30.912969 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:30.912969 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:30.912969 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:30.912969 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:30.912969 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:30.912969 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:30.912969 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:30.912969 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:30.912969 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:30.912969 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:30.912969 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:30.913971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:30.913971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:30.913971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:30.913971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:30.913971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:30.913971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:30.913971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:30.913971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:30.913971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:30.913971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:30.913971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:30.913971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:30.913971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:30.913971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:30.913971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:30.913971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:30.913971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:30.914924 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:30.914924 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:30.914924 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:30.914924 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:30.914924 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 272/552] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:30.920914 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a72043-9d89-43a1-b67b-cb3a4b3e1760 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:30.931104 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:30.971833 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f0c50-ef4b-4e40-988b-2ba90388426e None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:31.009616 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde86a4e-b38c-4e1c-a817-fa00ed79ad49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:31.010421 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde86a4e-b38c-4e1c-a817-fa00ed79ad49 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:31.010706 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde86a4e-b38c-4e1c-a817-fa00ed79ad49 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:31.010981 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde86a4e-b38c-4e1c-a817-fa00ed79ad49 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:31.028096 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde86a4e-b38c-4e1c-a817-fa00ed79ad49 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:31.029561 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde86a4e-b38c-4e1c-a817-fa00ed79ad49 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:31.051191 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-cde86a4e-b38c-4e1c-a817-fa00ed79ad49 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 03 11:45:31.051191 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:31.051191 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:31.051191 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:31.051191 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:31.051191 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:31.051191 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:31.051191 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:31.051191 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:31.051191 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:31.051191 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:31.051191 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:31.051191 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 11:45:31.051191 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 11:45:31.051191 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 11:45:31.051191 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 11:45:31.052235 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:31.052235 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:31.052235 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 11:45:31.052235 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:45:31.052235 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 11:45:31.052235 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:45:31.052235 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:31.052235 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:31.052235 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:31.052235 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:31.052235 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:31.052235 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:31.052235 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:31.052235 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:31.052235 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:31.052235 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:31.052235 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:31.052235 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:31.053168 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:31.053168 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:31.053168 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 11:45:31.053168 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 11:45:31.053168 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 11:45:31.053168 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 11:45:31.053168 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 11:45:31.053168 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 11:45:31.053168 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 03 11:45:31.053168 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:31.066163 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 281/553] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 3 11:45:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:31.068059 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde86a4e-b38c-4e1c-a817-fa00ed79ad49 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:31.151902 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a72043-9d89-43a1-b67b-cb3a4b3e1760 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:31.195066 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:31.199624 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69714c93-812f-4d62-82ee-6d6c77935512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:31.200377 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69714c93-812f-4d62-82ee-6d6c77935512 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:31.200667 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69714c93-812f-4d62-82ee-6d6c77935512 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:31.200946 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69714c93-812f-4d62-82ee-6d6c77935512 None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:31.201693 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69714c93-812f-4d62-82ee-6d6c77935512 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:31.202000 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69714c93-812f-4d62-82ee-6d6c77935512 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:31.203531 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69714c93-812f-4d62-82ee-6d6c77935512 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:31.218700 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 273/554] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:31.220153 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2cdfd-9253-4ee3-b948-10f19365d33b None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:31.220445 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2cdfd-9253-4ee3-b948-10f19365d33b None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:31.220759 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2cdfd-9253-4ee3-b948-10f19365d33b None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:31.222881 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde86a4e-b38c-4e1c-a817-fa00ed79ad49 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:31.226135 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 274/555] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:45:31.226917 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2cdfd-9253-4ee3-b948-10f19365d33b None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:31.248839 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:31.261168 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4777642e-a69a-4ae7-80aa-1e36ee3812cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:31.261842 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777642e-a69a-4ae7-80aa-1e36ee3812cb None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:31.262128 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777642e-a69a-4ae7-80aa-1e36ee3812cb None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:31.262450 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777642e-a69a-4ae7-80aa-1e36ee3812cb None admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:31.263237 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4777642e-a69a-4ae7-80aa-1e36ee3812cb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:31.263571 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4777642e-a69a-4ae7-80aa-1e36ee3812cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:31.264994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4777642e-a69a-4ae7-80aa-1e36ee3812cb None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:31.287878 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 282/556] 10.222.0.15 () {56 vars in 1135 bytes} [Fri Jun 3 11:45:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:31.289210 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b6dd0-5df7-4849-ac96-a3045da80584 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:31.289504 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b6dd0-5df7-4849-ac96-a3045da80584 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:31.289780 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b6dd0-5df7-4849-ac96-a3045da80584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:31.306118 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-899b6dd0-5df7-4849-ac96-a3045da80584 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:31.307294 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-899b6dd0-5df7-4849-ac96-a3045da80584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:31.338866 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2cdfd-9253-4ee3-b948-10f19365d33b None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:31.375537 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f53cf9-c11c-491d-a8c5-5ed514c00a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:31.376292 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f53cf9-c11c-491d-a8c5-5ed514c00a75 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:31.376635 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f53cf9-c11c-491d-a8c5-5ed514c00a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:31.377453 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f53cf9-c11c-491d-a8c5-5ed514c00a75 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:31.377635 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 283/557] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:45:31.378469 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899b6dd0-5df7-4849-ac96-a3045da80584 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:31.395334 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f53cf9-c11c-491d-a8c5-5ed514c00a75 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:31.396886 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f53cf9-c11c-491d-a8c5-5ed514c00a75 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:31.424147 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-a3f53cf9-c11c-491d-a8c5-5ed514c00a75 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 11:45:31.424147 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:31.424147 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:31.424147 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:31.424147 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:31.424147 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:31.424147 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:31.424147 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:31.424147 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:31.424147 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:31.424147 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:31.424147 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:31.424147 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 11:45:31.424147 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 11:45:31.424147 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 11:45:31.424147 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 11:45:31.426836 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:31.426836 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:31.426836 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 11:45:31.426836 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:45:31.426836 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 11:45:31.426836 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:45:31.426836 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:31.426836 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:31.426836 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:31.426836 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:31.426836 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:31.426836 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:31.426836 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:31.426836 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:31.426836 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:31.426836 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:31.426836 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:31.426836 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:31.428963 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:31.428963 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:31.428963 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 11:45:31.428963 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 11:45:31.428963 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 11:45:31.428963 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 11:45:31.428963 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 11:45:31.428963 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 11:45:31.428963 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 11:45:31.428963 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:31.428963 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 275/558] 10.222.0.15 () {56 vars in 1093 bytes} [Fri Jun 3 11:45:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:31.428963 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f53cf9-c11c-491d-a8c5-5ed514c00a75 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:31.483623 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899b6dd0-5df7-4849-ac96-a3045da80584 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:31.487726 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:31.498937 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:31.522529 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984901e-5aa0-4d74-81b5-a5cbad8feaae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:31.523289 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984901e-5aa0-4d74-81b5-a5cbad8feaae None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:31.523595 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984901e-5aa0-4d74-81b5-a5cbad8feaae None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:31.523877 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984901e-5aa0-4d74-81b5-a5cbad8feaae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:31.544301 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f53cf9-c11c-491d-a8c5-5ed514c00a75 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:31.580885 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe28b6-b503-41ef-a155-68a9eafd7e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:31.581672 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe28b6-b503-41ef-a155-68a9eafd7e7b None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:31.581952 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe28b6-b503-41ef-a155-68a9eafd7e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:31.582227 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe28b6-b503-41ef-a155-68a9eafd7e7b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:31.593176 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe28b6-b503-41ef-a155-68a9eafd7e7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:45:31.597713 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7984901e-5aa0-4d74-81b5-a5cbad8feaae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:31.599176 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7984901e-5aa0-4d74-81b5-a5cbad8feaae None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:31.601469 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-67fe28b6-b503-41ef-a155-68a9eafd7e7b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 11:45:31.601469 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:31.601469 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:31.601469 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:31.601469 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:31.601469 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:31.601469 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:31.601469 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:31.601469 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:31.601469 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:31.601469 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:31.601469 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:31.601469 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:45:31.601469 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:45:31.601469 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:45:31.601469 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:45:31.602480 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:45:31.602480 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:45:31.602480 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:45:31.602480 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:45:31.602480 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:31.602480 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:31.602480 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:31.602480 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:31.602480 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:31.602480 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:31.602480 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:31.602480 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:31.602480 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:31.602480 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:31.602480 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:31.602480 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:31.603336 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:31.603336 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:31.603336 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:31.603336 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:31.603336 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:45:31.603336 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:45:31.603336 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:45:31.603336 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:45:31.603336 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:45:31.603336 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:45:31.603336 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 11:45:31.603336 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:31.603336 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 276/559] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Jun 3 11:45:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:45:31.605337 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe28b6-b503-41ef-a155-68a9eafd7e7b None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:31.706945 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe28b6-b503-41ef-a155-68a9eafd7e7b None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:31.712769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 284/560] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:45:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 11:45:31.712769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfaec43-8450-4b3f-b3a7-151196c5e946 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:31.712769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfaec43-8450-4b3f-b3a7-151196c5e946 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:31.712769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfaec43-8450-4b3f-b3a7-151196c5e946 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:31.712769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 285/561] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:45:31.712769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfaec43-8450-4b3f-b3a7-151196c5e946 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:31.727127 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:31.731486 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:31.754217 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c066f06d-9abc-443c-896f-55a77595710c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:31.754898 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066f06d-9abc-443c-896f-55a77595710c None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:31.755180 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066f06d-9abc-443c-896f-55a77595710c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:31.755455 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066f06d-9abc-443c-896f-55a77595710c None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:31.756357 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c066f06d-9abc-443c-896f-55a77595710c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:31.756668 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c066f06d-9abc-443c-896f-55a77595710c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:31.758143 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c066f06d-9abc-443c-896f-55a77595710c None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:31.776116 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 277/562] 10.222.0.15 () {56 vars in 1133 bytes} [Fri Jun 3 11:45:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:31.776873 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c066f06d-9abc-443c-896f-55a77595710c None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:31.839573 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfaec43-8450-4b3f-b3a7-151196c5e946 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:31.877521 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b39385-b0e2-4876-aa89-5758a275971d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:31.878196 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b39385-b0e2-4876-aa89-5758a275971d None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:31.878477 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b39385-b0e2-4876-aa89-5758a275971d None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:31.878755 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b39385-b0e2-4876-aa89-5758a275971d None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:31.879525 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b39385-b0e2-4876-aa89-5758a275971d None admin] RBAC: Adding query filter params (name=service) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:31.879837 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b39385-b0e2-4876-aa89-5758a275971d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:31.881469 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b39385-b0e2-4876-aa89-5758a275971d None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:31.883769 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c066f06d-9abc-443c-896f-55a77595710c None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:31.893191 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 286/563] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Jun 3 11:45:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:31.894817 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720dfb91-91c2-4607-97b1-9f68f0e96b12 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:31.895372 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720dfb91-91c2-4607-97b1-9f68f0e96b12 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:31.895879 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720dfb91-91c2-4607-97b1-9f68f0e96b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:31.916371 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-720dfb91-91c2-4607-97b1-9f68f0e96b12 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:31.917536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-720dfb91-91c2-4607-97b1-9f68f0e96b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:31.925488 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c7b0a-7dc3-4c00-b86a-146e0fbcbd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:31.926707 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c7b0a-7dc3-4c00-b86a-146e0fbcbd5c None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:31.926995 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c7b0a-7dc3-4c00-b86a-146e0fbcbd5c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:31.927274 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c7b0a-7dc3-4c00-b86a-146e0fbcbd5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:31.938400 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c7b0a-7dc3-4c00-b86a-146e0fbcbd5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:31.939995 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c7b0a-7dc3-4c00-b86a-146e0fbcbd5c None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:31.957637 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-9a5c7b0a-7dc3-4c00-b86a-146e0fbcbd5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:31.957637 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:31.957637 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:31.957637 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:31.957637 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:31.957637 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:31.957637 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:31.957637 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:31.957637 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:31.957637 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:31.957637 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:31.957637 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:31.957637 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:31.957637 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:31.957637 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:31.958511 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:31.958511 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:31.958511 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:31.958511 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:31.958511 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:31.958511 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:31.958511 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:31.958511 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:31.958511 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:31.958511 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:31.958511 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:31.958511 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:31.958511 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:31.958511 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:31.958511 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:31.958511 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:31.958511 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:31.959412 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:31.959412 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:31.959412 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:31.959412 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:31.959412 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 278/564] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:31.960161 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c7b0a-7dc3-4c00-b86a-146e0fbcbd5c None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:31.988721 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:31.992981 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 287/565] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:45:31.993831 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720dfb91-91c2-4607-97b1-9f68f0e96b12 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:31.997747 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:32.080897 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c7b0a-7dc3-4c00-b86a-146e0fbcbd5c None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:32.098935 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720dfb91-91c2-4607-97b1-9f68f0e96b12 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:32.114504 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0405412-e792-423c-80d0-d13b1994c205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:32.115295 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0405412-e792-423c-80d0-d13b1994c205 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:32.115619 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0405412-e792-423c-80d0-d13b1994c205 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:32.115896 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0405412-e792-423c-80d0-d13b1994c205 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:32.126152 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0405412-e792-423c-80d0-d13b1994c205 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:32.127677 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0405412-e792-423c-80d0-d13b1994c205 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:32.131930 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7599df3-e03a-4b95-b759-fd7a3000dc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:32.132716 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7599df3-e03a-4b95-b759-fd7a3000dc99 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:32.132998 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7599df3-e03a-4b95-b759-fd7a3000dc99 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:32.133272 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7599df3-e03a-4b95-b759-fd7a3000dc99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:32.143037 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7599df3-e03a-4b95-b759-fd7a3000dc99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:32.144380 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-b0405412-e792-423c-80d0-d13b1994c205 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:32.144380 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:32.144380 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:32.144380 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:32.144380 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:32.144380 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:32.144380 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:32.144380 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:32.144380 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:32.144380 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:32.144380 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:32.144380 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:32.144380 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:32.144380 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:32.144380 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:32.145416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:32.145416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:32.145416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:32.145416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:32.145416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:32.145416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:32.145416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:32.145416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:32.145416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:32.145416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:32.145416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:32.145416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:32.145416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:32.145416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:32.145416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:32.145416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:32.145416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:32.146487 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:32.146487 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:32.146487 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:32.146487 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:32.146726 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7599df3-e03a-4b95-b759-fd7a3000dc99 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:32.147660 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 279/566] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:32.148692 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0405412-e792-423c-80d0-d13b1994c205 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:32.162637 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-f7599df3-e03a-4b95-b759-fd7a3000dc99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:32.162637 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:32.162637 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:32.162637 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:32.162637 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:32.162637 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:32.162637 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:32.162637 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:32.162637 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:32.162637 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:32.162637 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:32.162637 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:32.162637 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:32.162637 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:32.162637 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:32.163685 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:32.163685 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:32.163685 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:32.163685 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:32.163685 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:32.163685 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:32.163685 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:32.163685 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:32.163685 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:32.163685 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:32.163685 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:32.163685 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:32.163685 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:32.163685 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:32.163685 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:32.163685 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:32.163685 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:32.164582 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:32.164582 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:32.164582 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:32.164582 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:32.164582 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 288/567] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:32.164868 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7599df3-e03a-4b95-b759-fd7a3000dc99 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:32.219318 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:32.227113 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:32.252304 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0405412-e792-423c-80d0-d13b1994c205 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:32.263813 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7599df3-e03a-4b95-b759-fd7a3000dc99 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:32.285510 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418efd8-e436-4a7b-8148-fdec83f3c82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:32.286160 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418efd8-e436-4a7b-8148-fdec83f3c82f None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:32.286440 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418efd8-e436-4a7b-8148-fdec83f3c82f None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:32.286714 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418efd8-e436-4a7b-8148-fdec83f3c82f None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:32.287425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9418efd8-e436-4a7b-8148-fdec83f3c82f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:32.287760 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9418efd8-e436-4a7b-8148-fdec83f3c82f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:32.289143 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9418efd8-e436-4a7b-8148-fdec83f3c82f None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:32.298140 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440c5db-5182-4c44-983c-751338b63e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:32.298924 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440c5db-5182-4c44-983c-751338b63e3a None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:32.299206 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440c5db-5182-4c44-983c-751338b63e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:32.299484 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440c5db-5182-4c44-983c-751338b63e3a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:32.300672 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 280/568] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:32.301873 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154c21a-0459-4f95-8c91-44ae839b8532 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:32.302157 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154c21a-0459-4f95-8c91-44ae839b8532 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:32.302430 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154c21a-0459-4f95-8c91-44ae839b8532 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:32.303666 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 281/569] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:45:32.304350 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d154c21a-0459-4f95-8c91-44ae839b8532 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:32.314047 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440c5db-5182-4c44-983c-751338b63e3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:45:32.321892 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-8440c5db-5182-4c44-983c-751338b63e3a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 11:45:32.321892 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:32.321892 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:32.321892 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:32.321892 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:32.321892 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:32.321892 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:32.321892 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:32.321892 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:32.321892 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:32.321892 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:32.321892 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:32.321892 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:45:32.321892 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:45:32.321892 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:45:32.321892 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:45:32.322895 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:45:32.322895 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:45:32.322895 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:45:32.322895 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:45:32.322895 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:32.322895 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:32.322895 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:32.322895 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:32.322895 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:32.322895 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:32.322895 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:32.322895 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:32.322895 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:32.322895 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:32.322895 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:32.322895 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:32.323846 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:32.323846 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:32.323846 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:32.323846 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:32.323846 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:45:32.323846 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:45:32.323846 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:45:32.323846 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:45:32.323846 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:45:32.323846 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:45:32.323846 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 11:45:32.323846 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:32.323846 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 289/570] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Jun 3 11:45:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:32.324548 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440c5db-5182-4c44-983c-751338b63e3a None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:32.405592 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d154c21a-0459-4f95-8c91-44ae839b8532 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:32.421762 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440c5db-5182-4c44-983c-751338b63e3a None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:32.437246 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:32.439746 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3f796-750b-44e4-a663-f360275c0478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:32.440411 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3f796-750b-44e4-a663-f360275c0478 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:32.440694 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3f796-750b-44e4-a663-f360275c0478 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:32.441393 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3f796-750b-44e4-a663-f360275c0478 None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:32.442113 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3f796-750b-44e4-a663-f360275c0478 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:32.442457 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3f796-750b-44e4-a663-f360275c0478 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:32.443848 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3f796-750b-44e4-a663-f360275c0478 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:32.445413 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:32.454849 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f479f8-0c22-4502-8d3d-f3a56270042d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:32.456115 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f479f8-0c22-4502-8d3d-f3a56270042d None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:32.456396 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f479f8-0c22-4502-8d3d-f3a56270042d None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:32.456670 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f479f8-0c22-4502-8d3d-f3a56270042d None admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:32.456805 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 282/571] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:32.457465 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3f796-750b-44e4-a663-f360275c0478 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:32.457568 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f479f8-0c22-4502-8d3d-f3a56270042d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:32.457790 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f479f8-0c22-4502-8d3d-f3a56270042d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:32.459167 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f479f8-0c22-4502-8d3d-f3a56270042d None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:32.471732 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 290/572] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:32.472882 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385df98-6999-4888-a8ca-8ecf3e633fdf None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:32.473170 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385df98-6999-4888-a8ca-8ecf3e633fdf None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:32.473449 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385df98-6999-4888-a8ca-8ecf3e633fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:32.490232 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-0385df98-6999-4888-a8ca-8ecf3e633fdf None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:32.491400 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-0385df98-6999-4888-a8ca-8ecf3e633fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:32.556172 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 291/573] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:45:32.556982 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385df98-6999-4888-a8ca-8ecf3e633fdf None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:32.557231 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3f796-750b-44e4-a663-f360275c0478 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:32.601801 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998de6ae-c47b-4b4b-b653-61f147e38c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:32.602556 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998de6ae-c47b-4b4b-b653-61f147e38c39 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:32.602840 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998de6ae-c47b-4b4b-b653-61f147e38c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:32.603116 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998de6ae-c47b-4b4b-b653-61f147e38c39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:32.609881 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998de6ae-c47b-4b4b-b653-61f147e38c39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:32.611382 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998de6ae-c47b-4b4b-b653-61f147e38c39 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:32.625419 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-998de6ae-c47b-4b4b-b653-61f147e38c39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:45:32.625419 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:32.625419 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:32.625419 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:32.625419 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:32.625419 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:32.625419 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:32.625419 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:32.625419 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:32.625419 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:32.625419 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:32.625419 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:32.625419 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 11:45:32.625419 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 11:45:32.625419 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 11:45:32.626310 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 11:45:32.626310 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:32.626310 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:32.626310 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:32.626310 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:32.626310 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:32.626310 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:32.626310 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:32.626310 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:32.626310 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:32.626310 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:32.626310 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:32.626310 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:32.626310 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:32.626310 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:32.626310 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:32.626310 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:32.627991 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 11:45:32.627991 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 11:45:32.627991 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 11:45:32.627991 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 11:45:32.627991 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 11:45:32.627991 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 11:45:32.627991 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:45:32.627991 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:32.627991 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 283/574] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:45:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:32.627991 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998de6ae-c47b-4b4b-b653-61f147e38c39 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:32.656671 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385df98-6999-4888-a8ca-8ecf3e633fdf None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:32.665211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:32.686779 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:32.693387 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf9a42-c598-4af5-ad44-392abb07092d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:32.694058 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf9a42-c598-4af5-ad44-392abb07092d None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:32.694340 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf9a42-c598-4af5-ad44-392abb07092d None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:32.694615 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf9a42-c598-4af5-ad44-392abb07092d None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:32.695414 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf9a42-c598-4af5-ad44-392abb07092d None admin] RBAC: Adding query filter params (name=service) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:32.695755 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf9a42-c598-4af5-ad44-392abb07092d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:32.697124 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf9a42-c598-4af5-ad44-392abb07092d None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:32.705184 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 292/575] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Jun 3 11:45:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:32.708354 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf9a42-c598-4af5-ad44-392abb07092d None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:32.741363 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998de6ae-c47b-4b4b-b653-61f147e38c39 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:32.774122 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f330f6ef-6631-4d28-beac-0b1a14f966c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:32.774905 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330f6ef-6631-4d28-beac-0b1a14f966c2 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:32.775189 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330f6ef-6631-4d28-beac-0b1a14f966c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:32.775774 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330f6ef-6631-4d28-beac-0b1a14f966c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:32.782328 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f330f6ef-6631-4d28-beac-0b1a14f966c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:32.784311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f330f6ef-6631-4d28-beac-0b1a14f966c2 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:32.799576 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-f330f6ef-6631-4d28-beac-0b1a14f966c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:45:32.799576 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:32.799576 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:32.799576 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:32.799576 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:32.799576 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:32.799576 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:32.799576 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:32.799576 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:32.799576 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:32.799576 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:32.799576 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:32.799576 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 11:45:32.799576 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 11:45:32.799576 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 11:45:32.800439 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 11:45:32.800439 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:32.800439 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:32.800439 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:32.800439 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:32.800439 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:32.800439 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:32.800439 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:32.800439 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:32.800439 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:32.800439 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:32.800439 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:32.800439 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:32.800439 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:32.800439 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:32.800439 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:32.800439 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:32.801309 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 11:45:32.801309 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 11:45:32.801309 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 11:45:32.801309 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 11:45:32.801309 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 11:45:32.801309 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 11:45:32.801309 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:45:32.801309 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:32.801309 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 284/576] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:45:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:32.801782 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f330f6ef-6631-4d28-beac-0b1a14f966c2 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:32.808977 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf9a42-c598-4af5-ad44-392abb07092d None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:32.841703 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5c463-ebee-4099-b836-05a917618ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:32.842495 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5c463-ebee-4099-b836-05a917618ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:32.842775 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5c463-ebee-4099-b836-05a917618ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:32.843050 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5c463-ebee-4099-b836-05a917618ee7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:32.850980 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea5c463-ebee-4099-b836-05a917618ee7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:32.852450 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea5c463-ebee-4099-b836-05a917618ee7 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:32.866737 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-aea5c463-ebee-4099-b836-05a917618ee7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 03 11:45:32.866737 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:32.866737 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:32.866737 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:32.866737 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:32.866737 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:32.866737 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:32.866737 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:32.866737 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:32.866737 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:32.866737 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:32.866737 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:32.866737 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 11:45:32.866737 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 11:45:32.866737 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 11:45:32.866737 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 11:45:32.867684 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:32.867684 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:32.867684 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 11:45:32.867684 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:45:32.867684 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 11:45:32.867684 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:45:32.867684 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:32.867684 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:32.867684 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:32.867684 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:32.867684 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:32.867684 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:32.867684 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:32.867684 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:32.867684 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:32.867684 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:32.867684 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:32.867684 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:32.868628 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:32.868628 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:32.868628 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 11:45:32.868628 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 11:45:32.868628 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 11:45:32.868628 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 11:45:32.868628 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 11:45:32.868628 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 11:45:32.868628 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 03 11:45:32.868628 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:32.868628 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 293/577] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:45:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:32.869204 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5c463-ebee-4099-b836-05a917618ee7 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:32.897352 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:32.907331 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f330f6ef-6631-4d28-beac-0b1a14f966c2 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:32.921864 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:32.942500 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d974d-8d3a-4f11-9e0e-0bf2dbe7ec97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:32.943283 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d974d-8d3a-4f11-9e0e-0bf2dbe7ec97 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:32.943591 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d974d-8d3a-4f11-9e0e-0bf2dbe7ec97 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:32.943868 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d974d-8d3a-4f11-9e0e-0bf2dbe7ec97 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:32.953742 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d974d-8d3a-4f11-9e0e-0bf2dbe7ec97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:45:32.961424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-af8d974d-8d3a-4f11-9e0e-0bf2dbe7ec97 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 11:45:32.961424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:32.961424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:32.961424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:32.961424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:32.961424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:32.961424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:32.961424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:32.961424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:32.961424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:32.961424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:32.961424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:32.961424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:45:32.961424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:45:32.961424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:45:32.961424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:45:32.962545 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:45:32.962545 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:45:32.962545 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:45:32.962545 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:45:32.962545 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:32.962545 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:32.962545 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:32.962545 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:32.962545 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:32.962545 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:32.962545 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:32.962545 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:32.962545 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:32.962545 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:32.962545 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:32.962545 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:32.963613 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:32.963613 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:32.963613 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:32.963613 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:32.963613 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:45:32.963613 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:45:32.963613 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:45:32.963613 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:45:32.963613 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:45:32.963613 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:45:32.963613 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 11:45:32.963613 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:32.963613 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 285/578] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Jun 3 11:45:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:32.963613 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d974d-8d3a-4f11-9e0e-0bf2dbe7ec97 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:32.975777 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5c463-ebee-4099-b836-05a917618ee7 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:33.008820 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b9fab-1351-42a9-8714-d9626072e2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:33.009445 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b9fab-1351-42a9-8714-d9626072e2fa None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:33.009735 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b9fab-1351-42a9-8714-d9626072e2fa None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:33.010017 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b9fab-1351-42a9-8714-d9626072e2fa None admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:33.010803 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b9fab-1351-42a9-8714-d9626072e2fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:33.011119 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b9fab-1351-42a9-8714-d9626072e2fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:33.012604 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b9fab-1351-42a9-8714-d9626072e2fa None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:33.024989 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 294/579] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 3 11:45:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:33.026022 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b9fab-1351-42a9-8714-d9626072e2fa None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:33.067903 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d974d-8d3a-4f11-9e0e-0bf2dbe7ec97 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:33.101187 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c32f5-142b-4b78-8e2f-c5d07b1d9d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:33.101959 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c32f5-142b-4b78-8e2f-c5d07b1d9d2e None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:33.102242 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c32f5-142b-4b78-8e2f-c5d07b1d9d2e None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:33.102525 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c32f5-142b-4b78-8e2f-c5d07b1d9d2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:33.112859 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c32f5-142b-4b78-8e2f-c5d07b1d9d2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:33.113217 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:33.114308 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c32f5-142b-4b78-8e2f-c5d07b1d9d2e None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:33.125525 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b9fab-1351-42a9-8714-d9626072e2fa None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:33.131323 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-ef2c32f5-142b-4b78-8e2f-c5d07b1d9d2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:33.131323 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:33.131323 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:33.131323 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:33.131323 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:33.131323 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:33.131323 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:33.131323 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:33.131323 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:33.131323 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:33.131323 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:33.131323 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:33.131323 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:33.131323 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:33.131323 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:33.132226 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:33.132226 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:33.132226 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:33.132226 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:33.132226 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:33.132226 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:33.132226 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:33.132226 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:33.132226 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:33.132226 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:33.132226 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:33.132226 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:33.132226 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:33.132226 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:33.132226 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:33.132226 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:33.132226 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:33.133110 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:33.133110 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:33.133110 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:33.133110 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:33.133110 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 286/580] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:33.133595 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c32f5-142b-4b78-8e2f-c5d07b1d9d2e None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:33.161633 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:33.162172 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd946e-5ef2-42ab-85d1-9664aabcc490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:33.162843 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd946e-5ef2-42ab-85d1-9664aabcc490 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:33.163132 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd946e-5ef2-42ab-85d1-9664aabcc490 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:33.163417 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd946e-5ef2-42ab-85d1-9664aabcc490 None admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:33.164233 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd946e-5ef2-42ab-85d1-9664aabcc490 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:33.164551 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd946e-5ef2-42ab-85d1-9664aabcc490 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:33.165984 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd946e-5ef2-42ab-85d1-9664aabcc490 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:33.177314 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 295/581] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 3 11:45:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:33.178101 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd946e-5ef2-42ab-85d1-9664aabcc490 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:33.235634 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c32f5-142b-4b78-8e2f-c5d07b1d9d2e None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:33.268341 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1237fd-6e9f-42e9-b444-a613c9d4f16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:33.268942 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1237fd-6e9f-42e9-b444-a613c9d4f16b None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:33.269220 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1237fd-6e9f-42e9-b444-a613c9d4f16b None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:33.269491 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1237fd-6e9f-42e9-b444-a613c9d4f16b None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:33.270314 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1237fd-6e9f-42e9-b444-a613c9d4f16b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:33.270620 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1237fd-6e9f-42e9-b444-a613c9d4f16b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:33.272077 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1237fd-6e9f-42e9-b444-a613c9d4f16b None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:33.277514 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd946e-5ef2-42ab-85d1-9664aabcc490 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:33.289346 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 287/582] 10.222.0.15 () {56 vars in 1137 bytes} [Fri Jun 3 11:45:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:33.290130 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1237fd-6e9f-42e9-b444-a613c9d4f16b None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:33.315144 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b032bd-685f-48ac-b961-0a3d7b26f636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:33.315839 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b032bd-685f-48ac-b961-0a3d7b26f636 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:33.316122 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b032bd-685f-48ac-b961-0a3d7b26f636 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:33.316395 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b032bd-685f-48ac-b961-0a3d7b26f636 None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:33.317130 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b032bd-685f-48ac-b961-0a3d7b26f636 None admin] RBAC: Adding query filter params (name=service) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:33.317439 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b032bd-685f-48ac-b961-0a3d7b26f636 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:33.318804 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b032bd-685f-48ac-b961-0a3d7b26f636 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:33.326528 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 296/583] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Jun 3 11:45:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:33.327291 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b032bd-685f-48ac-b961-0a3d7b26f636 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:33.341043 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:33.373464 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:33.389636 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1237fd-6e9f-42e9-b444-a613c9d4f16b None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:33.424062 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84056e75-2592-4d6d-9830-3c38607042ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:33.424824 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84056e75-2592-4d6d-9830-3c38607042ae None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:33.425108 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84056e75-2592-4d6d-9830-3c38607042ae None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:33.425379 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84056e75-2592-4d6d-9830-3c38607042ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:33.426196 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84056e75-2592-4d6d-9830-3c38607042ae None admin] RBAC: Adding query filter params (role.id=41158ae54c7a437284af718034e9b354, scope.project.id=cff223ee05524cf4bf3591fc5a39559e, user.id=5f52901fe535420bb0019272d4eafe72) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:33.426510 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84056e75-2592-4d6d-9830-3c38607042ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:33.427743 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b032bd-685f-48ac-b961-0a3d7b26f636 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:33.427974 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84056e75-2592-4d6d-9830-3c38607042ae None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:33.433387 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 288/584] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:45:33 2022] GET /identity/v3/role_assignments?user.id=5f52901fe535420bb0019272d4eafe72&scope.project.id=cff223ee05524cf4bf3591fc5a39559e&role.id=41158ae54c7a437284af718034e9b354 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:33.434130 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84056e75-2592-4d6d-9830-3c38607042ae None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:33.465765 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b97aec-51d7-4346-a527-0d4130c96a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:33.466461 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b97aec-51d7-4346-a527-0d4130c96a4a None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:33.466758 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b97aec-51d7-4346-a527-0d4130c96a4a None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:33.467034 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b97aec-51d7-4346-a527-0d4130c96a4a None admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:33.467822 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b97aec-51d7-4346-a527-0d4130c96a4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:33.468136 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b97aec-51d7-4346-a527-0d4130c96a4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:33.469563 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b97aec-51d7-4346-a527-0d4130c96a4a None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:33.483190 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 297/585] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:33.484100 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b97aec-51d7-4346-a527-0d4130c96a4a None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:33.557270 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84056e75-2592-4d6d-9830-3c38607042ae None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:33.566424 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:33.599078 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ea674-1b05-4326-a7d1-155f08579ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:33.600365 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b97aec-51d7-4346-a527-0d4130c96a4a None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:33.600682 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ea674-1b05-4326-a7d1-155f08579ede None admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:33.601181 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ea674-1b05-4326-a7d1-155f08579ede None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:33.601662 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ea674-1b05-4326-a7d1-155f08579ede None admin] PATH_INFO: `/v3/projects/cff223ee05524cf4bf3591fc5a39559e/users/6247bfb7aebd45eeb97ba5933be44c6d/roles/41158ae54c7a437284af718034e9b354` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:33.619399 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ea674-1b05-4326-a7d1-155f08579ede None admin] RBAC: Authorizing `identity:create_grant(project_id=cff223ee05524cf4bf3591fc5a39559e, user_id=6247bfb7aebd45eeb97ba5933be44c6d, role_id=41158ae54c7a437284af718034e9b354)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:33.621201 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ea674-1b05-4326-a7d1-155f08579ede None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:33.631415 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:33.637235 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 289/586] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Jun 3 11:45:33 2022] PUT /identity/v3/projects/cff223ee05524cf4bf3591fc5a39559e/users/6247bfb7aebd45eeb97ba5933be44c6d/roles/41158ae54c7a437284af718034e9b354 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:45:33.637235 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ea674-1b05-4326-a7d1-155f08579ede None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:33.652441 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612f9b7-61d4-4e2e-a456-2d7f3c6badae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:33.653270 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612f9b7-61d4-4e2e-a456-2d7f3c6badae None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:33.653555 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612f9b7-61d4-4e2e-a456-2d7f3c6badae None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:33.653930 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612f9b7-61d4-4e2e-a456-2d7f3c6badae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:33.670009 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6612f9b7-61d4-4e2e-a456-2d7f3c6badae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:33.672503 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6612f9b7-61d4-4e2e-a456-2d7f3c6badae None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:33.700588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-6612f9b7-61d4-4e2e-a456-2d7f3c6badae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:33.700588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:33.700588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:33.700588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:33.700588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:33.700588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:33.700588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:33.700588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:33.700588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:33.700588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:33.700588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:33.700588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:33.700588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:33.700588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:33.700588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:33.701607 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:33.701607 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:33.701607 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:33.701607 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:33.701607 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:33.701607 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:33.701607 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:33.701607 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:33.701607 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:33.701607 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:33.701607 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:33.701607 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:33.701607 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:33.701607 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:33.701607 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:33.701607 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:33.701607 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:33.702518 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:33.702518 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:33.702518 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:33.702518 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:33.706444 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 298/587] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:33.707736 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612f9b7-61d4-4e2e-a456-2d7f3c6badae None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:33.777215 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ea674-1b05-4326-a7d1-155f08579ede None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:33.827686 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1902d29-0054-4af3-b09b-8914a1bcf3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:33.828864 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1902d29-0054-4af3-b09b-8914a1bcf3b5 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:33.829153 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1902d29-0054-4af3-b09b-8914a1bcf3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:33.829692 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1902d29-0054-4af3-b09b-8914a1bcf3b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:33.831672 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612f9b7-61d4-4e2e-a456-2d7f3c6badae None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:33.842562 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1902d29-0054-4af3-b09b-8914a1bcf3b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:33.844460 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1902d29-0054-4af3-b09b-8914a1bcf3b5 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:33.860586 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:33.864448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-c1902d29-0054-4af3-b09b-8914a1bcf3b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:33.864448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:33.864448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:33.864448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:33.864448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:33.864448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:33.864448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:33.864448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:33.864448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:33.864448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:33.864448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:33.864448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:33.864448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:33.864448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:33.864448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:33.865411 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:33.865411 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:33.865411 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:33.865411 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:33.865411 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:33.865411 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:33.865411 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:33.865411 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:33.865411 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:33.865411 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:33.865411 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:33.865411 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:33.865411 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:33.865411 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:33.865411 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:33.865411 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:33.865411 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:33.866311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:33.866311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:33.866311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:33.866311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:33.866311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 290/588] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:33.866596 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1902d29-0054-4af3-b09b-8914a1bcf3b5 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:33.881271 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c76694-864b-41fc-8a14-e9c392982982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:33.882568 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c76694-864b-41fc-8a14-e9c392982982 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:33.882867 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c76694-864b-41fc-8a14-e9c392982982 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:33.883152 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c76694-864b-41fc-8a14-e9c392982982 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:33.893450 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c76694-864b-41fc-8a14-e9c392982982 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:33.894929 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c76694-864b-41fc-8a14-e9c392982982 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:33.911633 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-a3c76694-864b-41fc-8a14-e9c392982982 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 03 11:45:33.911633 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:33.911633 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:33.911633 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:33.911633 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:33.911633 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:33.911633 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:33.911633 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:33.911633 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:33.911633 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:33.911633 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:33.911633 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:33.911633 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 11:45:33.911633 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 11:45:33.911633 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 11:45:33.911633 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 11:45:33.912595 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:33.912595 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:33.912595 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 11:45:33.912595 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:45:33.912595 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 11:45:33.912595 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:45:33.912595 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:33.912595 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:33.912595 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:33.912595 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:33.912595 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:33.912595 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:33.912595 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:33.912595 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:33.912595 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:33.912595 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:33.912595 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:33.912595 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:33.913623 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:33.913623 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:33.913623 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 11:45:33.913623 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 11:45:33.913623 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 11:45:33.913623 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 11:45:33.913623 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 11:45:33.913623 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 11:45:33.913623 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 03 11:45:33.913623 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:33.913623 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 299/589] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:45:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:33.914258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c76694-864b-41fc-8a14-e9c392982982 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:33.940386 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:33.996323 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1902d29-0054-4af3-b09b-8914a1bcf3b5 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:34.031305 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c76694-864b-41fc-8a14-e9c392982982 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:34.044668 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31380ed-68ca-4d5a-8b49-0b4ad66e031e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:34.045330 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31380ed-68ca-4d5a-8b49-0b4ad66e031e None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:34.045773 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31380ed-68ca-4d5a-8b49-0b4ad66e031e None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:34.046053 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31380ed-68ca-4d5a-8b49-0b4ad66e031e None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:34.047158 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31380ed-68ca-4d5a-8b49-0b4ad66e031e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:34.047607 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31380ed-68ca-4d5a-8b49-0b4ad66e031e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:34.049851 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31380ed-68ca-4d5a-8b49-0b4ad66e031e None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:34.066435 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 291/590] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:34.067289 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31380ed-68ca-4d5a-8b49-0b4ad66e031e None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:34.072838 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa3a92-1281-4e34-9f01-2177fe0b6a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:34.073525 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa3a92-1281-4e34-9f01-2177fe0b6a85 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:34.073811 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa3a92-1281-4e34-9f01-2177fe0b6a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:34.074091 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa3a92-1281-4e34-9f01-2177fe0b6a85 None admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:34.074889 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa3a92-1281-4e34-9f01-2177fe0b6a85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:34.075207 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa3a92-1281-4e34-9f01-2177fe0b6a85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:34.076640 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa3a92-1281-4e34-9f01-2177fe0b6a85 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:34.088891 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 300/591] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:34.089637 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa3a92-1281-4e34-9f01-2177fe0b6a85 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:34.136224 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:34.192536 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31380ed-68ca-4d5a-8b49-0b4ad66e031e None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:34.207618 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:34.209534 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa3a92-1281-4e34-9f01-2177fe0b6a85 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:34.235194 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbaecf-4320-465c-bd86-f4efc742b54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:34.236272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbaecf-4320-465c-bd86-f4efc742b54f None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:34.236766 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbaecf-4320-465c-bd86-f4efc742b54f None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:34.237292 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbaecf-4320-465c-bd86-f4efc742b54f None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:34.238553 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffbaecf-4320-465c-bd86-f4efc742b54f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:34.239114 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffbaecf-4320-465c-bd86-f4efc742b54f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:34.240962 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffbaecf-4320-465c-bd86-f4efc742b54f None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:34.250891 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb5f3a-4f6c-4ed1-85ad-58da2bdcc6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:34.252240 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb5f3a-4f6c-4ed1-85ad-58da2bdcc6b5 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:34.252541 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb5f3a-4f6c-4ed1-85ad-58da2bdcc6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:34.252843 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb5f3a-4f6c-4ed1-85ad-58da2bdcc6b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:34.261783 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cb5f3a-4f6c-4ed1-85ad-58da2bdcc6b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:34.267065 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cb5f3a-4f6c-4ed1-85ad-58da2bdcc6b5 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:34.268128 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 292/592] 10.222.0.15 () {56 vars in 1137 bytes} [Fri Jun 3 11:45:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:34.268989 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbaecf-4320-465c-bd86-f4efc742b54f None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:34.286036 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-09cb5f3a-4f6c-4ed1-85ad-58da2bdcc6b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:45:34.286036 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:34.286036 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:34.286036 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:34.286036 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:34.286036 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:34.286036 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:34.286036 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:34.286036 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:34.286036 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:34.286036 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:34.286036 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:34.286036 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 11:45:34.286036 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 11:45:34.286036 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 11:45:34.287006 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 11:45:34.287006 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:34.287006 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:34.287006 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:34.287006 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:34.287006 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:34.287006 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:34.287006 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:34.287006 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:34.287006 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:34.287006 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:34.287006 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:34.287006 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:34.287006 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:34.287006 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:34.287006 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:34.287006 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:34.287932 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 11:45:34.287932 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 11:45:34.287932 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 11:45:34.287932 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 11:45:34.287932 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 11:45:34.287932 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 11:45:34.287932 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:45:34.287932 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:34.290106 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 301/593] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:45:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:34.291089 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb5f3a-4f6c-4ed1-85ad-58da2bdcc6b5 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:34.386443 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbaecf-4320-465c-bd86-f4efc742b54f None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:34.426036 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb0f46-d411-4327-8009-98024d466096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:34.426264 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb5f3a-4f6c-4ed1-85ad-58da2bdcc6b5 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:34.427316 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb0f46-d411-4327-8009-98024d466096 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:34.427812 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:34.428314 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb0f46-d411-4327-8009-98024d466096 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:34.429454 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb0f46-d411-4327-8009-98024d466096 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:34.438515 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb0f46-d411-4327-8009-98024d466096 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:34.440900 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb0f46-d411-4327-8009-98024d466096 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:34.458021 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-6ecb0f46-d411-4327-8009-98024d466096 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 03 11:45:34.458021 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:34.458021 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:34.458021 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:34.458021 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:34.458021 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:34.458021 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:34.458021 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:34.458021 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:34.458021 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:34.458021 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:34.458021 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:34.458021 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 11:45:34.458021 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 11:45:34.458021 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 11:45:34.458021 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 11:45:34.458986 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:34.458986 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:34.458986 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 11:45:34.458986 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:45:34.458986 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 11:45:34.458986 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:45:34.458986 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:34.458986 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:34.458986 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:34.458986 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:34.458986 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:34.458986 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:34.458986 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:34.458986 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:34.458986 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:34.458986 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:34.458986 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:34.458986 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:34.459975 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:34.459975 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:34.459975 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 11:45:34.459975 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 11:45:34.459975 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 11:45:34.459975 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 11:45:34.459975 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 11:45:34.459975 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 11:45:34.459975 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 03 11:45:34.459975 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:34.463006 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 293/594] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Jun 3 11:45:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:34.464206 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb0f46-d411-4327-8009-98024d466096 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:34.464734 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f855e3f-5123-4e5a-a862-eb2dd6aaae22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:34.465503 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f855e3f-5123-4e5a-a862-eb2dd6aaae22 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:34.465784 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f855e3f-5123-4e5a-a862-eb2dd6aaae22 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:34.466056 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f855e3f-5123-4e5a-a862-eb2dd6aaae22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:34.479851 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f855e3f-5123-4e5a-a862-eb2dd6aaae22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:34.481623 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f855e3f-5123-4e5a-a862-eb2dd6aaae22 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:34.502120 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:34.504232 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-1f855e3f-5123-4e5a-a862-eb2dd6aaae22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:34.504232 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:34.504232 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:34.504232 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:34.504232 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:34.504232 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:34.504232 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:34.504232 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:34.504232 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:34.504232 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:34.504232 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:34.504232 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:34.504232 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:34.504232 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:34.504232 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:34.511968 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:34.511968 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:34.511968 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:34.511968 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:34.511968 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:34.511968 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:34.511968 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:34.511968 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:34.511968 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:34.511968 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:34.511968 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:34.511968 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:34.511968 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:34.511968 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:34.511968 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:34.511968 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:34.511968 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:34.512895 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:34.512895 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:34.512895 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:34.512895 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:34.512895 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 302/595] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:34.512895 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f855e3f-5123-4e5a-a862-eb2dd6aaae22 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:34.592561 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb0f46-d411-4327-8009-98024d466096 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:34.624493 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f855e3f-5123-4e5a-a862-eb2dd6aaae22 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:34.635652 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c33326-0bb9-476c-8506-af39d52b8111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:34.636748 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c33326-0bb9-476c-8506-af39d52b8111 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:34.637253 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c33326-0bb9-476c-8506-af39d52b8111 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:34.637733 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c33326-0bb9-476c-8506-af39d52b8111 None admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:34.638846 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c33326-0bb9-476c-8506-af39d52b8111 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:34.639382 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c33326-0bb9-476c-8506-af39d52b8111 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:34.641232 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c33326-0bb9-476c-8506-af39d52b8111 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:34.655730 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 294/596] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 3 11:45:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:34.656813 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c33326-0bb9-476c-8506-af39d52b8111 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:34.674724 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf8f56-6aa9-4150-b9ee-ca0c526a3c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:34.675707 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf8f56-6aa9-4150-b9ee-ca0c526a3c00 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:34.676002 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf8f56-6aa9-4150-b9ee-ca0c526a3c00 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:34.676278 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf8f56-6aa9-4150-b9ee-ca0c526a3c00 None admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:34.677124 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf8f56-6aa9-4150-b9ee-ca0c526a3c00 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:34.677438 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf8f56-6aa9-4150-b9ee-ca0c526a3c00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:34.679571 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf8f56-6aa9-4150-b9ee-ca0c526a3c00 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:34.703851 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 303/597] 10.222.0.15 () {56 vars in 1139 bytes} [Fri Jun 3 11:45:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:34.705097 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf8f56-6aa9-4150-b9ee-ca0c526a3c00 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:34.723816 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:34.767308 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:34.786431 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c33326-0bb9-476c-8506-af39d52b8111 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:34.825961 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2ef53-8a98-40a9-94e9-b9fb3737fe9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:34.826654 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2ef53-8a98-40a9-94e9-b9fb3737fe9c None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:34.827008 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2ef53-8a98-40a9-94e9-b9fb3737fe9c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:34.827214 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2ef53-8a98-40a9-94e9-b9fb3737fe9c None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:34.827965 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af2ef53-8a98-40a9-94e9-b9fb3737fe9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:34.828271 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af2ef53-8a98-40a9-94e9-b9fb3737fe9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:34.829639 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af2ef53-8a98-40a9-94e9-b9fb3737fe9c None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:34.837357 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf8f56-6aa9-4150-b9ee-ca0c526a3c00 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:34.842719 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 295/598] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:34.843880 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2ef53-8a98-40a9-94e9-b9fb3737fe9c None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:34.883107 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c519b-6af6-4c58-937e-76cf43e06e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:34.884412 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c519b-6af6-4c58-937e-76cf43e06e77 None admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:34.884906 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c519b-6af6-4c58-937e-76cf43e06e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:34.885385 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c519b-6af6-4c58-937e-76cf43e06e77 None admin] PATH_INFO: `/v3/projects/cff223ee05524cf4bf3591fc5a39559e/users/9aa048aec48b4755ac13eae997bff2fc/roles/41158ae54c7a437284af718034e9b354` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:34.906876 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c519b-6af6-4c58-937e-76cf43e06e77 None admin] RBAC: Authorizing `identity:create_grant(project_id=cff223ee05524cf4bf3591fc5a39559e, user_id=9aa048aec48b4755ac13eae997bff2fc, role_id=41158ae54c7a437284af718034e9b354)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:34.909818 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c519b-6af6-4c58-937e-76cf43e06e77 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:34.927719 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 304/599] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Jun 3 11:45:34 2022] PUT /identity/v3/projects/cff223ee05524cf4bf3591fc5a39559e/users/9aa048aec48b4755ac13eae997bff2fc/roles/41158ae54c7a437284af718034e9b354 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:45:34.929040 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c519b-6af6-4c58-937e-76cf43e06e77 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:34.989447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2ef53-8a98-40a9-94e9-b9fb3737fe9c None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:35.058427 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14def4d5-c888-4448-b3d8-d53d880b83f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:35.059934 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14def4d5-c888-4448-b3d8-d53d880b83f0 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:35.060710 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14def4d5-c888-4448-b3d8-d53d880b83f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:35.061716 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14def4d5-c888-4448-b3d8-d53d880b83f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:35.064160 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:35.081374 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14def4d5-c888-4448-b3d8-d53d880b83f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:35.083747 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14def4d5-c888-4448-b3d8-d53d880b83f0 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:35.096965 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:35.112026 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-14def4d5-c888-4448-b3d8-d53d880b83f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:35.112026 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:35.112026 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:35.112026 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:35.112026 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:35.112026 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:35.112026 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:35.112026 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:35.112026 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:35.112026 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:35.112026 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:35.112026 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:35.112026 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:35.112026 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:35.112026 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:35.113102 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:35.113102 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:35.113102 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:35.113102 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:35.113102 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:35.113102 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:35.113102 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:35.113102 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:35.113102 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:35.113102 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:35.113102 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:35.113102 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:35.113102 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:35.113102 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:35.113102 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:35.113102 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:35.113102 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:35.114028 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:35.114028 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:35.114028 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:35.114028 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:35.116812 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 296/600] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:35.121711 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c519b-6af6-4c58-937e-76cf43e06e77 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:35.122890 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14def4d5-c888-4448-b3d8-d53d880b83f0 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:35.193032 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75bc917-cc08-4743-acd2-15fa531661cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:35.193802 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75bc917-cc08-4743-acd2-15fa531661cc None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:35.194091 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75bc917-cc08-4743-acd2-15fa531661cc None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:35.194367 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75bc917-cc08-4743-acd2-15fa531661cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:35.202751 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75bc917-cc08-4743-acd2-15fa531661cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:35.204242 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75bc917-cc08-4743-acd2-15fa531661cc None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:35.219868 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-f75bc917-cc08-4743-acd2-15fa531661cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:45:35.219868 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:35.219868 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:35.219868 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:35.219868 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:35.219868 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:35.219868 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:35.219868 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:35.219868 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:35.219868 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:35.219868 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:35.219868 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:35.219868 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 11:45:35.219868 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 11:45:35.219868 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 11:45:35.220899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 11:45:35.220899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:35.220899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:35.220899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:35.220899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:35.220899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:35.220899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:35.220899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:35.220899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:35.220899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:35.220899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:35.220899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:35.220899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:35.220899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:35.220899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:35.220899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:35.220899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:35.221802 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 11:45:35.221802 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 11:45:35.221802 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 11:45:35.221802 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 11:45:35.221802 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 11:45:35.221802 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 11:45:35.221802 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:45:35.221802 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:35.221802 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 305/601] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:45:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:35.228204 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75bc917-cc08-4743-acd2-15fa531661cc None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:35.280919 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14def4d5-c888-4448-b3d8-d53d880b83f0 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:35.346803 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64c734-d803-4325-a290-0ebba4a7f50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:35.351852 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64c734-d803-4325-a290-0ebba4a7f50a None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:35.352332 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64c734-d803-4325-a290-0ebba4a7f50a None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:35.352783 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64c734-d803-4325-a290-0ebba4a7f50a None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:35.353680 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f64c734-d803-4325-a290-0ebba4a7f50a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:35.354153 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f64c734-d803-4325-a290-0ebba4a7f50a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:35.355735 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f64c734-d803-4325-a290-0ebba4a7f50a None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:35.381226 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 297/602] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:35.386684 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64c734-d803-4325-a290-0ebba4a7f50a None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:35.410543 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75bc917-cc08-4743-acd2-15fa531661cc None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:35.447516 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:35.460645 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c17bc-cd83-476e-a46a-189e2810606e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:35.461649 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c17bc-cd83-476e-a46a-189e2810606e None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:35.462093 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c17bc-cd83-476e-a46a-189e2810606e None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:35.462529 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c17bc-cd83-476e-a46a-189e2810606e None admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:35.463478 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c17bc-cd83-476e-a46a-189e2810606e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:35.463988 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c17bc-cd83-476e-a46a-189e2810606e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:35.465713 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c17bc-cd83-476e-a46a-189e2810606e None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:35.480137 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 306/603] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 3 11:45:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:35.487284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c17bc-cd83-476e-a46a-189e2810606e None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:35.572968 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:35.603102 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c17bc-cd83-476e-a46a-189e2810606e None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:35.644128 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c29e41-2ecc-4952-9cb9-8c0405d952fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:35.645730 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c29e41-2ecc-4952-9cb9-8c0405d952fe None admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:35.646175 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c29e41-2ecc-4952-9cb9-8c0405d952fe None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:35.646610 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c29e41-2ecc-4952-9cb9-8c0405d952fe None admin] PATH_INFO: `/v3/projects/cff223ee05524cf4bf3591fc5a39559e/users/978c834f137a4a6ab83a54af0239c137/roles/41158ae54c7a437284af718034e9b354` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:35.667124 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c29e41-2ecc-4952-9cb9-8c0405d952fe None admin] RBAC: Authorizing `identity:create_grant(project_id=cff223ee05524cf4bf3591fc5a39559e, user_id=978c834f137a4a6ab83a54af0239c137, role_id=41158ae54c7a437284af718034e9b354)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:35.669294 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c29e41-2ecc-4952-9cb9-8c0405d952fe None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:35.677543 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64c734-d803-4325-a290-0ebba4a7f50a None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:35.698740 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 307/604] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Jun 3 11:45:35 2022] PUT /identity/v3/projects/cff223ee05524cf4bf3591fc5a39559e/users/978c834f137a4a6ab83a54af0239c137/roles/41158ae54c7a437284af718034e9b354 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:45:35.747988 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4d2f7-8013-4bbc-8632-354a3f731b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:35.748810 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4d2f7-8013-4bbc-8632-354a3f731b86 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:35.749099 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4d2f7-8013-4bbc-8632-354a3f731b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:35.749373 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4d2f7-8013-4bbc-8632-354a3f731b86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:35.764928 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb4d2f7-8013-4bbc-8632-354a3f731b86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:35.766463 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb4d2f7-8013-4bbc-8632-354a3f731b86 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:35.785688 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-4cb4d2f7-8013-4bbc-8632-354a3f731b86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:45:35.785688 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:35.785688 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:35.785688 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:35.785688 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:35.785688 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:35.785688 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:35.785688 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:35.785688 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:35.785688 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:35.785688 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:35.785688 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:35.785688 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 11:45:35.785688 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 11:45:35.785688 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 11:45:35.787089 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 11:45:35.787089 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:35.787089 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:35.787089 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:35.787089 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:35.787089 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:35.787089 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:35.787089 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:35.787089 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:35.787089 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:35.787089 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:35.787089 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:35.787089 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:35.787089 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:35.787089 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:35.787089 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:35.787089 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:35.788052 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 11:45:35.788052 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 11:45:35.788052 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 11:45:35.788052 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 11:45:35.788052 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 11:45:35.788052 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 11:45:35.788052 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:45:35.788052 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:35.789992 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 298/605] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:45:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 401 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:45:35.794959 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c29e41-2ecc-4952-9cb9-8c0405d952fe None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:35.846864 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:35.884075 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816d4e3-6afe-4bde-b97a-af67c2212aa6 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:35.884425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816d4e3-6afe-4bde-b97a-af67c2212aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:35.884635 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816d4e3-6afe-4bde-b97a-af67c2212aa6 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:35.886282 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 299/606] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:45:35.893943 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319010c0-6f2a-49c6-8e1e-e5b9fb8bab36 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:35.893943 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319010c0-6f2a-49c6-8e1e-e5b9fb8bab36 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:35.893943 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319010c0-6f2a-49c6-8e1e-e5b9fb8bab36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:35.940120 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-319010c0-6f2a-49c6-8e1e-e5b9fb8bab36 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:35.941332 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-319010c0-6f2a-49c6-8e1e-e5b9fb8bab36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:35.952853 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c29e41-2ecc-4952-9cb9-8c0405d952fe None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:35.994807 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc541e-acb1-4699-9f9a-0ee8b4de1781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:35.995479 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc541e-acb1-4699-9f9a-0ee8b4de1781 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:35.995799 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc541e-acb1-4699-9f9a-0ee8b4de1781 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:35.996077 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc541e-acb1-4699-9f9a-0ee8b4de1781 None admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:35.997237 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfc541e-acb1-4699-9f9a-0ee8b4de1781 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:35.997552 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfc541e-acb1-4699-9f9a-0ee8b4de1781 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:35.999017 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfc541e-acb1-4699-9f9a-0ee8b4de1781 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:36.016716 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 308/607] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 3 11:45:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:36.023042 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc541e-acb1-4699-9f9a-0ee8b4de1781 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:36.063617 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 300/608] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 11:45:36.081191 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e5402-56e9-4fda-9d21-813a62711560 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:36.081481 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e5402-56e9-4fda-9d21-813a62711560 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:36.081772 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e5402-56e9-4fda-9d21-813a62711560 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:36.083128 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 301/609] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:45:36.084233 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e5402-56e9-4fda-9d21-813a62711560 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:36.136420 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:36.146713 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc541e-acb1-4699-9f9a-0ee8b4de1781 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:36.179873 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:36.182736 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96445cb6-2f20-4420-9cfc-5fa2552b06a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:36.184296 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96445cb6-2f20-4420-9cfc-5fa2552b06a9 None admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:36.184296 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96445cb6-2f20-4420-9cfc-5fa2552b06a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:36.184697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96445cb6-2f20-4420-9cfc-5fa2552b06a9 None admin] PATH_INFO: `/v3/projects/cff223ee05524cf4bf3591fc5a39559e/users/a78b4284099546cd9c126a5739380b8f/roles/41158ae54c7a437284af718034e9b354` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:36.200980 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96445cb6-2f20-4420-9cfc-5fa2552b06a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=cff223ee05524cf4bf3591fc5a39559e, user_id=a78b4284099546cd9c126a5739380b8f, role_id=41158ae54c7a437284af718034e9b354)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:36.202659 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96445cb6-2f20-4420-9cfc-5fa2552b06a9 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:36.213305 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e5402-56e9-4fda-9d21-813a62711560 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:36.218985 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 309/610] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Jun 3 11:45:36 2022] PUT /identity/v3/projects/cff223ee05524cf4bf3591fc5a39559e/users/a78b4284099546cd9c126a5739380b8f/roles/41158ae54c7a437284af718034e9b354 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:45:36.220726 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f61842-1044-40df-80ca-892c2b0f532f None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:36.221303 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f61842-1044-40df-80ca-892c2b0f532f None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:36.221829 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f61842-1044-40df-80ca-892c2b0f532f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:36.241921 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-54f61842-1044-40df-80ca-892c2b0f532f None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:36.243485 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-54f61842-1044-40df-80ca-892c2b0f532f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:36.254173 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b440c-adf0-4ec1-8b1a-28030918c1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:36.254994 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b440c-adf0-4ec1-8b1a-28030918c1a2 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:36.255381 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b440c-adf0-4ec1-8b1a-28030918c1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:36.255708 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b440c-adf0-4ec1-8b1a-28030918c1a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:36.268121 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b440c-adf0-4ec1-8b1a-28030918c1a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:45:36.276971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-9a4b440c-adf0-4ec1-8b1a-28030918c1a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 11:45:36.276971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:36.276971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:36.276971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:36.276971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:36.276971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:36.276971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:36.276971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:36.276971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:36.276971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:36.276971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:36.276971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:36.276971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:45:36.276971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:45:36.276971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:45:36.276971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:45:36.278041 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:45:36.278041 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:45:36.278041 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:45:36.278041 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:45:36.278041 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:36.278041 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:36.278041 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:36.278041 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:36.278041 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:36.278041 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:36.278041 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:36.278041 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:36.278041 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:36.278041 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:36.278041 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:36.278041 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:36.278864 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:36.278864 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:36.278864 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:36.278864 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:36.278864 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:45:36.278864 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:45:36.278864 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:45:36.278864 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:45:36.278864 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:45:36.278864 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:45:36.278864 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 11:45:36.278864 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:36.278864 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 302/611] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Jun 3 11:45:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:45:36.292676 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b440c-adf0-4ec1-8b1a-28030918c1a2 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:36.347894 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 310/612] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:45:36.370478 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f61842-1044-40df-80ca-892c2b0f532f None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:36.463981 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:36.487817 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f61842-1044-40df-80ca-892c2b0f532f None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:36.532075 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b440c-adf0-4ec1-8b1a-28030918c1a2 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:36.533050 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5f4f7-f3cb-4733-b58d-c38fcd2c52fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:36.534052 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5f4f7-f3cb-4733-b58d-c38fcd2c52fb None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:36.534339 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5f4f7-f3cb-4733-b58d-c38fcd2c52fb None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:36.535457 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5f4f7-f3cb-4733-b58d-c38fcd2c52fb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:36.544167 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:36.552201 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5f4f7-f3cb-4733-b58d-c38fcd2c52fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:45:36.562514 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-fbe5f4f7-f3cb-4733-b58d-c38fcd2c52fb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 11:45:36.562514 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:36.562514 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:36.562514 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:36.562514 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:36.562514 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:36.562514 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:36.562514 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:36.562514 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:36.562514 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:36.562514 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:36.562514 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:36.562514 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:45:36.562514 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:45:36.562514 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:45:36.562514 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:45:36.563493 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:45:36.563493 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:45:36.563493 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:45:36.563493 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:45:36.563493 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:36.563493 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:36.563493 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:36.563493 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:36.563493 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:36.563493 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:36.563493 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:36.563493 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:36.563493 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:36.563493 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:36.563493 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:36.563493 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:36.565081 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:36.565081 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:36.565081 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:36.565081 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:36.565081 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:45:36.565081 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:45:36.565081 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:45:36.565081 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:45:36.565081 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:45:36.565081 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:45:36.565081 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 11:45:36.565081 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:36.566868 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 311/613] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Jun 3 11:45:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:45:36.570766 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5f4f7-f3cb-4733-b58d-c38fcd2c52fb None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:36.578710 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ba9b0-0fa1-4655-94a5-e5516e873be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:36.579391 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ba9b0-0fa1-4655-94a5-e5516e873be4 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:36.579755 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ba9b0-0fa1-4655-94a5-e5516e873be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:36.580654 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ba9b0-0fa1-4655-94a5-e5516e873be4 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:36.581410 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ba9b0-0fa1-4655-94a5-e5516e873be4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:36.582259 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ba9b0-0fa1-4655-94a5-e5516e873be4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:36.583733 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ba9b0-0fa1-4655-94a5-e5516e873be4 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:36.597033 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 303/614] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Jun 3 11:45:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:36.602820 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ba9b0-0fa1-4655-94a5-e5516e873be4 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:36.733244 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ba9b0-0fa1-4655-94a5-e5516e873be4 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:36.770359 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5f4f7-f3cb-4733-b58d-c38fcd2c52fb None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:36.778524 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e6304d-9e83-466a-beb2-4ae3bc1c86cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:36.779389 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6304d-9e83-466a-beb2-4ae3bc1c86cc None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:36.779703 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6304d-9e83-466a-beb2-4ae3bc1c86cc None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:36.779985 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6304d-9e83-466a-beb2-4ae3bc1c86cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:36.800721 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e6304d-9e83-466a-beb2-4ae3bc1c86cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:36.802188 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e6304d-9e83-466a-beb2-4ae3bc1c86cc None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:36.802309 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:36.807748 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef99cf-c75b-4127-b6db-1a5e81c5e560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:36.808422 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef99cf-c75b-4127-b6db-1a5e81c5e560 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:36.808708 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef99cf-c75b-4127-b6db-1a5e81c5e560 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:36.808978 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef99cf-c75b-4127-b6db-1a5e81c5e560 None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:36.809977 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef99cf-c75b-4127-b6db-1a5e81c5e560 None admin] RBAC: Adding query filter params (name=service) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:36.810483 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef99cf-c75b-4127-b6db-1a5e81c5e560 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:36.812080 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef99cf-c75b-4127-b6db-1a5e81c5e560 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:36.821625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 312/615] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Jun 3 11:45:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:45:36.826887 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef99cf-c75b-4127-b6db-1a5e81c5e560 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:36.832821 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-45e6304d-9e83-466a-beb2-4ae3bc1c86cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:36.832821 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:36.832821 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:36.832821 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:36.832821 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:36.832821 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:36.832821 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:36.832821 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:36.832821 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:36.832821 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:36.832821 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:36.832821 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:36.832821 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:36.832821 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:36.832821 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:36.834173 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:36.834173 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:36.834173 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:36.834173 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:36.834173 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:36.834173 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:36.834173 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:36.834173 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:36.834173 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:36.834173 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:36.834173 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:36.834173 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:36.834173 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:36.834173 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:36.834173 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:36.834173 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:36.834173 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:36.836374 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:36.836374 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:36.836374 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:36.836374 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:36.843927 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 304/616] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:36.850897 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e6304d-9e83-466a-beb2-4ae3bc1c86cc None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:36.932924 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:36.936662 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef99cf-c75b-4127-b6db-1a5e81c5e560 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:36.972003 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df60d59-6341-46e7-bc15-f231974c456f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:36.972799 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df60d59-6341-46e7-bc15-f231974c456f None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:36.973083 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df60d59-6341-46e7-bc15-f231974c456f None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:36.973357 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df60d59-6341-46e7-bc15-f231974c456f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:36.984556 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df60d59-6341-46e7-bc15-f231974c456f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:36.985948 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df60d59-6341-46e7-bc15-f231974c456f None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:37.004578 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-8df60d59-6341-46e7-bc15-f231974c456f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:37.004578 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:37.004578 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:37.004578 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:37.004578 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:37.004578 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:37.004578 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:37.004578 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:37.004578 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:37.004578 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:37.004578 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:37.004578 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:37.004578 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:37.004578 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:37.004578 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:37.006680 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:37.006680 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:37.006680 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:37.006680 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:37.006680 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:37.006680 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:37.006680 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:37.006680 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:37.006680 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:37.006680 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:37.006680 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:37.006680 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:37.006680 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:37.006680 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:37.006680 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:37.006680 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:37.006680 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:37.008902 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:37.008902 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:37.008902 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:37.008902 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:37.008902 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 313/617] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:45:37.012612 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df60d59-6341-46e7-bc15-f231974c456f None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:37.060507 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:37.118937 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df60d59-6341-46e7-bc15-f231974c456f None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:37.153455 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e6304d-9e83-466a-beb2-4ae3bc1c86cc None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:37.155301 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5984b97-0452-4b19-9297-cf49dbfcfe29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:37.156954 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5984b97-0452-4b19-9297-cf49dbfcfe29 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:37.157417 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5984b97-0452-4b19-9297-cf49dbfcfe29 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:37.157842 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5984b97-0452-4b19-9297-cf49dbfcfe29 None admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:37.159246 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5984b97-0452-4b19-9297-cf49dbfcfe29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:37.159732 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5984b97-0452-4b19-9297-cf49dbfcfe29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:37.161269 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5984b97-0452-4b19-9297-cf49dbfcfe29 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:37.175452 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 314/618] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:37.181605 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5984b97-0452-4b19-9297-cf49dbfcfe29 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:37.284152 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419b3f5-8609-4597-8e76-b7970039f74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:37.284152 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419b3f5-8609-4597-8e76-b7970039f74a None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:37.284152 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419b3f5-8609-4597-8e76-b7970039f74a None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:37.284152 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419b3f5-8609-4597-8e76-b7970039f74a None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:37.284780 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c419b3f5-8609-4597-8e76-b7970039f74a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:37.284780 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c419b3f5-8609-4597-8e76-b7970039f74a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:37.284780 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c419b3f5-8609-4597-8e76-b7970039f74a None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:37.305157 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5984b97-0452-4b19-9297-cf49dbfcfe29 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:37.318412 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 305/619] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 468 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:37.325662 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419b3f5-8609-4597-8e76-b7970039f74a None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:37.330354 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:37.374431 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002699e0-9834-457c-b0b2-8f071a95a2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:37.375227 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002699e0-9834-457c-b0b2-8f071a95a2f4 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:37.375520 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002699e0-9834-457c-b0b2-8f071a95a2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:37.375793 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002699e0-9834-457c-b0b2-8f071a95a2f4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:37.391923 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002699e0-9834-457c-b0b2-8f071a95a2f4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:37.393447 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002699e0-9834-457c-b0b2-8f071a95a2f4 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:37.412667 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-002699e0-9834-457c-b0b2-8f071a95a2f4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 11:45:37.412667 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:37.412667 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:37.412667 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:37.412667 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:37.412667 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:37.412667 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:37.412667 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:37.412667 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:37.412667 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:37.412667 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:37.412667 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:37.412667 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 11:45:37.412667 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 11:45:37.412667 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 11:45:37.412667 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 11:45:37.413665 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:37.413665 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:37.413665 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 11:45:37.413665 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:45:37.413665 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 11:45:37.413665 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:45:37.413665 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:37.413665 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:37.413665 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:37.413665 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:37.413665 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:37.413665 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:37.413665 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:37.413665 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:37.413665 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:37.413665 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:37.413665 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:37.413665 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:37.414652 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:37.414652 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:37.414652 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 11:45:37.414652 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 11:45:37.414652 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 11:45:37.414652 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 11:45:37.414652 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 11:45:37.414652 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 11:45:37.414652 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 11:45:37.414652 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:37.418352 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 315/620] 10.222.0.15 () {56 vars in 1093 bytes} [Fri Jun 3 11:45:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:45:37.423979 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002699e0-9834-457c-b0b2-8f071a95a2f4 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:37.476059 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:37.505316 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419b3f5-8609-4597-8e76-b7970039f74a None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:37.564926 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d9926-98a6-498d-b826-4bc23cb4c244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:37.565632 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d9926-98a6-498d-b826-4bc23cb4c244 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:37.565915 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d9926-98a6-498d-b826-4bc23cb4c244 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:37.566192 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d9926-98a6-498d-b826-4bc23cb4c244 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:37.577933 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7d9926-98a6-498d-b826-4bc23cb4c244 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:37.579378 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7d9926-98a6-498d-b826-4bc23cb4c244 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:37.605995 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002699e0-9834-457c-b0b2-8f071a95a2f4 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:37.609307 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-cf7d9926-98a6-498d-b826-4bc23cb4c244 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 03 11:45:37.609307 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:37.609307 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:37.609307 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:37.609307 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:37.609307 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:37.609307 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:37.609307 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:37.609307 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:37.609307 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:37.609307 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:37.609307 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:37.609307 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 11:45:37.609307 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 11:45:37.609307 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 11:45:37.609307 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 11:45:37.610215 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:37.610215 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:37.610215 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 11:45:37.610215 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:45:37.610215 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 11:45:37.610215 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:45:37.610215 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:37.610215 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:37.610215 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:37.610215 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:37.610215 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:37.610215 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:37.610215 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:37.610215 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:37.610215 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:37.610215 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:37.610215 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:37.610215 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:37.612927 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:37.612927 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:37.612927 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 11:45:37.612927 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 11:45:37.612927 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 11:45:37.612927 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 11:45:37.612927 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 11:45:37.612927 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 11:45:37.612927 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 03 11:45:37.612927 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:37.612927 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 306/621] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 3 11:45:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:45:37.621870 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d9926-98a6-498d-b826-4bc23cb4c244 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:37.676245 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e1de8-8bf8-41f1-8058-8b8c32892f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:37.676922 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e1de8-8bf8-41f1-8058-8b8c32892f4d None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:37.677206 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e1de8-8bf8-41f1-8058-8b8c32892f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:37.677478 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e1de8-8bf8-41f1-8058-8b8c32892f4d None admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:37.678317 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e1de8-8bf8-41f1-8058-8b8c32892f4d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:37.678624 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e1de8-8bf8-41f1-8058-8b8c32892f4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:37.680102 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e1de8-8bf8-41f1-8058-8b8c32892f4d None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:37.710350 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 316/622] 10.222.0.15 () {56 vars in 1133 bytes} [Fri Jun 3 11:45:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:37.715822 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e69aa3-07b3-44fc-b37c-7436b9c2c61c None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:37.716134 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e69aa3-07b3-44fc-b37c-7436b9c2c61c None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:37.716516 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e69aa3-07b3-44fc-b37c-7436b9c2c61c None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:37.718032 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 317/623] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:45:37.722115 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e69aa3-07b3-44fc-b37c-7436b9c2c61c None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:37.746221 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:37.774628 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d9926-98a6-498d-b826-4bc23cb4c244 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:37.813014 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78cbab-efd6-4abd-a181-0747bf639c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:37.813678 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78cbab-efd6-4abd-a181-0747bf639c6f None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:37.813948 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78cbab-efd6-4abd-a181-0747bf639c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:37.814275 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78cbab-efd6-4abd-a181-0747bf639c6f None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:37.816663 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a78cbab-efd6-4abd-a181-0747bf639c6f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:37.816923 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a78cbab-efd6-4abd-a181-0747bf639c6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:37.818429 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a78cbab-efd6-4abd-a181-0747bf639c6f None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:37.843591 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 307/624] 10.222.0.15 () {56 vars in 1135 bytes} [Fri Jun 3 11:45:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:37.845284 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093ab5e-55bb-46a7-b217-b3ce6c239b65 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:37.846416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093ab5e-55bb-46a7-b217-b3ce6c239b65 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:37.847662 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093ab5e-55bb-46a7-b217-b3ce6c239b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:37.855216 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:37.865118 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e69aa3-07b3-44fc-b37c-7436b9c2c61c None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:37.871654 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-6093ab5e-55bb-46a7-b217-b3ce6c239b65 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:37.872836 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-6093ab5e-55bb-46a7-b217-b3ce6c239b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:37.904860 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2168a75-fd6f-491a-8abe-b9cced95026d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:37.905961 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2168a75-fd6f-491a-8abe-b9cced95026d None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:37.906508 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2168a75-fd6f-491a-8abe-b9cced95026d None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:37.906993 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2168a75-fd6f-491a-8abe-b9cced95026d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:37.955651 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 308/625] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:45:37.956553 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093ab5e-55bb-46a7-b217-b3ce6c239b65 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:37.984792 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2168a75-fd6f-491a-8abe-b9cced95026d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:37.987199 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2168a75-fd6f-491a-8abe-b9cced95026d None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:38.019755 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:38.073226 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093ab5e-55bb-46a7-b217-b3ce6c239b65 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:38.107884 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:38.115492 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 318/626] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:45:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 11:45:38.116947 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2168a75-fd6f-491a-8abe-b9cced95026d None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:38.117864 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb09699-12aa-49b7-b4ec-3eab57a7ccc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:38.118716 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb09699-12aa-49b7-b4ec-3eab57a7ccc4 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:38.119002 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb09699-12aa-49b7-b4ec-3eab57a7ccc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:38.119280 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb09699-12aa-49b7-b4ec-3eab57a7ccc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:38.131105 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb09699-12aa-49b7-b4ec-3eab57a7ccc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:38.132428 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb09699-12aa-49b7-b4ec-3eab57a7ccc4 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:38.151406 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-9eb09699-12aa-49b7-b4ec-3eab57a7ccc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:38.151406 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:38.151406 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:38.151406 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:38.151406 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:38.151406 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:38.151406 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:38.151406 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:38.151406 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:38.151406 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:38.151406 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:38.151406 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:38.151406 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:38.151406 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:38.151406 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:38.152524 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:38.152524 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:38.152524 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:38.152524 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:38.152524 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:38.152524 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:38.152524 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:38.152524 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:38.152524 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:38.152524 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:38.152524 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:38.152524 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:38.152524 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:38.152524 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:38.152524 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:38.152524 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:38.152524 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:38.153406 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:38.153406 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:38.153406 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:38.153406 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:38.153406 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 309/627] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:38.153406 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb09699-12aa-49b7-b4ec-3eab57a7ccc4 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:38.228409 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2168a75-fd6f-491a-8abe-b9cced95026d None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:38.254681 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:38.266350 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae7e0f-9c2f-452d-9ede-0e8ced71d118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:38.267533 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae7e0f-9c2f-452d-9ede-0e8ced71d118 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:38.268033 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae7e0f-9c2f-452d-9ede-0e8ced71d118 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:38.268548 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae7e0f-9c2f-452d-9ede-0e8ced71d118 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:38.271222 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb09699-12aa-49b7-b4ec-3eab57a7ccc4 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:38.280678 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae7e0f-9c2f-452d-9ede-0e8ced71d118 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:45:38.288828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-c8ae7e0f-9c2f-452d-9ede-0e8ced71d118 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 11:45:38.288828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:38.288828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:38.288828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:38.288828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:38.288828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:38.288828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:38.288828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:38.288828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:38.288828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:38.288828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:38.288828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:38.288828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:45:38.288828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:45:38.288828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:45:38.288828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:45:38.289772 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:45:38.289772 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:45:38.289772 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:45:38.289772 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:45:38.289772 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:38.289772 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:38.289772 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:38.289772 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:38.289772 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:38.289772 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:38.289772 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:38.289772 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:38.289772 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:38.289772 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:38.289772 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:38.289772 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:38.290705 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:38.290705 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:38.290705 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:38.290705 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:38.290705 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:45:38.290705 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:45:38.290705 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:45:38.290705 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:45:38.290705 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:45:38.290705 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:45:38.290705 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 11:45:38.290705 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:38.299576 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 319/628] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Jun 3 11:45:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:38.300698 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae7e0f-9c2f-452d-9ede-0e8ced71d118 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:38.308982 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e018c90-b540-41a8-b149-ed816f2da771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:38.309840 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e018c90-b540-41a8-b149-ed816f2da771 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:38.310122 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e018c90-b540-41a8-b149-ed816f2da771 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:38.310453 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e018c90-b540-41a8-b149-ed816f2da771 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:38.322231 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e018c90-b540-41a8-b149-ed816f2da771 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:38.323848 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e018c90-b540-41a8-b149-ed816f2da771 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:38.342260 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-4e018c90-b540-41a8-b149-ed816f2da771 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:38.342260 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:38.342260 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:38.342260 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:38.342260 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:38.342260 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:38.342260 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:38.342260 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:38.342260 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:38.342260 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:38.342260 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:38.342260 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:38.342260 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:38.342260 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:38.342260 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:38.343208 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:38.343208 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:38.343208 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:38.343208 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:38.343208 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:38.343208 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:38.343208 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:38.343208 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:38.343208 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:38.343208 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:38.343208 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:38.343208 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:38.343208 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:38.343208 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:38.343208 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:38.343208 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:38.343208 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:38.344156 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:38.344156 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:38.344156 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:38.344156 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:38.344156 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 310/629] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:38.344156 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e018c90-b540-41a8-b149-ed816f2da771 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:38.382604 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:38.413799 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae7e0f-9c2f-452d-9ede-0e8ced71d118 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:38.452774 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50822a-2f7b-4763-a208-258f4c5ce4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:38.453434 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50822a-2f7b-4763-a208-258f4c5ce4b9 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:38.453720 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50822a-2f7b-4763-a208-258f4c5ce4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:38.453990 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50822a-2f7b-4763-a208-258f4c5ce4b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:38.454715 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50822a-2f7b-4763-a208-258f4c5ce4b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:38.455875 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50822a-2f7b-4763-a208-258f4c5ce4b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:38.456694 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e018c90-b540-41a8-b149-ed816f2da771 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:38.457264 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50822a-2f7b-4763-a208-258f4c5ce4b9 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:38.469914 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 320/630] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:38.476004 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50822a-2f7b-4763-a208-258f4c5ce4b9 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:38.495332 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4012797-9158-4e18-a00e-e841cb6fea30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:38.496062 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4012797-9158-4e18-a00e-e841cb6fea30 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:38.496346 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4012797-9158-4e18-a00e-e841cb6fea30 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:38.496654 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4012797-9158-4e18-a00e-e841cb6fea30 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:38.497389 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4012797-9158-4e18-a00e-e841cb6fea30 None admin] RBAC: Adding query filter params (name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:38.498047 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4012797-9158-4e18-a00e-e841cb6fea30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:38.503455 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4012797-9158-4e18-a00e-e841cb6fea30 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:38.517817 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 311/631] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Jun 3 11:45:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:38.519277 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e28622-97ed-40de-b3f5-21ed73aaac54 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:38.519589 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e28622-97ed-40de-b3f5-21ed73aaac54 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:38.519868 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e28622-97ed-40de-b3f5-21ed73aaac54 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:38.523618 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 312/632] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:45:38.523618 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e28622-97ed-40de-b3f5-21ed73aaac54 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:38.530730 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:38.590447 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50822a-2f7b-4763-a208-258f4c5ce4b9 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:38.624089 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:38.628888 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03572bda-298c-4278-936e-ed8bcdc17225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:38.629550 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03572bda-298c-4278-936e-ed8bcdc17225 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:38.629741 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e28622-97ed-40de-b3f5-21ed73aaac54 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:38.629857 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03572bda-298c-4278-936e-ed8bcdc17225 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:38.630097 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03572bda-298c-4278-936e-ed8bcdc17225 None admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:38.630818 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03572bda-298c-4278-936e-ed8bcdc17225 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:38.631131 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03572bda-298c-4278-936e-ed8bcdc17225 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:38.632532 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03572bda-298c-4278-936e-ed8bcdc17225 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:38.645453 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 321/633] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:38.646293 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03572bda-298c-4278-936e-ed8bcdc17225 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:38.670291 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdcaa7-d119-4b44-bd73-c3d48882a442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:38.671101 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdcaa7-d119-4b44-bd73-c3d48882a442 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:38.671364 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdcaa7-d119-4b44-bd73-c3d48882a442 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:38.671670 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdcaa7-d119-4b44-bd73-c3d48882a442 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:38.678777 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fdcaa7-d119-4b44-bd73-c3d48882a442 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:38.680351 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fdcaa7-d119-4b44-bd73-c3d48882a442 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:38.696168 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-91fdcaa7-d119-4b44-bd73-c3d48882a442 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:45:38.696168 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:38.696168 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:38.696168 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:38.696168 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:38.696168 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:38.696168 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:38.696168 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:38.696168 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:38.696168 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:38.696168 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:38.696168 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:38.696168 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 11:45:38.696168 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 11:45:38.696168 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 11:45:38.697122 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 11:45:38.697122 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:38.697122 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:38.697122 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:38.697122 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:38.697122 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:38.697122 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:38.697122 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:38.697122 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:38.697122 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:38.697122 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:38.697122 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:38.697122 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:38.697122 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:38.697122 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:38.697122 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:38.697122 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:38.697998 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 11:45:38.697998 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 11:45:38.697998 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 11:45:38.697998 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 11:45:38.697998 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 11:45:38.697998 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 11:45:38.697998 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:45:38.697998 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:38.697998 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 313/634] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:45:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:38.699001 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45f595-dfd4-4593-9f9a-2094a0089cad None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:38.699001 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45f595-dfd4-4593-9f9a-2094a0089cad None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:38.699371 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45f595-dfd4-4593-9f9a-2094a0089cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:38.718383 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-7e45f595-dfd4-4593-9f9a-2094a0089cad None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:38.719984 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-7e45f595-dfd4-4593-9f9a-2094a0089cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:38.756777 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03572bda-298c-4278-936e-ed8bcdc17225 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:38.760076 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:38.794445 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e171b4-b977-44db-a73c-5a68b82aef7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:38.795569 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e171b4-b977-44db-a73c-5a68b82aef7e None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:38.796127 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e171b4-b977-44db-a73c-5a68b82aef7e None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:38.796408 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e171b4-b977-44db-a73c-5a68b82aef7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:38.799266 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 314/635] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:45:38.800092 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45f595-dfd4-4593-9f9a-2094a0089cad None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:38.812100 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e171b4-b977-44db-a73c-5a68b82aef7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:38.813577 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e171b4-b977-44db-a73c-5a68b82aef7e None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:38.832579 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-76e171b4-b977-44db-a73c-5a68b82aef7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:38.832579 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:38.832579 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:38.832579 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:38.832579 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:38.832579 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:38.832579 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:38.832579 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:38.832579 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:38.832579 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:38.832579 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:38.832579 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:38.832579 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:38.832579 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:38.832579 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:38.833561 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:38.833561 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:38.833561 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:38.833561 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:38.833561 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:38.833561 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:38.833561 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:38.833561 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:38.833561 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:38.833561 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:38.833561 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:38.833561 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:38.833561 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:38.833561 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:38.833561 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:38.833561 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:38.833561 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:38.834450 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:38.834450 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:38.834450 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:38.834450 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:38.834450 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 322/636] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:38.834734 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e171b4-b977-44db-a73c-5a68b82aef7e None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:38.897450 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:38.907471 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45f595-dfd4-4593-9f9a-2094a0089cad None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:38.937683 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e171b4-b977-44db-a73c-5a68b82aef7e None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:38.941103 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb5565-500e-438b-a192-0cb6f1f3243f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:38.941889 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb5565-500e-438b-a192-0cb6f1f3243f None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:38.942172 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb5565-500e-438b-a192-0cb6f1f3243f None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:38.942449 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb5565-500e-438b-a192-0cb6f1f3243f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:38.949411 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efb5565-500e-438b-a192-0cb6f1f3243f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:38.950738 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efb5565-500e-438b-a192-0cb6f1f3243f None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:38.964674 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-7efb5565-500e-438b-a192-0cb6f1f3243f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:45:38.964674 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:38.964674 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:38.964674 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:38.964674 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:38.964674 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:38.964674 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:38.964674 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:38.964674 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:38.964674 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:38.964674 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:38.964674 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:38.964674 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 11:45:38.964674 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 11:45:38.964674 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 11:45:38.965548 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 11:45:38.965548 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:38.965548 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:38.965548 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:38.965548 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:38.965548 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:38.965548 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:38.965548 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:38.965548 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:38.965548 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:38.965548 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:38.965548 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:38.965548 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:38.965548 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:38.965548 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:38.965548 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:38.965548 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:38.971397 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 11:45:38.971397 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 11:45:38.971397 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 11:45:38.971397 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 11:45:38.971397 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 11:45:38.971397 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 11:45:38.971397 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:45:38.971397 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:38.971397 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 315/637] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:45:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:38.971397 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe48aca-3b19-4cb6-abf9-3861b523ad26 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:38.971397 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe48aca-3b19-4cb6-abf9-3861b523ad26 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:38.972253 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe48aca-3b19-4cb6-abf9-3861b523ad26 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:38.972253 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 316/638] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:45:38.972253 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe48aca-3b19-4cb6-abf9-3861b523ad26 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:38.974122 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a61ee7-ec27-4e63-aaa6-f09dc4f3b5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:38.974788 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a61ee7-ec27-4e63-aaa6-f09dc4f3b5dc None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:38.975074 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a61ee7-ec27-4e63-aaa6-f09dc4f3b5dc None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:38.975351 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a61ee7-ec27-4e63-aaa6-f09dc4f3b5dc None admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:38.976177 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a61ee7-ec27-4e63-aaa6-f09dc4f3b5dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:38.976492 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a61ee7-ec27-4e63-aaa6-f09dc4f3b5dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:38.977933 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a61ee7-ec27-4e63-aaa6-f09dc4f3b5dc None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:38.990477 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 323/639] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 3 11:45:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:38.991259 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a61ee7-ec27-4e63-aaa6-f09dc4f3b5dc None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:39.010171 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:39.072998 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe48aca-3b19-4cb6-abf9-3861b523ad26 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:39.089660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a61ee7-ec27-4e63-aaa6-f09dc4f3b5dc None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:39.105313 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1dd971-cb25-45f8-9f89-67230d111704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:39.106191 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1dd971-cb25-45f8-9f89-67230d111704 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:39.106484 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1dd971-cb25-45f8-9f89-67230d111704 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:39.106766 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1dd971-cb25-45f8-9f89-67230d111704 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:39.117130 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1dd971-cb25-45f8-9f89-67230d111704 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:45:39.123082 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ac764-0c1b-45a2-b0ca-25c5ddfba7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:39.123766 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ac764-0c1b-45a2-b0ca-25c5ddfba7de None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:39.124048 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ac764-0c1b-45a2-b0ca-25c5ddfba7de None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:39.124317 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ac764-0c1b-45a2-b0ca-25c5ddfba7de None admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:39.125030 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8ac764-0c1b-45a2-b0ca-25c5ddfba7de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:39.125127 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-ed1dd971-cb25-45f8-9f89-67230d111704 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 11:45:39.125127 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:39.125127 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:39.125127 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:39.125127 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:39.125127 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:39.125127 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:39.125127 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:39.125127 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:39.125127 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:39.125127 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:39.125127 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:39.125127 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:45:39.125127 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:45:39.125127 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:45:39.125127 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:45:39.126231 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:45:39.126231 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:45:39.126231 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:45:39.126231 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:45:39.126231 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:39.126231 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:39.126231 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:39.126231 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:39.126231 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:39.126231 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:39.126231 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:39.126231 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:39.126231 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:39.126231 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:39.126231 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:39.126231 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:39.127993 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:39.127993 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:39.127993 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:39.127993 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:39.127993 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:45:39.127993 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:45:39.127993 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:45:39.127993 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:45:39.127993 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:45:39.127993 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:45:39.127993 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 11:45:39.127993 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:39.128787 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8ac764-0c1b-45a2-b0ca-25c5ddfba7de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:39.128787 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8ac764-0c1b-45a2-b0ca-25c5ddfba7de None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:39.129162 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 317/640] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Jun 3 11:45:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:39.129884 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1dd971-cb25-45f8-9f89-67230d111704 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:39.140426 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:39.147827 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 324/641] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:39.147827 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ab451-c785-4b09-afc0-022d0d62edc1 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:39.147827 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ab451-c785-4b09-afc0-022d0d62edc1 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:39.147827 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ab451-c785-4b09-afc0-022d0d62edc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:39.161904 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-473ab451-c785-4b09-afc0-022d0d62edc1 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:39.163070 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-473ab451-c785-4b09-afc0-022d0d62edc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:39.228198 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 325/642] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:45:39.228974 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ab451-c785-4b09-afc0-022d0d62edc1 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:39.229452 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1dd971-cb25-45f8-9f89-67230d111704 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:39.236608 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:39.264978 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5ef9c-2bb0-4316-b35a-b28ec42fc639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:39.265633 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5ef9c-2bb0-4316-b35a-b28ec42fc639 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:39.265914 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5ef9c-2bb0-4316-b35a-b28ec42fc639 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:39.266190 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5ef9c-2bb0-4316-b35a-b28ec42fc639 None admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:39.266970 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5ef9c-2bb0-4316-b35a-b28ec42fc639 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:39.267895 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5ef9c-2bb0-4316-b35a-b28ec42fc639 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:39.269336 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5ef9c-2bb0-4316-b35a-b28ec42fc639 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:39.281570 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 318/643] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 3 11:45:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:39.282342 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5ef9c-2bb0-4316-b35a-b28ec42fc639 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:39.326563 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ab451-c785-4b09-afc0-022d0d62edc1 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:39.348456 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:39.360340 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54749930-4dd5-4946-8a7b-51baee35fd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:39.361322 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54749930-4dd5-4946-8a7b-51baee35fd76 None admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:39.361598 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54749930-4dd5-4946-8a7b-51baee35fd76 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:39.361867 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54749930-4dd5-4946-8a7b-51baee35fd76 None admin] PATH_INFO: `/v3/projects/cff223ee05524cf4bf3591fc5a39559e/users/5f52901fe535420bb0019272d4eafe72/roles/41158ae54c7a437284af718034e9b354` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:39.375758 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54749930-4dd5-4946-8a7b-51baee35fd76 None admin] RBAC: Authorizing `identity:create_grant(project_id=cff223ee05524cf4bf3591fc5a39559e, user_id=5f52901fe535420bb0019272d4eafe72, role_id=41158ae54c7a437284af718034e9b354)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:39.377735 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54749930-4dd5-4946-8a7b-51baee35fd76 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:39.381144 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5ef9c-2bb0-4316-b35a-b28ec42fc639 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:39.389498 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 326/644] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Jun 3 11:45:39 2022] PUT /identity/v3/projects/cff223ee05524cf4bf3591fc5a39559e/users/5f52901fe535420bb0019272d4eafe72/roles/41158ae54c7a437284af718034e9b354 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:45:39.390282 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54749930-4dd5-4946-8a7b-51baee35fd76 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:39.433025 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c339e-71b6-4c59-8d14-525f57e984cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:39.434253 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c339e-71b6-4c59-8d14-525f57e984cf None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:39.434749 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c339e-71b6-4c59-8d14-525f57e984cf None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:39.435235 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c339e-71b6-4c59-8d14-525f57e984cf None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:39.436412 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c339e-71b6-4c59-8d14-525f57e984cf None admin] RBAC: Adding query filter params (name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:39.436932 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c339e-71b6-4c59-8d14-525f57e984cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:39.438703 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c339e-71b6-4c59-8d14-525f57e984cf None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:39.449084 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 319/645] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Jun 3 11:45:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:39.450327 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c339e-71b6-4c59-8d14-525f57e984cf None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:39.458295 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:39.507434 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54749930-4dd5-4946-8a7b-51baee35fd76 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:39.548794 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d45036-1f3e-4ae2-886a-37e21bb70c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:39.549610 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d45036-1f3e-4ae2-886a-37e21bb70c63 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:39.549889 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d45036-1f3e-4ae2-886a-37e21bb70c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:39.550155 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d45036-1f3e-4ae2-886a-37e21bb70c63 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:39.558231 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d45036-1f3e-4ae2-886a-37e21bb70c63 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:39.559725 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d45036-1f3e-4ae2-886a-37e21bb70c63 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:39.570814 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c339e-71b6-4c59-8d14-525f57e984cf None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:39.576372 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-98d45036-1f3e-4ae2-886a-37e21bb70c63 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 03 11:45:39.576372 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:39.576372 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:39.576372 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:39.576372 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:39.576372 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:39.576372 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:39.576372 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:39.576372 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:39.576372 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:39.576372 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:39.576372 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:39.576372 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 11:45:39.576372 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 11:45:39.576372 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 11:45:39.576372 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 11:45:39.577359 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:39.577359 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:39.577359 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 11:45:39.577359 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:45:39.577359 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 11:45:39.577359 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:45:39.577359 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:39.577359 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:39.577359 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:39.577359 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:39.577359 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:39.577359 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:39.577359 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:39.577359 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:39.577359 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:39.577359 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:39.577359 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:39.577359 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:39.578474 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:39.578474 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:39.578474 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 11:45:39.578474 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 11:45:39.578474 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 11:45:39.578474 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 11:45:39.578474 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 11:45:39.578474 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 11:45:39.578474 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 03 11:45:39.578474 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:39.582901 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 327/646] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:45:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:39.583820 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d45036-1f3e-4ae2-886a-37e21bb70c63 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:39.606140 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:39.614038 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1ece4-50f8-459c-8db6-265fa2488d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:39.614949 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1ece4-50f8-459c-8db6-265fa2488d78 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:39.615238 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1ece4-50f8-459c-8db6-265fa2488d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:39.615532 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1ece4-50f8-459c-8db6-265fa2488d78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:39.626019 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c1ece4-50f8-459c-8db6-265fa2488d78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:45:39.633784 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-69c1ece4-50f8-459c-8db6-265fa2488d78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 11:45:39.633784 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:39.633784 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:39.633784 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:39.633784 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:39.633784 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:39.633784 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:39.633784 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:39.633784 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:39.633784 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:39.633784 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:39.633784 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:39.633784 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:45:39.633784 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:45:39.633784 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:45:39.633784 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:45:39.634728 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:45:39.634728 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:45:39.634728 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:45:39.634728 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:45:39.634728 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:39.634728 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:39.634728 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:39.634728 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:39.634728 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:39.634728 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:39.634728 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:39.634728 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:39.634728 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:39.634728 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:39.634728 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:39.634728 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:39.636353 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:39.636353 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:39.636353 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:39.636353 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:39.636353 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:45:39.636353 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:45:39.636353 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:45:39.636353 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:45:39.636353 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:45:39.636353 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:45:39.636353 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 11:45:39.636353 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:39.636353 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 320/647] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Jun 3 11:45:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:39.636353 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1ece4-50f8-459c-8db6-265fa2488d78 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:39.698332 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d45036-1f3e-4ae2-886a-37e21bb70c63 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:39.716486 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:39.736774 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5afdf95-06ef-4cd0-8da9-04d211d07698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:39.737461 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afdf95-06ef-4cd0-8da9-04d211d07698 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:39.737743 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afdf95-06ef-4cd0-8da9-04d211d07698 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:39.738013 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afdf95-06ef-4cd0-8da9-04d211d07698 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:39.738839 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5afdf95-06ef-4cd0-8da9-04d211d07698 None admin] RBAC: Adding query filter params (role.id=41158ae54c7a437284af718034e9b354, scope.project.id=cff223ee05524cf4bf3591fc5a39559e, user.id=6247bfb7aebd45eeb97ba5933be44c6d) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:39.739248 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5afdf95-06ef-4cd0-8da9-04d211d07698 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:39.740723 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5afdf95-06ef-4cd0-8da9-04d211d07698 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:39.746759 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 328/648] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:45:39 2022] GET /identity/v3/role_assignments?user.id=6247bfb7aebd45eeb97ba5933be44c6d&scope.project.id=cff223ee05524cf4bf3591fc5a39559e&role.id=41158ae54c7a437284af718034e9b354 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:39.747249 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1ece4-50f8-459c-8db6-265fa2488d78 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:39.747542 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5afdf95-06ef-4cd0-8da9-04d211d07698 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:39.801092 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c115fa-da23-4235-963c-3b56dad9085b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:39.801886 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c115fa-da23-4235-963c-3b56dad9085b None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:39.802164 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c115fa-da23-4235-963c-3b56dad9085b None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:39.802435 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c115fa-da23-4235-963c-3b56dad9085b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:39.815570 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c115fa-da23-4235-963c-3b56dad9085b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:39.816819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c115fa-da23-4235-963c-3b56dad9085b None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:39.836258 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-22c115fa-da23-4235-963c-3b56dad9085b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:39.836258 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:39.836258 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:39.836258 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:39.836258 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:39.836258 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:39.836258 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:39.836258 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:39.836258 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:39.836258 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:39.836258 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:39.836258 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:39.836258 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:39.836258 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:39.836258 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:39.837256 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:39.837256 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:39.837256 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:39.837256 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:39.837256 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:39.837256 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:39.837256 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:39.837256 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:39.837256 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:39.837256 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:39.837256 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:39.837256 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:39.837256 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:39.837256 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:39.837256 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:39.837256 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:39.837256 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:39.838178 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:39.838178 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:39.838178 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:39.838178 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:39.838178 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 321/649] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:39.838844 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c115fa-da23-4235-963c-3b56dad9085b None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:39.889507 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:39.895984 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5afdf95-06ef-4cd0-8da9-04d211d07698 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:39.946972 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3190aa2-e226-42ae-ae99-47a40a1047fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:39.949065 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3190aa2-e226-42ae-ae99-47a40a1047fa None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:39.949634 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3190aa2-e226-42ae-ae99-47a40a1047fa None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:39.950078 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3190aa2-e226-42ae-ae99-47a40a1047fa None admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:39.951268 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3190aa2-e226-42ae-ae99-47a40a1047fa None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:39.951758 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3190aa2-e226-42ae-ae99-47a40a1047fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:39.953689 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3190aa2-e226-42ae-ae99-47a40a1047fa None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:39.969922 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c115fa-da23-4235-963c-3b56dad9085b None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:39.979360 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 329/650] 10.222.0.15 () {56 vars in 1137 bytes} [Fri Jun 3 11:45:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:39.980458 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3190aa2-e226-42ae-ae99-47a40a1047fa None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:40.013212 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b751594-612e-4ac5-b89d-d3ab6cdcb178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:40.014129 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b751594-612e-4ac5-b89d-d3ab6cdcb178 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:40.014589 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b751594-612e-4ac5-b89d-d3ab6cdcb178 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:40.015016 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b751594-612e-4ac5-b89d-d3ab6cdcb178 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:40.016558 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b751594-612e-4ac5-b89d-d3ab6cdcb178 None admin] RBAC: Adding query filter params (name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:40.016871 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b751594-612e-4ac5-b89d-d3ab6cdcb178 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:40.018283 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b751594-612e-4ac5-b89d-d3ab6cdcb178 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:40.029462 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 322/651] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Jun 3 11:45:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:40.030735 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b751594-612e-4ac5-b89d-d3ab6cdcb178 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:40.039952 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:40.117766 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3190aa2-e226-42ae-ae99-47a40a1047fa None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:40.158923 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b751594-612e-4ac5-b89d-d3ab6cdcb178 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:40.162394 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:40.167402 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc49dbe-8d47-4615-ab7a-8a3e85079bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:40.168366 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc49dbe-8d47-4615-ab7a-8a3e85079bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:40.168817 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc49dbe-8d47-4615-ab7a-8a3e85079bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:40.169716 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc49dbe-8d47-4615-ab7a-8a3e85079bd7 None admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:40.170941 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc49dbe-8d47-4615-ab7a-8a3e85079bd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:40.171471 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc49dbe-8d47-4615-ab7a-8a3e85079bd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:40.174385 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc49dbe-8d47-4615-ab7a-8a3e85079bd7 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:40.196118 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 330/652] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:40.197832 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc49dbe-8d47-4615-ab7a-8a3e85079bd7 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:40.201244 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262bdf6-6a9e-477c-bc10-41720e63a1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:40.201901 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262bdf6-6a9e-477c-bc10-41720e63a1d9 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:40.202254 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262bdf6-6a9e-477c-bc10-41720e63a1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:40.202600 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262bdf6-6a9e-477c-bc10-41720e63a1d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:40.288255 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0262bdf6-6a9e-477c-bc10-41720e63a1d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:40.290107 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0262bdf6-6a9e-477c-bc10-41720e63a1d9 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:40.300605 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:40.304570 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc49dbe-8d47-4615-ab7a-8a3e85079bd7 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:40.338966 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895375b1-f3b7-438e-a792-892e07d2fa56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:40.339530 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895375b1-f3b7-438e-a792-892e07d2fa56 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:40.339867 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895375b1-f3b7-438e-a792-892e07d2fa56 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:40.340135 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895375b1-f3b7-438e-a792-892e07d2fa56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:40.351843 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895375b1-f3b7-438e-a792-892e07d2fa56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:40.353332 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895375b1-f3b7-438e-a792-892e07d2fa56 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:40.371211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-895375b1-f3b7-438e-a792-892e07d2fa56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:40.371211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:40.371211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:40.371211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:40.371211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:40.371211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:40.371211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:40.371211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:40.371211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:40.371211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:40.371211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:40.371211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:40.371211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:40.371211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:40.371211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:40.372156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:40.372156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:40.372156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:40.372156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:40.372156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:40.372156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:40.372156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:40.372156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:40.372156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:40.372156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:40.372156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:40.372156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:40.372156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:40.372156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:40.372156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:40.372156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:40.372156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:40.373133 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:40.373133 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:40.373133 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:40.373133 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:40.377064 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 331/653] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:40.377912 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895375b1-f3b7-438e-a792-892e07d2fa56 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:40.406673 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 323/654] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:45:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 11:45:40.408474 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262bdf6-6a9e-477c-bc10-41720e63a1d9 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:40.484023 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:40.487126 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895375b1-f3b7-438e-a792-892e07d2fa56 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:40.520995 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262bdf6-6a9e-477c-bc10-41720e63a1d9 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:40.522874 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2977d-e4c9-4da9-a8c3-517cb2f0c5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:40.523677 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2977d-e4c9-4da9-a8c3-517cb2f0c5ea None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:40.523960 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2977d-e4c9-4da9-a8c3-517cb2f0c5ea None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:40.524234 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2977d-e4c9-4da9-a8c3-517cb2f0c5ea None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:40.532433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b2977d-e4c9-4da9-a8c3-517cb2f0c5ea None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:40.534565 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b2977d-e4c9-4da9-a8c3-517cb2f0c5ea None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:40.549443 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-e7b2977d-e4c9-4da9-a8c3-517cb2f0c5ea None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 03 11:45:40.549443 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:40.549443 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:40.549443 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:40.549443 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:40.549443 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:40.549443 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:40.549443 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:40.549443 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:40.549443 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:40.549443 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:40.549443 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:40.549443 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 11:45:40.549443 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 11:45:40.549443 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 11:45:40.549443 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 11:45:40.550433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:40.550433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:40.550433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 11:45:40.550433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:45:40.550433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 11:45:40.550433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:45:40.550433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:40.550433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:40.550433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:40.550433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:40.550433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:40.550433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:40.550433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:40.550433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:40.550433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:40.550433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:40.550433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:40.550433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:40.551368 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:40.551368 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:40.551368 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 11:45:40.551368 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 11:45:40.551368 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 11:45:40.551368 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 11:45:40.551368 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 11:45:40.551368 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 11:45:40.551368 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 03 11:45:40.551368 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:40.551368 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 332/655] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:45:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:40.552017 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2977d-e4c9-4da9-a8c3-517cb2f0c5ea None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:40.563488 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9dfd7-2e4b-450f-bd8d-8e41967acf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:40.564538 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9dfd7-2e4b-450f-bd8d-8e41967acf25 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:40.565011 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:40.565874 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9dfd7-2e4b-450f-bd8d-8e41967acf25 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:40.566573 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9dfd7-2e4b-450f-bd8d-8e41967acf25 None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:40.567537 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e9dfd7-2e4b-450f-bd8d-8e41967acf25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:40.568122 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e9dfd7-2e4b-450f-bd8d-8e41967acf25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:40.570451 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e9dfd7-2e4b-450f-bd8d-8e41967acf25 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:40.584208 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 324/656] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:40.585366 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9dfd7-2e4b-450f-bd8d-8e41967acf25 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:40.661590 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2977d-e4c9-4da9-a8c3-517cb2f0c5ea None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:40.662315 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:40.693376 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9dfd7-2e4b-450f-bd8d-8e41967acf25 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:40.698394 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9df2e8-e2fc-4518-a845-4dd6e8e27728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:40.699245 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9df2e8-e2fc-4518-a845-4dd6e8e27728 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:40.699462 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9df2e8-e2fc-4518-a845-4dd6e8e27728 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:40.699783 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9df2e8-e2fc-4518-a845-4dd6e8e27728 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:40.713171 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9df2e8-e2fc-4518-a845-4dd6e8e27728 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:40.714765 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9df2e8-e2fc-4518-a845-4dd6e8e27728 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:40.731158 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6663fa-a43c-4ba3-8b0d-a83d5b822ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:40.731919 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6663fa-a43c-4ba3-8b0d-a83d5b822ccd None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:40.732204 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6663fa-a43c-4ba3-8b0d-a83d5b822ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:40.732480 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6663fa-a43c-4ba3-8b0d-a83d5b822ccd None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:40.733322 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6663fa-a43c-4ba3-8b0d-a83d5b822ccd None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:40.733633 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6663fa-a43c-4ba3-8b0d-a83d5b822ccd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:40.734533 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-8a9df2e8-e2fc-4518-a845-4dd6e8e27728 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:40.734533 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:40.734533 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:40.734533 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:40.734533 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:40.734533 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:40.734533 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:40.734533 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:40.734533 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:40.734533 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:40.734533 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:40.734533 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:40.734533 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:40.734533 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:40.734533 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:40.735389 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:40.735389 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:40.735389 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:40.735389 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:40.735389 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:40.735389 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:40.735389 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:40.735389 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:40.735389 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:40.735389 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:40.735389 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:40.735389 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:40.735389 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:40.735389 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:40.735389 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:40.735389 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:40.735389 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:40.736350 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:40.736350 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:40.736350 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:40.736350 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:40.736570 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6663fa-a43c-4ba3-8b0d-a83d5b822ccd None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:40.740453 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 333/657] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:40.741317 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9df2e8-e2fc-4518-a845-4dd6e8e27728 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:40.758394 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 325/658] 10.222.0.15 () {56 vars in 1137 bytes} [Fri Jun 3 11:45:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:40.759417 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6663fa-a43c-4ba3-8b0d-a83d5b822ccd None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:40.808022 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:40.850147 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9df2e8-e2fc-4518-a845-4dd6e8e27728 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:40.867567 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6663fa-a43c-4ba3-8b0d-a83d5b822ccd None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:40.885549 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14578b7b-3a26-4ef8-99a0-d9457d878bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:40.886414 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14578b7b-3a26-4ef8-99a0-d9457d878bfb None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:40.886841 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14578b7b-3a26-4ef8-99a0-d9457d878bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:40.887043 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14578b7b-3a26-4ef8-99a0-d9457d878bfb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:40.896500 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:40.902267 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14578b7b-3a26-4ef8-99a0-d9457d878bfb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:40.904028 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14578b7b-3a26-4ef8-99a0-d9457d878bfb None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:40.908117 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34301e-271f-4c7c-a28c-07a02edf8363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:40.909015 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34301e-271f-4c7c-a28c-07a02edf8363 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:40.909491 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34301e-271f-4c7c-a28c-07a02edf8363 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:40.910121 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34301e-271f-4c7c-a28c-07a02edf8363 None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:40.910858 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34301e-271f-4c7c-a28c-07a02edf8363 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:40.911166 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34301e-271f-4c7c-a28c-07a02edf8363 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:40.912555 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34301e-271f-4c7c-a28c-07a02edf8363 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:40.920392 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-14578b7b-3a26-4ef8-99a0-d9457d878bfb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 03 11:45:40.920392 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:40.920392 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:40.920392 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:40.920392 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:40.920392 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:40.920392 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:40.920392 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:40.920392 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:40.920392 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:40.920392 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:40.920392 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:40.920392 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 11:45:40.920392 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 11:45:40.920392 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 11:45:40.920392 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 11:45:40.921526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:40.921526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:40.921526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 11:45:40.921526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:45:40.921526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 11:45:40.921526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:45:40.921526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:40.921526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:40.921526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:40.921526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:40.921526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:40.921526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:40.921526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:40.921526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:40.921526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:40.921526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:40.921526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:40.921526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:40.922576 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:40.922576 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:40.922576 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 11:45:40.922576 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 11:45:40.922576 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 11:45:40.922576 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 11:45:40.922576 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 11:45:40.922576 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 11:45:40.922576 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 03 11:45:40.922576 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:40.928794 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 334/660] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Jun 3 11:45:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:40.928925 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 326/660] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:40.929694 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34301e-271f-4c7c-a28c-07a02edf8363 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:40.930076 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14578b7b-3a26-4ef8-99a0-d9457d878bfb None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:41.034968 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14578b7b-3a26-4ef8-99a0-d9457d878bfb None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:41.042196 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34301e-271f-4c7c-a28c-07a02edf8363 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:41.060114 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:41.072546 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36636a39-13dd-419c-8297-464b1806a50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:41.073286 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36636a39-13dd-419c-8297-464b1806a50d None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:41.073802 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36636a39-13dd-419c-8297-464b1806a50d None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:41.074425 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36636a39-13dd-419c-8297-464b1806a50d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:41.081503 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36636a39-13dd-419c-8297-464b1806a50d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:41.083033 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36636a39-13dd-419c-8297-464b1806a50d None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:41.084106 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d23149e-e5b0-4380-8fcb-a37890a4de01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:41.085051 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23149e-e5b0-4380-8fcb-a37890a4de01 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:41.085491 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23149e-e5b0-4380-8fcb-a37890a4de01 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:41.085962 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23149e-e5b0-4380-8fcb-a37890a4de01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:41.098517 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-36636a39-13dd-419c-8297-464b1806a50d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:45:41.098517 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:41.098517 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:41.098517 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:41.098517 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:41.098517 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:41.098517 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:41.098517 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:41.098517 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:41.098517 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:41.098517 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:41.098517 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:41.098517 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 11:45:41.098517 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 11:45:41.098517 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 11:45:41.099730 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 11:45:41.099730 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:41.099730 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:41.099730 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:41.099730 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:41.099730 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:41.099730 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:41.099730 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:41.099730 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:41.099730 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:41.099730 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:41.099730 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:41.099730 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:41.099730 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:41.099730 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:41.099730 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:41.099730 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:41.100897 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 11:45:41.100897 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 11:45:41.100897 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 11:45:41.100897 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 11:45:41.100897 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 11:45:41.100897 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 11:45:41.100897 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:45:41.100897 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:41.104906 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 335/661] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:45:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:41.105811 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36636a39-13dd-419c-8297-464b1806a50d None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:41.152427 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:41.168102 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d23149e-e5b0-4380-8fcb-a37890a4de01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:41.169746 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d23149e-e5b0-4380-8fcb-a37890a4de01 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:41.225452 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36636a39-13dd-419c-8297-464b1806a50d None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:41.270242 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f39fa-4660-4dc1-96ff-8c00671047df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:41.270913 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f39fa-4660-4dc1-96ff-8c00671047df None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:41.271263 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f39fa-4660-4dc1-96ff-8c00671047df None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:41.271633 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f39fa-4660-4dc1-96ff-8c00671047df None admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:41.272532 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f39fa-4660-4dc1-96ff-8c00671047df None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:41.272929 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f39fa-4660-4dc1-96ff-8c00671047df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:41.274424 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f39fa-4660-4dc1-96ff-8c00671047df None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:41.275104 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 327/662] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:45:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 11:45:41.276388 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d23149e-e5b0-4380-8fcb-a37890a4de01 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:41.298427 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 336/663] 10.222.0.15 () {56 vars in 1139 bytes} [Fri Jun 3 11:45:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:41.299189 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f39fa-4660-4dc1-96ff-8c00671047df None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:41.346164 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:41.395875 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:41.406760 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d23149e-e5b0-4380-8fcb-a37890a4de01 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:41.417737 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f39fa-4660-4dc1-96ff-8c00671047df None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:41.451472 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835245cc-f543-4f5a-8787-da778f1b3ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:41.452839 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835245cc-f543-4f5a-8787-da778f1b3ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:41.453349 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835245cc-f543-4f5a-8787-da778f1b3ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:41.453831 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835245cc-f543-4f5a-8787-da778f1b3ac2 None admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:41.455044 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835245cc-f543-4f5a-8787-da778f1b3ac2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:41.455559 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835245cc-f543-4f5a-8787-da778f1b3ac2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:41.455955 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed5581-1e39-4f0c-9eb8-3d62211d8be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:41.456810 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed5581-1e39-4f0c-9eb8-3d62211d8be7 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:41.457176 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed5581-1e39-4f0c-9eb8-3d62211d8be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:41.457518 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed5581-1e39-4f0c-9eb8-3d62211d8be7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:41.458021 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835245cc-f543-4f5a-8787-da778f1b3ac2 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:41.468065 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed5581-1e39-4f0c-9eb8-3d62211d8be7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:41.469586 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed5581-1e39-4f0c-9eb8-3d62211d8be7 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:41.473688 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 328/664] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 3 11:45:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:41.474722 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835245cc-f543-4f5a-8787-da778f1b3ac2 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:41.494142 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-19ed5581-1e39-4f0c-9eb8-3d62211d8be7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:41.494142 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:41.494142 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:41.494142 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:41.494142 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:41.494142 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:41.494142 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:41.494142 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:41.494142 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:41.494142 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:41.494142 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:41.494142 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:41.494142 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:41.494142 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:41.494142 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:41.495118 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:41.495118 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:41.495118 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:41.495118 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:41.495118 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:41.495118 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:41.495118 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:41.495118 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:41.495118 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:41.495118 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:41.495118 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:41.495118 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:41.495118 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:41.495118 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:41.495118 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:41.495118 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:41.495118 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:41.496020 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:41.496020 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:41.496020 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:41.496020 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:41.496020 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 337/665] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:41.497075 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed5581-1e39-4f0c-9eb8-3d62211d8be7 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:41.597733 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:41.608056 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed5581-1e39-4f0c-9eb8-3d62211d8be7 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:41.610052 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835245cc-f543-4f5a-8787-da778f1b3ac2 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:41.647543 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419931af-72fd-4b50-8c9a-c34a8f47d640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:41.648447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419931af-72fd-4b50-8c9a-c34a8f47d640 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:41.648797 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419931af-72fd-4b50-8c9a-c34a8f47d640 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:41.649136 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419931af-72fd-4b50-8c9a-c34a8f47d640 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:41.654208 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723ce74-ac2f-456d-8f91-3f6422ae502c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:41.655076 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723ce74-ac2f-456d-8f91-3f6422ae502c None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:41.655527 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723ce74-ac2f-456d-8f91-3f6422ae502c None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:41.655951 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723ce74-ac2f-456d-8f91-3f6422ae502c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:41.656934 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7723ce74-ac2f-456d-8f91-3f6422ae502c None admin] RBAC: Adding query filter params (role.id=41158ae54c7a437284af718034e9b354, scope.project.id=cff223ee05524cf4bf3591fc5a39559e, user.id=9aa048aec48b4755ac13eae997bff2fc) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:41.657411 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7723ce74-ac2f-456d-8f91-3f6422ae502c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:41.660118 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7723ce74-ac2f-456d-8f91-3f6422ae502c None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:41.666100 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:41.672194 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 338/666] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:45:41 2022] GET /identity/v3/role_assignments?user.id=9aa048aec48b4755ac13eae997bff2fc&scope.project.id=cff223ee05524cf4bf3591fc5a39559e&role.id=41158ae54c7a437284af718034e9b354 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:41.672194 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723ce74-ac2f-456d-8f91-3f6422ae502c None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:41.733902 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419931af-72fd-4b50-8c9a-c34a8f47d640 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:41.735386 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419931af-72fd-4b50-8c9a-c34a8f47d640 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:41.821275 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723ce74-ac2f-456d-8f91-3f6422ae502c None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:41.860327 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 329/667] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:45:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 11:45:41.861986 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1772d2-a4ed-470f-8ed6-2ef6e259b3dd None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:41.862392 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1772d2-a4ed-470f-8ed6-2ef6e259b3dd None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:41.862766 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1772d2-a4ed-470f-8ed6-2ef6e259b3dd None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:41.864763 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 330/668] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:45:41.865580 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1772d2-a4ed-470f-8ed6-2ef6e259b3dd None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:41.868932 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89959e5f-986b-4dfa-97d0-b931595cc988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:41.869887 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89959e5f-986b-4dfa-97d0-b931595cc988 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:41.870237 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89959e5f-986b-4dfa-97d0-b931595cc988 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:41.870595 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89959e5f-986b-4dfa-97d0-b931595cc988 None admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:41.871392 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89959e5f-986b-4dfa-97d0-b931595cc988 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:41.871812 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89959e5f-986b-4dfa-97d0-b931595cc988 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:41.873268 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89959e5f-986b-4dfa-97d0-b931595cc988 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:41.887109 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 339/669] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:41.888670 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57e747-1499-4484-a01d-a1abcd1e894d None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:41.889032 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57e747-1499-4484-a01d-a1abcd1e894d None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:41.889383 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57e747-1499-4484-a01d-a1abcd1e894d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:41.911848 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-0f57e747-1499-4484-a01d-a1abcd1e894d None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:41.913112 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-0f57e747-1499-4484-a01d-a1abcd1e894d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:41.930139 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:41.934621 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:41.999281 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 340/670] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:45:42.000028 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f57e747-1499-4484-a01d-a1abcd1e894d None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:42.009712 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1772d2-a4ed-470f-8ed6-2ef6e259b3dd None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:42.053377 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b82eac-e0e4-455a-a350-46b0e2e8bbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:42.054162 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b82eac-e0e4-455a-a350-46b0e2e8bbed None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:42.054443 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b82eac-e0e4-455a-a350-46b0e2e8bbed None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:42.054737 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b82eac-e0e4-455a-a350-46b0e2e8bbed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:42.065737 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b82eac-e0e4-455a-a350-46b0e2e8bbed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:42.067205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b82eac-e0e4-455a-a350-46b0e2e8bbed None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:42.085742 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-a9b82eac-e0e4-455a-a350-46b0e2e8bbed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:42.085742 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:42.085742 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:42.085742 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:42.085742 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:42.085742 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:42.085742 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:42.085742 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:42.085742 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:42.085742 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:42.085742 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:42.085742 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:42.085742 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:42.085742 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:42.085742 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:42.086685 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:42.086685 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:42.086685 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:42.086685 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:42.086685 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:42.086685 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:42.086685 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:42.086685 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:42.086685 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:42.086685 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:42.086685 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:42.086685 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:42.086685 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:42.086685 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:42.086685 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:42.086685 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:42.086685 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:42.087612 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:42.087612 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:42.087612 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:42.087612 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:42.091418 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 331/671] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:42.092294 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b82eac-e0e4-455a-a350-46b0e2e8bbed None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:42.124038 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f57e747-1499-4484-a01d-a1abcd1e894d None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:42.167683 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8e43c-04fe-4004-ae8d-d28a1283abbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:42.168576 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8e43c-04fe-4004-ae8d-d28a1283abbe None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:42.168983 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8e43c-04fe-4004-ae8d-d28a1283abbe None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:42.169325 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8e43c-04fe-4004-ae8d-d28a1283abbe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:42.176900 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa8e43c-04fe-4004-ae8d-d28a1283abbe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:42.178461 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa8e43c-04fe-4004-ae8d-d28a1283abbe None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:42.193088 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-3fa8e43c-04fe-4004-ae8d-d28a1283abbe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:45:42.193088 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:42.193088 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:42.193088 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:42.193088 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:42.193088 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:42.193088 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:42.193088 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:42.193088 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:42.193088 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:42.193088 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:42.193088 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:42.193088 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 11:45:42.193088 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 11:45:42.193088 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 11:45:42.194263 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 11:45:42.194263 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:42.194263 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:42.194263 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:42.194263 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:42.194263 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:42.194263 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:42.194263 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:42.194263 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:42.194263 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:42.194263 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:42.194263 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:42.194263 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:42.194263 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:42.194263 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:42.194263 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:42.194263 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:42.195385 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 11:45:42.195385 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 11:45:42.195385 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 11:45:42.195385 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 11:45:42.195385 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 11:45:42.195385 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 11:45:42.195385 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:45:42.195385 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:42.196779 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 341/672] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:45:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:42.197778 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8e43c-04fe-4004-ae8d-d28a1283abbe None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:42.203770 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:42.208467 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:42.213608 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b82eac-e0e4-455a-a350-46b0e2e8bbed None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:42.253069 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd6279d-a6a0-48ea-a8ba-ff899c58e446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:42.253861 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6279d-a6a0-48ea-a8ba-ff899c58e446 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:42.254143 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6279d-a6a0-48ea-a8ba-ff899c58e446 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:42.254415 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6279d-a6a0-48ea-a8ba-ff899c58e446 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:42.264915 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd6279d-a6a0-48ea-a8ba-ff899c58e446 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:45:42.273094 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-abd6279d-a6a0-48ea-a8ba-ff899c58e446 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 11:45:42.273094 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:42.273094 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:42.273094 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:42.273094 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:42.273094 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:42.273094 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:42.273094 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:42.273094 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:42.273094 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:42.273094 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:42.273094 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:42.273094 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:45:42.273094 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:45:42.273094 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:45:42.273094 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:45:42.274023 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:45:42.274023 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:45:42.274023 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:45:42.274023 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:45:42.274023 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:42.274023 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:42.274023 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:42.274023 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:42.274023 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:42.274023 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:42.274023 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:42.274023 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:42.274023 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:42.274023 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:42.274023 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:42.274023 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:42.274866 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:42.274866 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:42.274866 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:42.274866 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:42.274866 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:45:42.274866 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:45:42.274866 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:45:42.274866 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:45:42.274866 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:45:42.274866 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:45:42.274866 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 11:45:42.274866 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:42.274866 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 332/673] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Jun 3 11:45:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:42.275842 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd6279d-a6a0-48ea-a8ba-ff899c58e446 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:42.309900 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8e43c-04fe-4004-ae8d-d28a1283abbe None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:42.346644 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66451a41-45de-4c4d-b66f-aef34d494fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:42.347854 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66451a41-45de-4c4d-b66f-aef34d494fa8 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:42.348143 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66451a41-45de-4c4d-b66f-aef34d494fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:42.348573 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66451a41-45de-4c4d-b66f-aef34d494fa8 None admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:42.349301 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66451a41-45de-4c4d-b66f-aef34d494fa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:42.349679 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66451a41-45de-4c4d-b66f-aef34d494fa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:42.351315 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66451a41-45de-4c4d-b66f-aef34d494fa8 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:42.363427 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 342/674] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:42.363427 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a5df8-bcf9-4b63-ac15-b99f05a91193 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:42.363427 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a5df8-bcf9-4b63-ac15-b99f05a91193 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:42.363427 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a5df8-bcf9-4b63-ac15-b99f05a91193 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:42.363427 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 343/675] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:45:42.363427 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a5df8-bcf9-4b63-ac15-b99f05a91193 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:42.388820 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd6279d-a6a0-48ea-a8ba-ff899c58e446 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:42.422674 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2dd02-491f-4df3-b6df-6da3fba2a7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:42.423325 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2dd02-491f-4df3-b6df-6da3fba2a7d8 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:42.423703 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2dd02-491f-4df3-b6df-6da3fba2a7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:42.423980 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2dd02-491f-4df3-b6df-6da3fba2a7d8 None admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:42.424755 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f2dd02-491f-4df3-b6df-6da3fba2a7d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:42.425068 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f2dd02-491f-4df3-b6df-6da3fba2a7d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:42.426497 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f2dd02-491f-4df3-b6df-6da3fba2a7d8 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:42.438251 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:42.443922 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 333/676] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 3 11:45:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:42.444810 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2dd02-491f-4df3-b6df-6da3fba2a7d8 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:42.460211 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:42.476849 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a5df8-bcf9-4b63-ac15-b99f05a91193 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:42.510665 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c606087-cafc-4046-a62d-7d415a439192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:42.511338 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c606087-cafc-4046-a62d-7d415a439192 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:42.511661 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c606087-cafc-4046-a62d-7d415a439192 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:42.511938 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c606087-cafc-4046-a62d-7d415a439192 None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:42.512680 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c606087-cafc-4046-a62d-7d415a439192 None admin] RBAC: Adding query filter params (name=service) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:42.512988 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c606087-cafc-4046-a62d-7d415a439192 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:42.514377 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c606087-cafc-4046-a62d-7d415a439192 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:42.523792 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 344/677] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Jun 3 11:45:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:42.525013 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed9e7b-24d1-4b27-a0dd-a02fe65b0adc None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:42.525296 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed9e7b-24d1-4b27-a0dd-a02fe65b0adc None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:42.525819 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed9e7b-24d1-4b27-a0dd-a02fe65b0adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:42.541698 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-22ed9e7b-24d1-4b27-a0dd-a02fe65b0adc None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:42.542861 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-22ed9e7b-24d1-4b27-a0dd-a02fe65b0adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:42.552162 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2dd02-491f-4df3-b6df-6da3fba2a7d8 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:42.589002 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86386f7b-0e0a-4a50-93bc-faa263e0fa7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:42.589789 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86386f7b-0e0a-4a50-93bc-faa263e0fa7b None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:42.590067 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86386f7b-0e0a-4a50-93bc-faa263e0fa7b None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:42.590361 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86386f7b-0e0a-4a50-93bc-faa263e0fa7b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:42.597931 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86386f7b-0e0a-4a50-93bc-faa263e0fa7b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:42.599363 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86386f7b-0e0a-4a50-93bc-faa263e0fa7b None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:42.614037 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 345/678] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:45:42.614263 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-86386f7b-0e0a-4a50-93bc-faa263e0fa7b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:45:42.614263 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:42.614263 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:42.614263 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:42.614263 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:42.614263 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:42.614263 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:42.614263 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:42.614263 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:42.614263 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:42.614263 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:42.614263 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:42.614263 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 11:45:42.614263 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 11:45:42.614263 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 11:45:42.615128 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 11:45:42.615128 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:42.615128 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:42.615128 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:42.615128 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:42.615128 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:42.615128 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:42.615128 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:42.615128 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:42.615128 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:42.615128 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:42.615128 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:42.615128 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:42.615128 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:42.615128 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:42.615128 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:42.615128 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:42.616049 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 11:45:42.616049 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 11:45:42.616049 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 11:45:42.616049 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 11:45:42.616049 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 11:45:42.616049 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 11:45:42.616049 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:45:42.616049 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:42.617305 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed9e7b-24d1-4b27-a0dd-a02fe65b0adc None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:42.620471 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 334/679] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:45:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:42.621308 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86386f7b-0e0a-4a50-93bc-faa263e0fa7b None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:42.684851 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:42.701131 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:42.726882 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86386f7b-0e0a-4a50-93bc-faa263e0fa7b None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:42.729163 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed9e7b-24d1-4b27-a0dd-a02fe65b0adc None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:42.763104 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ae70b-7026-4f56-a7a6-3e8b104649b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:42.764002 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ae70b-7026-4f56-a7a6-3e8b104649b1 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:42.764520 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ae70b-7026-4f56-a7a6-3e8b104649b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:42.764520 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ae70b-7026-4f56-a7a6-3e8b104649b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:42.773084 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9959b3-8122-4c6e-9cdb-96f32d40873e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:42.774126 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9959b3-8122-4c6e-9cdb-96f32d40873e None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:42.774418 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9959b3-8122-4c6e-9cdb-96f32d40873e None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:42.774693 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9959b3-8122-4c6e-9cdb-96f32d40873e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:42.775958 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9959b3-8122-4c6e-9cdb-96f32d40873e None admin] RBAC: Adding query filter params (role.id=41158ae54c7a437284af718034e9b354, scope.project.id=cff223ee05524cf4bf3591fc5a39559e, user.id=978c834f137a4a6ab83a54af0239c137) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:42.776061 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ae70b-7026-4f56-a7a6-3e8b104649b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:42.776275 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9959b3-8122-4c6e-9cdb-96f32d40873e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:42.777391 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ae70b-7026-4f56-a7a6-3e8b104649b1 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:42.777749 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9959b3-8122-4c6e-9cdb-96f32d40873e None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:42.784389 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 346/680] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:45:42 2022] GET /identity/v3/role_assignments?user.id=978c834f137a4a6ab83a54af0239c137&scope.project.id=cff223ee05524cf4bf3591fc5a39559e&role.id=41158ae54c7a437284af718034e9b354 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:42.785050 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9959b3-8122-4c6e-9cdb-96f32d40873e None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:42.809228 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-248ae70b-7026-4f56-a7a6-3e8b104649b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:42.809228 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:42.809228 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:42.809228 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:42.809228 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:42.809228 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:42.809228 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:42.809228 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:42.809228 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:42.809228 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:42.809228 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:42.809228 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:42.809228 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:42.809228 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:42.809228 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:42.810205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:42.810205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:42.810205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:42.810205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:42.810205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:42.810205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:42.810205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:42.810205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:42.810205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:42.810205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:42.810205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:42.810205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:42.810205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:42.810205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:42.810205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:42.810205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:42.810205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:42.811086 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:42.811086 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:42.811086 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:42.811086 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:42.813498 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 335/681] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:42.814598 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ae70b-7026-4f56-a7a6-3e8b104649b1 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:42.926981 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9959b3-8122-4c6e-9cdb-96f32d40873e None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:42.929522 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ae70b-7026-4f56-a7a6-3e8b104649b1 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:42.955267 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:42.959073 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:42.972185 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e51080-f43b-4acc-bd07-22de3208fe4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:42.973061 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e51080-f43b-4acc-bd07-22de3208fe4d None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:42.973459 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e51080-f43b-4acc-bd07-22de3208fe4d None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:42.973830 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e51080-f43b-4acc-bd07-22de3208fe4d None admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:42.974480 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e0c3c-aab6-4158-a4a0-c3edae49275d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:42.974860 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e51080-f43b-4acc-bd07-22de3208fe4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:42.975276 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e51080-f43b-4acc-bd07-22de3208fe4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:42.975816 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e0c3c-aab6-4158-a4a0-c3edae49275d None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:42.976243 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e0c3c-aab6-4158-a4a0-c3edae49275d None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:42.976659 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e0c3c-aab6-4158-a4a0-c3edae49275d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:42.977196 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e51080-f43b-4acc-bd07-22de3208fe4d None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:42.993170 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e0c3c-aab6-4158-a4a0-c3edae49275d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:45:42.994308 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 347/682] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 3 11:45:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:42.999619 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e51080-f43b-4acc-bd07-22de3208fe4d None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:43.003325 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-cd6e0c3c-aab6-4158-a4a0-c3edae49275d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:45:43.003325 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:43.003325 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:43.003325 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:43.003325 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:43.003325 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:43.003325 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:43.003325 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:43.003325 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:43.003325 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:43.003325 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:43.003325 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:43.003325 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:45:43.003325 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:45:43.003325 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:45:43.003325 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:45:43.004425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:45:43.004425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:45:43.004425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:45:43.004425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:45:43.004425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:43.004425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:43.004425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:43.004425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:43.004425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:43.004425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:43.004425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:43.004425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:43.004425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:43.004425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:43.004425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:43.004425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:43.005288 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:43.005288 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:43.005288 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:43.005288 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:43.005288 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:45:43.005288 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:45:43.005288 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:45:43.005288 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:45:43.005288 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:45:43.005288 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:45:43.005288 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:45:43.005288 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:43.005288 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 336/683] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 3 11:45:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:43.005288 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e0c3c-aab6-4158-a4a0-c3edae49275d None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:43.119662 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e51080-f43b-4acc-bd07-22de3208fe4d None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:43.127553 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e0c3c-aab6-4158-a4a0-c3edae49275d None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:43.158201 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a8655-2805-4676-9d69-d3d4472aa5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:43.158898 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a8655-2805-4676-9d69-d3d4472aa5de None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:43.159139 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a8655-2805-4676-9d69-d3d4472aa5de None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:43.159410 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a8655-2805-4676-9d69-d3d4472aa5de None admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:43.160171 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a8655-2805-4676-9d69-d3d4472aa5de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:43.160473 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a8655-2805-4676-9d69-d3d4472aa5de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:43.161838 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a8655-2805-4676-9d69-d3d4472aa5de None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:43.171980 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d40f6e-e4d0-46f5-a407-c42396a954df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:43.172918 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d40f6e-e4d0-46f5-a407-c42396a954df None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:43.173206 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d40f6e-e4d0-46f5-a407-c42396a954df None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:43.173543 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d40f6e-e4d0-46f5-a407-c42396a954df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:43.174374 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d40f6e-e4d0-46f5-a407-c42396a954df None admin] RBAC: Adding query filter params (role.id=41158ae54c7a437284af718034e9b354, scope.project.id=cff223ee05524cf4bf3591fc5a39559e, user.id=a78b4284099546cd9c126a5739380b8f) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:43.174560 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 348/684] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:43.174713 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d40f6e-e4d0-46f5-a407-c42396a954df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:43.175336 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a8655-2805-4676-9d69-d3d4472aa5de None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:43.176151 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d40f6e-e4d0-46f5-a407-c42396a954df None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:43.184291 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 337/685] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:45:43 2022] GET /identity/v3/role_assignments?user.id=a78b4284099546cd9c126a5739380b8f&scope.project.id=cff223ee05524cf4bf3591fc5a39559e&role.id=41158ae54c7a437284af718034e9b354 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:43.185108 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d40f6e-e4d0-46f5-a407-c42396a954df None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:43.257224 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:43.303897 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:43.368727 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d40f6e-e4d0-46f5-a407-c42396a954df None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:43.409248 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a8655-2805-4676-9d69-d3d4472aa5de None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:43.426341 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7bae8-b352-4966-bee8-1bd5eb62596f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:43.427253 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7bae8-b352-4966-bee8-1bd5eb62596f None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:43.427608 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7bae8-b352-4966-bee8-1bd5eb62596f None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:43.427894 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7bae8-b352-4966-bee8-1bd5eb62596f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:43.437067 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e7bae8-b352-4966-bee8-1bd5eb62596f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:43.441882 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e7bae8-b352-4966-bee8-1bd5eb62596f None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:43.453413 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda484bc-158c-4c4d-9619-37a5e0793156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:43.454283 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda484bc-158c-4c4d-9619-37a5e0793156 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:43.454758 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda484bc-158c-4c4d-9619-37a5e0793156 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:43.455722 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda484bc-158c-4c4d-9619-37a5e0793156 None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:43.456610 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda484bc-158c-4c4d-9619-37a5e0793156 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:43.456737 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-24e7bae8-b352-4966-bee8-1bd5eb62596f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 03 11:45:43.456737 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:43.456737 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:43.456737 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:43.456737 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:43.456737 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:43.456737 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:43.456737 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:43.456737 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:43.456737 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:43.456737 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:43.456737 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:43.456737 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 11:45:43.456737 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 11:45:43.456737 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 11:45:43.456737 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 11:45:43.457590 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:43.457590 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:43.457590 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 11:45:43.457590 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:45:43.457590 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 11:45:43.457590 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:45:43.457590 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:43.457590 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:43.457590 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:43.457590 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:43.457590 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:43.457590 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:43.457590 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:43.457590 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:43.457590 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:43.457590 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:43.457590 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:43.457590 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:43.458970 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:43.458970 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:43.458970 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 11:45:43.458970 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 11:45:43.458970 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 11:45:43.458970 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 11:45:43.458970 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 11:45:43.458970 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 11:45:43.458970 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 03 11:45:43.458970 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:43.458970 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 338/686] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 3 11:45:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:43.460308 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda484bc-158c-4c4d-9619-37a5e0793156 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:43.461903 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda484bc-158c-4c4d-9619-37a5e0793156 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:43.463713 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7bae8-b352-4966-bee8-1bd5eb62596f None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:43.473423 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 349/687] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:45:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:43.478983 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda484bc-158c-4c4d-9619-37a5e0793156 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:43.578897 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7bae8-b352-4966-bee8-1bd5eb62596f None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:43.590811 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:43.609482 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda484bc-158c-4c4d-9619-37a5e0793156 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:43.615035 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:43.624396 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac08ec5-a152-4586-8106-15b27c7eb796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:43.625420 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac08ec5-a152-4586-8106-15b27c7eb796 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:43.626140 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac08ec5-a152-4586-8106-15b27c7eb796 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:43.627223 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac08ec5-a152-4586-8106-15b27c7eb796 None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:43.628469 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac08ec5-a152-4586-8106-15b27c7eb796 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:43.629346 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac08ec5-a152-4586-8106-15b27c7eb796 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:43.631260 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac08ec5-a152-4586-8106-15b27c7eb796 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:43.651674 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84632794-9731-4206-955d-7bc62239597c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:43.652591 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84632794-9731-4206-955d-7bc62239597c None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:43.652934 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84632794-9731-4206-955d-7bc62239597c None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:43.653278 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84632794-9731-4206-955d-7bc62239597c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:43.656067 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 339/688] 10.222.0.15 () {56 vars in 1135 bytes} [Fri Jun 3 11:45:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:45:43.662257 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac08ec5-a152-4586-8106-15b27c7eb796 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:43.672704 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84632794-9731-4206-955d-7bc62239597c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:43.674792 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84632794-9731-4206-955d-7bc62239597c None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:43.700741 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-84632794-9731-4206-955d-7bc62239597c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:43.700741 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:43.700741 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:43.700741 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:43.700741 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:43.700741 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:43.700741 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:43.700741 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:43.700741 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:43.700741 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:43.700741 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:43.700741 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:43.700741 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:43.700741 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:43.700741 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:43.701682 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:43.701682 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:43.701682 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:43.701682 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:43.701682 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:43.701682 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:43.701682 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:43.701682 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:43.701682 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:43.701682 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:43.701682 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:43.701682 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:43.701682 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:43.701682 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:43.701682 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:43.701682 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:43.701682 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:43.702579 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:43.702579 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:43.702579 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:43.702579 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:43.711315 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 350/689] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:43.716757 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84632794-9731-4206-955d-7bc62239597c None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:43.831628 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac08ec5-a152-4586-8106-15b27c7eb796 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:43.917957 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29a8ac-625f-457a-9a38-db949ec3fa8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:43.918613 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29a8ac-625f-457a-9a38-db949ec3fa8c None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:43.920619 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84632794-9731-4206-955d-7bc62239597c None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:43.923844 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29a8ac-625f-457a-9a38-db949ec3fa8c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:43.924146 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29a8ac-625f-457a-9a38-db949ec3fa8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:43.959116 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5293f4-fef3-4740-80e8-e4c1295ad341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:43.959851 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5293f4-fef3-4740-80e8-e4c1295ad341 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:43.960138 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5293f4-fef3-4740-80e8-e4c1295ad341 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:43.960413 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5293f4-fef3-4740-80e8-e4c1295ad341 None admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:43.961141 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5293f4-fef3-4740-80e8-e4c1295ad341 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:43.961451 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5293f4-fef3-4740-80e8-e4c1295ad341 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:43.962823 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5293f4-fef3-4740-80e8-e4c1295ad341 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:43.975958 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 351/690] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:45:43.981696 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5293f4-fef3-4740-80e8-e4c1295ad341 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:44.009107 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:44.016678 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:44.048723 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29a8ac-625f-457a-9a38-db949ec3fa8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:44.050640 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29a8ac-625f-457a-9a38-db949ec3fa8c None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:44.160112 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5293f4-fef3-4740-80e8-e4c1295ad341 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:44.196017 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d286ed2-ab04-4e50-ad7f-ad757502ed6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:44.197164 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d286ed2-ab04-4e50-ad7f-ad757502ed6d None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:44.197652 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d286ed2-ab04-4e50-ad7f-ad757502ed6d None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:44.198168 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d286ed2-ab04-4e50-ad7f-ad757502ed6d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:44.206261 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d286ed2-ab04-4e50-ad7f-ad757502ed6d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:44.207973 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d286ed2-ab04-4e50-ad7f-ad757502ed6d None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:44.212107 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 340/691] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:45:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 03 11:45:44.217679 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29a8ac-625f-457a-9a38-db949ec3fa8c None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:44.224082 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-0d286ed2-ab04-4e50-ad7f-ad757502ed6d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 11:45:44.224082 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:44.224082 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:44.224082 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:44.224082 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:44.224082 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:44.224082 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:44.224082 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:44.224082 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:44.224082 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:44.224082 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:44.224082 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:44.224082 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 11:45:44.224082 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 11:45:44.224082 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 11:45:44.224082 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 11:45:44.225127 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:44.225127 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:44.225127 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 11:45:44.225127 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:45:44.225127 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 11:45:44.225127 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:45:44.225127 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:44.225127 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:44.225127 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:44.225127 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:44.225127 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:44.225127 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:44.225127 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:44.225127 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:44.225127 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:44.225127 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:44.225127 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:44.225127 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:44.226083 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:44.226083 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:44.226083 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 11:45:44.226083 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 11:45:44.226083 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 11:45:44.226083 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 11:45:44.226083 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 11:45:44.226083 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 11:45:44.226083 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 11:45:44.226083 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:44.228735 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 352/692] 10.222.0.15 () {56 vars in 1093 bytes} [Fri Jun 3 11:45:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:45:44.240593 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d286ed2-ab04-4e50-ad7f-ad757502ed6d None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:44.296706 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:44.330658 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:44.350112 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29a8ac-625f-457a-9a38-db949ec3fa8c None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:44.362303 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d286ed2-ab04-4e50-ad7f-ad757502ed6d None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:44.385817 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92619bf1-5044-4a50-8a72-18d0dfd27b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:44.386612 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92619bf1-5044-4a50-8a72-18d0dfd27b92 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:44.386894 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92619bf1-5044-4a50-8a72-18d0dfd27b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:44.387167 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92619bf1-5044-4a50-8a72-18d0dfd27b92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:44.398535 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92619bf1-5044-4a50-8a72-18d0dfd27b92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:44.400878 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92619bf1-5044-4a50-8a72-18d0dfd27b92 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:44.402579 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d3ce7-aff9-44fd-a156-06b07380bfc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:44.403250 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d3ce7-aff9-44fd-a156-06b07380bfc1 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:44.403557 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d3ce7-aff9-44fd-a156-06b07380bfc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:44.403839 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d3ce7-aff9-44fd-a156-06b07380bfc1 None admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:44.404682 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d3ce7-aff9-44fd-a156-06b07380bfc1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:44.404993 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d3ce7-aff9-44fd-a156-06b07380bfc1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:44.406430 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d3ce7-aff9-44fd-a156-06b07380bfc1 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:44.420854 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-92619bf1-5044-4a50-8a72-18d0dfd27b92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:44.420854 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:44.420854 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:44.420854 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:44.420854 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:44.420854 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:44.420854 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:44.420854 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:44.420854 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:44.420854 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:44.420854 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:44.420854 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:44.420854 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:44.420854 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:44.420854 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:44.421803 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:44.421803 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:44.421803 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:44.421803 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:44.421803 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:44.421803 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:44.421803 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:44.421803 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:44.421803 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:44.421803 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:44.421803 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:44.421803 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:44.421803 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:44.421803 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:44.421803 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:44.421803 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:44.421803 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:44.422732 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:44.422732 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:44.422732 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:44.422732 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:44.425789 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 353/694] 10.222.0.15 () {56 vars in 1133 bytes} [Fri Jun 3 11:45:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:44.425907 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 341/694] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:45:44.427112 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c99b1-b267-4e1e-8efe-fbeb264ebcfa None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:44.427401 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c99b1-b267-4e1e-8efe-fbeb264ebcfa None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:44.427729 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c99b1-b267-4e1e-8efe-fbeb264ebcfa None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:44.429064 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 354/695] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:45:44.430892 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92619bf1-5044-4a50-8a72-18d0dfd27b92 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:44.433655 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c99b1-b267-4e1e-8efe-fbeb264ebcfa None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:44.543319 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c99b1-b267-4e1e-8efe-fbeb264ebcfa None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:44.556602 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92619bf1-5044-4a50-8a72-18d0dfd27b92 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:44.577793 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:44.588757 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63efe1c0-2c91-4d86-b3e8-b7547bffb961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:44.589674 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63efe1c0-2c91-4d86-b3e8-b7547bffb961 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:44.589958 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63efe1c0-2c91-4d86-b3e8-b7547bffb961 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:44.590231 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63efe1c0-2c91-4d86-b3e8-b7547bffb961 None admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:44.591361 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63efe1c0-2c91-4d86-b3e8-b7547bffb961 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:44.591702 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63efe1c0-2c91-4d86-b3e8-b7547bffb961 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:44.593335 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63efe1c0-2c91-4d86-b3e8-b7547bffb961 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:44.594754 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:44.597494 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c422ba4e-c8fc-4b79-97d8-b984414199a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:44.598381 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422ba4e-c8fc-4b79-97d8-b984414199a1 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:44.598870 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422ba4e-c8fc-4b79-97d8-b984414199a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:44.599347 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422ba4e-c8fc-4b79-97d8-b984414199a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:44.608331 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 355/696] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:44.610225 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e019ec-6358-45c3-abdd-b3b4ef54f9ae None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:44.610527 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e019ec-6358-45c3-abdd-b3b4ef54f9ae None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:44.610808 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e019ec-6358-45c3-abdd-b3b4ef54f9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:44.629710 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-c9e019ec-6358-45c3-abdd-b3b4ef54f9ae None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:44.631216 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-c9e019ec-6358-45c3-abdd-b3b4ef54f9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:44.691198 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c422ba4e-c8fc-4b79-97d8-b984414199a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:44.693118 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c422ba4e-c8fc-4b79-97d8-b984414199a1 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:44.711607 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 356/697] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:45:44.712959 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e019ec-6358-45c3-abdd-b3b4ef54f9ae None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:44.842406 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e019ec-6358-45c3-abdd-b3b4ef54f9ae None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:44.844432 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 342/698] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:45:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 11:45:44.845394 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c422ba4e-c8fc-4b79-97d8-b984414199a1 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:44.868772 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:44.878861 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:44.904174 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e2977-0796-4e33-91e1-2982427a3d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:44.904983 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e2977-0796-4e33-91e1-2982427a3d19 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:44.905267 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e2977-0796-4e33-91e1-2982427a3d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:44.905544 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e2977-0796-4e33-91e1-2982427a3d19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:44.913681 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e2977-0796-4e33-91e1-2982427a3d19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:44.915090 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e2977-0796-4e33-91e1-2982427a3d19 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:44.929258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-746e2977-0796-4e33-91e1-2982427a3d19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:45:44.929258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:44.929258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:44.929258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:44.929258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:44.929258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:44.929258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:44.929258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:44.929258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:44.929258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:44.929258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:44.929258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:44.929258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 11:45:44.929258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 11:45:44.929258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 11:45:44.930148 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 11:45:44.930148 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:44.930148 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:44.930148 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:44.930148 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:44.930148 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:44.930148 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:44.930148 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:44.930148 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:44.930148 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:44.930148 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:44.930148 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:44.930148 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:44.930148 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:44.930148 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:44.930148 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:44.930148 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:44.931044 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 11:45:44.931044 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 11:45:44.931044 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 11:45:44.931044 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 11:45:44.931044 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 11:45:44.931044 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 11:45:44.931044 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:45:44.931044 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:44.931044 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 357/699] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:45:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:44.931551 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e2977-0796-4e33-91e1-2982427a3d19 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:44.983327 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c422ba4e-c8fc-4b79-97d8-b984414199a1 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:45.037142 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6ec09-46a0-46b3-87ef-b0f2ea9c3841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:45.038555 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6ec09-46a0-46b3-87ef-b0f2ea9c3841 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:45.039275 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6ec09-46a0-46b3-87ef-b0f2ea9c3841 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:45.040241 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6ec09-46a0-46b3-87ef-b0f2ea9c3841 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:45.049601 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e2977-0796-4e33-91e1-2982427a3d19 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:45.055651 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6ec09-46a0-46b3-87ef-b0f2ea9c3841 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:45.057894 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6ec09-46a0-46b3-87ef-b0f2ea9c3841 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:45.084230 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-ebe6ec09-46a0-46b3-87ef-b0f2ea9c3841 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:45.084230 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:45.084230 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:45.084230 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:45.084230 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:45.084230 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:45.084230 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:45.084230 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:45.084230 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:45.084230 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:45.084230 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:45.084230 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:45.084230 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:45.084230 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:45.084230 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:45.085521 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:45.085521 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:45.085521 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:45.085521 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:45.085521 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:45.085521 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:45.085521 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:45.085521 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:45.085521 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:45.085521 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:45.085521 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:45.085521 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:45.085521 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:45.085521 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:45.085521 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:45.085521 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:45.085521 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:45.086637 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:45.086637 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:45.086637 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:45.086637 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:45.088023 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb723da6-dad9-4951-bc35-bc0afe7d6d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:45.088841 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 343/700] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:45.089805 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6ec09-46a0-46b3-87ef-b0f2ea9c3841 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:45.094374 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb723da6-dad9-4951-bc35-bc0afe7d6d73 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:45.094374 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb723da6-dad9-4951-bc35-bc0afe7d6d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:45.094744 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb723da6-dad9-4951-bc35-bc0afe7d6d73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:45.106702 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb723da6-dad9-4951-bc35-bc0afe7d6d73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:45.108349 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb723da6-dad9-4951-bc35-bc0afe7d6d73 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:45.127882 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-eb723da6-dad9-4951-bc35-bc0afe7d6d73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:45.127882 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:45.127882 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:45.127882 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:45.127882 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:45.127882 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:45.127882 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:45.127882 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:45.127882 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:45.127882 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:45.127882 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:45.127882 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:45.127882 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:45.127882 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:45.127882 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:45.129084 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:45.129084 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:45.129084 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:45.129084 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:45.129084 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:45.129084 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:45.129084 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:45.129084 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:45.129084 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:45.129084 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:45.129084 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:45.129084 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:45.129084 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:45.129084 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:45.129084 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:45.129084 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:45.129084 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:45.130204 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:45.130204 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:45.130204 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:45.130204 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:45.131363 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 358/701] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:45.132573 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb723da6-dad9-4951-bc35-bc0afe7d6d73 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:45.183334 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:45.186869 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:45.230227 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6ec09-46a0-46b3-87ef-b0f2ea9c3841 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:45.258998 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb723da6-dad9-4951-bc35-bc0afe7d6d73 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:45.282908 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa84ca-a788-4425-b054-6b8acc62733a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:45.284221 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa84ca-a788-4425-b054-6b8acc62733a None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:45.284659 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa84ca-a788-4425-b054-6b8acc62733a None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:45.285492 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa84ca-a788-4425-b054-6b8acc62733a None admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:45.286742 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa84ca-a788-4425-b054-6b8acc62733a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:45.287225 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa84ca-a788-4425-b054-6b8acc62733a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:45.289793 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa84ca-a788-4425-b054-6b8acc62733a None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:45.296843 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265cc6f-3912-4b7e-b19f-2b67a5236e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:45.297649 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265cc6f-3912-4b7e-b19f-2b67a5236e0b None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:45.298029 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265cc6f-3912-4b7e-b19f-2b67a5236e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:45.298992 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265cc6f-3912-4b7e-b19f-2b67a5236e0b None admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:45.299859 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d265cc6f-3912-4b7e-b19f-2b67a5236e0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:45.300574 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d265cc6f-3912-4b7e-b19f-2b67a5236e0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:45.301952 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d265cc6f-3912-4b7e-b19f-2b67a5236e0b None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:45.311470 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 344/702] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 3 11:45:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:45.311470 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa84ca-a788-4425-b054-6b8acc62733a None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:45.322069 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 359/703] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:45.323836 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265cc6f-3912-4b7e-b19f-2b67a5236e0b None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:45.418170 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa84ca-a788-4425-b054-6b8acc62733a None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:45.428519 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:45.435763 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265cc6f-3912-4b7e-b19f-2b67a5236e0b None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:45.448810 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:45.454905 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4062fd-70ff-4c8e-95c5-fd27e7eeb324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:45.455603 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4062fd-70ff-4c8e-95c5-fd27e7eeb324 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:45.455894 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4062fd-70ff-4c8e-95c5-fd27e7eeb324 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:45.456174 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4062fd-70ff-4c8e-95c5-fd27e7eeb324 None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:45.456900 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4062fd-70ff-4c8e-95c5-fd27e7eeb324 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:45.457211 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4062fd-70ff-4c8e-95c5-fd27e7eeb324 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:45.458583 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4062fd-70ff-4c8e-95c5-fd27e7eeb324 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:45.471266 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 345/704] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:45.472597 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163cc68-20af-4c67-bcc1-244ec3538245 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:45.472888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163cc68-20af-4c67-bcc1-244ec3538245 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:45.473278 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163cc68-20af-4c67-bcc1-244ec3538245 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:45.474669 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 346/705] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:45:45.475199 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163cc68-20af-4c67-bcc1-244ec3538245 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:45.482673 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff953e-b8a4-4a8c-975a-60e90364688c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:45.483645 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff953e-b8a4-4a8c-975a-60e90364688c None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:45.484105 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff953e-b8a4-4a8c-975a-60e90364688c None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:45.484558 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff953e-b8a4-4a8c-975a-60e90364688c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:45.486645 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff953e-b8a4-4a8c-975a-60e90364688c None admin] RBAC: Adding query filter params (role.id=41158ae54c7a437284af718034e9b354, scope.project.id=cff223ee05524cf4bf3591fc5a39559e, user.id=5f52901fe535420bb0019272d4eafe72) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:45.487141 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff953e-b8a4-4a8c-975a-60e90364688c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:45.489483 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff953e-b8a4-4a8c-975a-60e90364688c None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:45.497023 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 360/706] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:45:45 2022] GET /identity/v3/role_assignments?user.id=5f52901fe535420bb0019272d4eafe72&scope.project.id=cff223ee05524cf4bf3591fc5a39559e&role.id=41158ae54c7a437284af718034e9b354 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:45.498074 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff953e-b8a4-4a8c-975a-60e90364688c None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:45.619617 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff953e-b8a4-4a8c-975a-60e90364688c None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:45.623969 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163cc68-20af-4c67-bcc1-244ec3538245 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:45.661785 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae47e50-2afa-4bde-8c4a-27b79c217b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:45.662758 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae47e50-2afa-4bde-8c4a-27b79c217b82 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:45.663125 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae47e50-2afa-4bde-8c4a-27b79c217b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:45.663470 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae47e50-2afa-4bde-8c4a-27b79c217b82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:45.670493 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55087a-2485-484c-b858-bedf671abb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:45.671681 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55087a-2485-484c-b858-bedf671abb03 None admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:45.672210 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55087a-2485-484c-b858-bedf671abb03 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:45.672767 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae47e50-2afa-4bde-8c4a-27b79c217b82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:45.672883 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55087a-2485-484c-b858-bedf671abb03 None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:45.674614 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea55087a-2485-484c-b858-bedf671abb03 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:45.674874 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae47e50-2afa-4bde-8c4a-27b79c217b82 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:45.676761 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea55087a-2485-484c-b858-bedf671abb03 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:45.691817 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-4ae47e50-2afa-4bde-8c4a-27b79c217b82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:45:45.691817 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:45.691817 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:45.691817 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:45.691817 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:45.691817 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:45.691817 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:45.691817 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:45.691817 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:45.691817 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:45.691817 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:45.691817 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:45.691817 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 11:45:45.691817 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 11:45:45.691817 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 11:45:45.692813 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 11:45:45.692813 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:45.692813 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:45.692813 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:45.692813 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:45.692813 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:45.692813 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:45.692813 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:45.692813 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:45.692813 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:45.692813 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:45.692813 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:45.692813 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:45.692813 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:45.692813 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:45.692813 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:45.692813 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:45.693749 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 11:45:45.693749 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 11:45:45.693749 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 11:45:45.693749 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 11:45:45.693749 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 11:45:45.693749 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 11:45:45.693749 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:45:45.693749 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:45.697928 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 361/707] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:45:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:45.699975 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986871f-2f33-43d0-939c-b720c92752c9 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:45.700276 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986871f-2f33-43d0-939c-b720c92752c9 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:45.700560 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986871f-2f33-43d0-939c-b720c92752c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:45.713077 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 347/708] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Jun 3 11:45:45 2022] POST /identity/v3/users => generated 254 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:45:45.714396 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55087a-2485-484c-b858-bedf671abb03 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:45.719967 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-4986871f-2f33-43d0-939c-b720c92752c9 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:45.721893 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-4986871f-2f33-43d0-939c-b720c92752c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:45.740692 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:45.807719 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 362/709] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:45:45.811889 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:45.831037 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986871f-2f33-43d0-939c-b720c92752c9 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:45.883178 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55087a-2485-484c-b858-bedf671abb03 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:45.926339 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926cc503-54ca-4c63-8c61-31ec1a3b0d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:45.927017 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cc503-54ca-4c63-8c61-31ec1a3b0d1e None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:45.927294 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cc503-54ca-4c63-8c61-31ec1a3b0d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:45.927594 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cc503-54ca-4c63-8c61-31ec1a3b0d1e None admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:45.928448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926cc503-54ca-4c63-8c61-31ec1a3b0d1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:45.928807 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926cc503-54ca-4c63-8c61-31ec1a3b0d1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:45.930289 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926cc503-54ca-4c63-8c61-31ec1a3b0d1e None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:45.955556 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 348/710] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 3 11:45:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:45.957555 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926cc503-54ca-4c63-8c61-31ec1a3b0d1e None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:45.959947 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986871f-2f33-43d0-939c-b720c92752c9 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:46.000662 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8da5b3-467b-4efc-8e51-96f1f98fd914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:46.001872 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8da5b3-467b-4efc-8e51-96f1f98fd914 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:46.002395 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8da5b3-467b-4efc-8e51-96f1f98fd914 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:46.002674 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8da5b3-467b-4efc-8e51-96f1f98fd914 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:46.003342 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8da5b3-467b-4efc-8e51-96f1f98fd914 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:46.004895 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8da5b3-467b-4efc-8e51-96f1f98fd914 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:46.021316 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-ce8da5b3-467b-4efc-8e51-96f1f98fd914 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 11:45:46.021316 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:46.021316 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 11:45:46.021316 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 11:45:46.021316 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 11:45:46.021316 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 11:45:46.021316 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 11:45:46.021316 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:45:46.021316 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 11:45:46.021316 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:46.021316 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 11:45:46.021316 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:46.021316 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:46.021316 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:46.021316 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:46.021316 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:46.022366 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:46.022366 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:46.022366 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:46.022366 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:46.022366 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:46.022366 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:46.022366 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:46.022366 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 11:45:46.022366 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 11:45:46.022366 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 11:45:46.022366 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 11:45:46.022366 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:46.022366 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:46.022366 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:46.022366 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:46.022366 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:46.023396 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:46.023396 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:46.023396 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:46.023396 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:46.023396 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:46.023396 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:46.023396 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:46.023396 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:46.023396 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:46.023396 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:46.023396 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:46.023396 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 11:45:46.023396 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:45:46.023396 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 11:45:46.023396 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:46.027576 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 363/711] 10.222.0.15 () {56 vars in 1129 bytes} [Fri Jun 3 11:45:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:46.028987 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9af07c-921a-4a6e-a086-04bf6fe05f0a None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:46.029283 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9af07c-921a-4a6e-a086-04bf6fe05f0a None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:46.029576 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9af07c-921a-4a6e-a086-04bf6fe05f0a None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:46.030891 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 364/712] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:45:46.032113 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9af07c-921a-4a6e-a086-04bf6fe05f0a None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:46.052347 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:46.081929 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926cc503-54ca-4c63-8c61-31ec1a3b0d1e None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:46.091799 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:46.132250 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9488a-e389-404a-9f22-2a13859700df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:46.132920 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9488a-e389-404a-9f22-2a13859700df None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:46.133260 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9488a-e389-404a-9f22-2a13859700df None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:46.133544 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9488a-e389-404a-9f22-2a13859700df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:46.134968 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f9488a-e389-404a-9f22-2a13859700df None admin] RBAC: Adding query filter params (role.id=c486e164840b41a59fd118dece2ce572, scope.project.id=cff223ee05524cf4bf3591fc5a39559e, user.id=6247bfb7aebd45eeb97ba5933be44c6d) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:46.135288 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f9488a-e389-404a-9f22-2a13859700df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:46.137689 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f9488a-e389-404a-9f22-2a13859700df None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:46.151636 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 349/713] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:45:45 2022] GET /identity/v3/role_assignments?user.id=6247bfb7aebd45eeb97ba5933be44c6d&scope.project.id=cff223ee05524cf4bf3591fc5a39559e&role.id=c486e164840b41a59fd118dece2ce572 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:46.153182 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4673039-5222-412f-ac4a-a4481a6014fd None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:46.153473 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4673039-5222-412f-ac4a-a4481a6014fd None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:46.153745 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4673039-5222-412f-ac4a-a4481a6014fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:46.181809 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9af07c-921a-4a6e-a086-04bf6fe05f0a None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:46.193857 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-b4673039-5222-412f-ac4a-a4481a6014fd None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:46.195087 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-b4673039-5222-412f-ac4a-a4481a6014fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:46.263378 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf9d58-cb26-4291-b120-a64ec9d64a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:46.264146 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf9d58-cb26-4291-b120-a64ec9d64a96 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:46.264427 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf9d58-cb26-4291-b120-a64ec9d64a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:46.264696 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf9d58-cb26-4291-b120-a64ec9d64a96 None admin] PATH_INFO: `/v3/services` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:46.266788 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cf9d58-cb26-4291-b120-a64ec9d64a96 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:46.267143 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cf9d58-cb26-4291-b120-a64ec9d64a96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:46.269235 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cf9d58-cb26-4291-b120-a64ec9d64a96 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:46.274803 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 365/714] 10.222.0.15 () {56 vars in 1124 bytes} [Fri Jun 3 11:45:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:45:46.280852 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf9d58-cb26-4291-b120-a64ec9d64a96 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:46.339767 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 350/715] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:45:46.371177 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:46.374498 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4673039-5222-412f-ac4a-a4481a6014fd None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:46.407926 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf9d58-cb26-4291-b120-a64ec9d64a96 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:46.443946 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5c62a-17fb-4493-ac1e-190a4e7d8e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:46.444625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5c62a-17fb-4493-ac1e-190a4e7d8e60 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:46.444935 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5c62a-17fb-4493-ac1e-190a4e7d8e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:46.445236 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5c62a-17fb-4493-ac1e-190a4e7d8e60 None admin] PATH_INFO: `/v3/services` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:46.446011 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc5c62a-17fb-4493-ac1e-190a4e7d8e60 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:46.446319 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc5c62a-17fb-4493-ac1e-190a4e7d8e60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:46.447729 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc5c62a-17fb-4493-ac1e-190a4e7d8e60 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:46.458684 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 366/716] 10.222.0.15 () {56 vars in 1124 bytes} [Fri Jun 3 11:45:46 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:45:46.500121 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4673039-5222-412f-ac4a-a4481a6014fd None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:46.503878 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:46.547149 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c02ec63-5213-4682-8791-3c147715e053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:46.547989 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c02ec63-5213-4682-8791-3c147715e053 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:46.548271 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c02ec63-5213-4682-8791-3c147715e053 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:46.548594 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c02ec63-5213-4682-8791-3c147715e053 None admin] PATH_INFO: `/v3/services/network` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:46.549264 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c02ec63-5213-4682-8791-3c147715e053 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:46.550650 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c02ec63-5213-4682-8791-3c147715e053 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:46.570156 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-6c02ec63-5213-4682-8791-3c147715e053 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 11:45:46.570156 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:46.570156 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 11:45:46.570156 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 11:45:46.570156 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 11:45:46.570156 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 11:45:46.570156 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 11:45:46.570156 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:45:46.570156 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 11:45:46.570156 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:46.570156 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 11:45:46.570156 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:46.570156 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:46.570156 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:46.570156 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:46.570156 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:46.570156 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:46.571311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:46.571311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:46.571311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:46.571311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:46.571311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:46.571311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:46.571311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 11:45:46.571311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 11:45:46.571311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 11:45:46.571311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 11:45:46.571311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:46.571311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:46.571311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:46.571311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:46.571311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:46.571311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:46.572255 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:46.572255 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:46.572255 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:46.572255 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:46.572255 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:46.572255 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:46.572255 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:46.572255 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:46.572255 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:46.572255 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:46.572255 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 11:45:46.572255 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:45:46.572255 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 11:45:46.572255 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:46.579525 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 351/717] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:45:46 2022] GET /identity/v3/services/network => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:46.584669 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5c62a-17fb-4493-ac1e-190a4e7d8e60 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:46.724275 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5c62a-17fb-4493-ac1e-190a4e7d8e60 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:46.760171 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90da8d31-253b-4abf-abc4-f4713d7efba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:46.760849 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da8d31-253b-4abf-abc4-f4713d7efba4 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:46.761133 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da8d31-253b-4abf-abc4-f4713d7efba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:46.761410 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da8d31-253b-4abf-abc4-f4713d7efba4 None admin] PATH_INFO: `/v3/services` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:46.762123 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90da8d31-253b-4abf-abc4-f4713d7efba4 None admin] RBAC: Adding query filter params (name=network) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:46.762427 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90da8d31-253b-4abf-abc4-f4713d7efba4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:46.763846 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90da8d31-253b-4abf-abc4-f4713d7efba4 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:46.769643 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 367/718] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Jun 3 11:45:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:46.774843 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c02ec63-5213-4682-8791-3c147715e053 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:46.935293 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c02ec63-5213-4682-8791-3c147715e053 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:46.985342 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce276c-c8a9-4ea2-a648-ac1134e04153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:46.985959 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce276c-c8a9-4ea2-a648-ac1134e04153 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:46.986246 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce276c-c8a9-4ea2-a648-ac1134e04153 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:46.986526 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce276c-c8a9-4ea2-a648-ac1134e04153 None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:46.987238 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce276c-c8a9-4ea2-a648-ac1134e04153 None admin] RBAC: Adding query filter params (type=network) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:46.987568 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce276c-c8a9-4ea2-a648-ac1134e04153 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:46.989021 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce276c-c8a9-4ea2-a648-ac1134e04153 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:47.000590 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 352/719] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Jun 3 11:45:46 2022] GET /identity/v3/services?type=network => generated 124 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:48.421449 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97052929-aea3-4e9f-b1e9-3557df2aea31 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:48.421973 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97052929-aea3-4e9f-b1e9-3557df2aea31 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:48.421973 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97052929-aea3-4e9f-b1e9-3557df2aea31 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:48.424165 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 368/720] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:45:48.429729 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f17e3-f1f8-4a2a-b263-d6a61da3f79c None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:48.430145 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f17e3-f1f8-4a2a-b263-d6a61da3f79c None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:48.430317 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f17e3-f1f8-4a2a-b263-d6a61da3f79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:48.447463 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-8a0f17e3-f1f8-4a2a-b263-d6a61da3f79c None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:48.448839 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-8a0f17e3-f1f8-4a2a-b263-d6a61da3f79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:48.473937 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:48.520602 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 353/721] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 03 11:45:48.544659 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97052929-aea3-4e9f-b1e9-3557df2aea31 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:48.556594 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:48.635765 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5afa1-7d85-4719-b4d6-33b002654ce0 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:48.636425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5afa1-7d85-4719-b4d6-33b002654ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:48.637024 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5afa1-7d85-4719-b4d6-33b002654ce0 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:48.638922 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 354/722] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 11:45:48.643646 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e413ad7-3152-47f6-8ddd-36606045ddca None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:48.644162 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e413ad7-3152-47f6-8ddd-36606045ddca None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:48.644666 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e413ad7-3152-47f6-8ddd-36606045ddca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:48.678822 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97052929-aea3-4e9f-b1e9-3557df2aea31 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:48.680210 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-0e413ad7-3152-47f6-8ddd-36606045ddca None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:48.681873 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-0e413ad7-3152-47f6-8ddd-36606045ddca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:48.714417 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad8648-a87b-486c-bbbc-7b7bdeb84aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:48.715244 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad8648-a87b-486c-bbbc-7b7bdeb84aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:48.715811 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad8648-a87b-486c-bbbc-7b7bdeb84aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:48.716198 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad8648-a87b-486c-bbbc-7b7bdeb84aa9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:48.730673 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad8648-a87b-486c-bbbc-7b7bdeb84aa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:45:48.740104 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-b7ad8648-a87b-486c-bbbc-7b7bdeb84aa9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:45:48.740104 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:48.740104 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:48.740104 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:48.740104 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:48.740104 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:48.740104 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:48.740104 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:48.740104 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:48.740104 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:48.740104 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:48.740104 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:48.740104 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:45:48.740104 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:45:48.740104 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:45:48.740104 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:45:48.741258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:45:48.741258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:45:48.741258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:45:48.741258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:45:48.741258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:48.741258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:48.741258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:48.741258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:48.741258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:48.741258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:48.741258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:48.741258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:48.741258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:48.741258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:48.741258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:48.741258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:48.742292 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:48.742292 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:48.742292 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:48.742292 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:48.742292 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:45:48.742292 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:45:48.742292 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:45:48.742292 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:45:48.742292 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:45:48.742292 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:45:48.742292 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:45:48.742292 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:48.744441 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 369/723] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 3 11:45:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:48.750468 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad8648-a87b-486c-bbbc-7b7bdeb84aa9 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:48.826176 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 355/724] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:45:48.855856 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:48.862501 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e413ad7-3152-47f6-8ddd-36606045ddca None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:48.890355 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad8648-a87b-486c-bbbc-7b7bdeb84aa9 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:48.930859 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf94f6c-9450-4e80-94b5-8f7185c62d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:48.931666 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf94f6c-9450-4e80-94b5-8f7185c62d1b None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:48.932722 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf94f6c-9450-4e80-94b5-8f7185c62d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:48.933038 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf94f6c-9450-4e80-94b5-8f7185c62d1b None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:48.933795 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf94f6c-9450-4e80-94b5-8f7185c62d1b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:48.934113 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf94f6c-9450-4e80-94b5-8f7185c62d1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:48.935614 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf94f6c-9450-4e80-94b5-8f7185c62d1b None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:48.947586 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 370/725] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:45:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:48.949263 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74028dac-1d82-4f3c-935d-4ef9c01c83ce None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:48.949560 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74028dac-1d82-4f3c-935d-4ef9c01c83ce None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:48.949846 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74028dac-1d82-4f3c-935d-4ef9c01c83ce None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:48.951831 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 371/726] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:45:48.953774 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74028dac-1d82-4f3c-935d-4ef9c01c83ce None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:48.993426 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:49.005164 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e413ad7-3152-47f6-8ddd-36606045ddca None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:49.045832 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb1ae9-5313-44b4-aeb3-c3204fc672f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:49.047277 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb1ae9-5313-44b4-aeb3-c3204fc672f7 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:49.047590 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb1ae9-5313-44b4-aeb3-c3204fc672f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:49.047865 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb1ae9-5313-44b4-aeb3-c3204fc672f7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:49.061837 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acb1ae9-5313-44b4-aeb3-c3204fc672f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:45:49.072034 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-4acb1ae9-5313-44b4-aeb3-c3204fc672f7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 11:45:49.072034 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:49.072034 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:49.072034 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:49.072034 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:49.072034 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:49.072034 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:49.072034 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:49.072034 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:49.072034 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:49.072034 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:49.072034 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:49.072034 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:45:49.072034 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:45:49.072034 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:45:49.072034 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:45:49.072949 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:45:49.072949 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:45:49.072949 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:45:49.072949 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:45:49.072949 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:49.072949 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:49.072949 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:49.072949 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:49.072949 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:49.072949 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:49.072949 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:49.072949 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:49.072949 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:49.072949 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:49.072949 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:49.072949 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:49.073784 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:49.073784 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:49.073784 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:49.073784 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:49.073784 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:45:49.073784 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:45:49.073784 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:45:49.073784 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:45:49.073784 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:45:49.073784 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:45:49.073784 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 11:45:49.073784 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:49.074421 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 356/727] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Jun 3 11:45:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:45:49.075517 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71361e9-7b30-4189-9358-c3d5b65a10ba None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:49.075700 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71361e9-7b30-4189-9358-c3d5b65a10ba None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:49.076197 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71361e9-7b30-4189-9358-c3d5b65a10ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:49.088089 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74028dac-1d82-4f3c-935d-4ef9c01c83ce None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:49.100837 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-d71361e9-7b30-4189-9358-c3d5b65a10ba None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:49.102342 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-d71361e9-7b30-4189-9358-c3d5b65a10ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:49.117582 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:49.127197 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886f7da-3168-4219-b10d-f59f17c7d925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:49.128577 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886f7da-3168-4219-b10d-f59f17c7d925 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:49.128939 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886f7da-3168-4219-b10d-f59f17c7d925 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:49.129421 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886f7da-3168-4219-b10d-f59f17c7d925 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:49.142946 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d886f7da-3168-4219-b10d-f59f17c7d925 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:49.144707 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d886f7da-3168-4219-b10d-f59f17c7d925 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:49.166660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-d886f7da-3168-4219-b10d-f59f17c7d925 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:49.166660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:49.166660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:49.166660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:49.166660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:49.166660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:49.166660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:49.166660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:49.166660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:49.166660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:49.166660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:49.166660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:49.166660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:49.166660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:49.166660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:49.168768 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:49.168768 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:49.168768 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:49.168768 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:49.168768 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:49.168768 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:49.168768 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:49.168768 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:49.168768 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:49.168768 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:49.168768 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:49.168768 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:49.168768 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:49.168768 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:49.168768 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:49.168768 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:49.168768 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:49.170818 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:49.170818 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:49.170818 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:49.170818 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:49.170818 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 372/728] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:45:49.170818 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886f7da-3168-4219-b10d-f59f17c7d925 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:49.181107 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 357/729] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:45:49.184380 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71361e9-7b30-4189-9358-c3d5b65a10ba None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:49.300702 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:49.310862 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886f7da-3168-4219-b10d-f59f17c7d925 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:49.326894 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71361e9-7b30-4189-9358-c3d5b65a10ba None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:49.349345 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e33d3b-21f9-417b-9ad9-1d282685543e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:49.350162 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e33d3b-21f9-417b-9ad9-1d282685543e None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:49.350553 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e33d3b-21f9-417b-9ad9-1d282685543e None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:49.350927 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e33d3b-21f9-417b-9ad9-1d282685543e None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:49.351816 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e33d3b-21f9-417b-9ad9-1d282685543e None admin] RBAC: Adding query filter params (name=service) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:49.352316 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e33d3b-21f9-417b-9ad9-1d282685543e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:49.353819 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e33d3b-21f9-417b-9ad9-1d282685543e None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:49.364292 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 373/730] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Jun 3 11:45:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:49.365367 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e33d3b-21f9-417b-9ad9-1d282685543e None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:49.368656 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f2d70-ed9e-46cb-a0b3-f0d171dc464d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:49.370365 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f2d70-ed9e-46cb-a0b3-f0d171dc464d None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:49.370720 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f2d70-ed9e-46cb-a0b3-f0d171dc464d None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:49.371064 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f2d70-ed9e-46cb-a0b3-f0d171dc464d None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:49.371892 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f2d70-ed9e-46cb-a0b3-f0d171dc464d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:49.372266 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f2d70-ed9e-46cb-a0b3-f0d171dc464d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:49.373703 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f2d70-ed9e-46cb-a0b3-f0d171dc464d None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:49.388908 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 358/731] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:49.390300 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f2d70-ed9e-46cb-a0b3-f0d171dc464d None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:49.413195 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:49.475685 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e33d3b-21f9-417b-9ad9-1d282685543e None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:49.494263 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f2d70-ed9e-46cb-a0b3-f0d171dc464d None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:49.511445 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01efeda-abd9-471f-b9f4-1c03c83d78b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:49.512273 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01efeda-abd9-471f-b9f4-1c03c83d78b9 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:49.512559 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01efeda-abd9-471f-b9f4-1c03c83d78b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:49.512833 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01efeda-abd9-471f-b9f4-1c03c83d78b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:49.524354 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01efeda-abd9-471f-b9f4-1c03c83d78b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:45:49.527627 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af103f2e-2e5a-4cdb-a28c-f7c430462c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:49.528412 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af103f2e-2e5a-4cdb-a28c-f7c430462c87 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:49.528692 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af103f2e-2e5a-4cdb-a28c-f7c430462c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:49.528963 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af103f2e-2e5a-4cdb-a28c-f7c430462c87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:49.534076 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-b01efeda-abd9-471f-b9f4-1c03c83d78b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:45:49.534076 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:49.534076 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:49.534076 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:49.534076 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:49.534076 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:49.534076 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:49.534076 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:49.534076 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:49.534076 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:49.534076 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:49.534076 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:49.534076 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:45:49.534076 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:45:49.534076 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:45:49.534076 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:45:49.534995 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:45:49.534995 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:45:49.534995 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:45:49.534995 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:45:49.534995 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:49.534995 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:49.534995 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:49.534995 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:49.534995 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:49.534995 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:49.534995 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:49.534995 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:49.534995 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:49.534995 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:49.534995 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:49.534995 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:49.536509 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:49.536509 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:49.536509 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:49.536509 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:49.536509 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:45:49.536509 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:45:49.536509 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:45:49.536509 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:45:49.536509 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:45:49.536509 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:45:49.536509 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:45:49.536509 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:49.536509 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 374/732] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 3 11:45:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:49.537262 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df89d5-b3c2-44c6-8900-d6a102591fbb None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:49.537262 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df89d5-b3c2-44c6-8900-d6a102591fbb None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:49.537590 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df89d5-b3c2-44c6-8900-d6a102591fbb None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:49.542290 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 375/733] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:45:49.542432 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:49.542545 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df89d5-b3c2-44c6-8900-d6a102591fbb None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:49.547917 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af103f2e-2e5a-4cdb-a28c-f7c430462c87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:49.549500 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af103f2e-2e5a-4cdb-a28c-f7c430462c87 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:49.567362 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-af103f2e-2e5a-4cdb-a28c-f7c430462c87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:49.567362 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:49.567362 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:49.567362 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:49.567362 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:49.567362 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:49.567362 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:49.567362 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:49.567362 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:49.567362 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:49.567362 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:49.567362 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:49.567362 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:49.567362 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:49.567362 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:49.568466 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:49.568466 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:49.568466 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:49.568466 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:49.568466 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:49.568466 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:49.568466 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:49.568466 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:49.568466 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:49.568466 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:49.568466 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:49.568466 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:49.568466 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:49.568466 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:49.568466 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:49.568466 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:49.568466 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:49.569373 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:49.569373 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:49.569373 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:49.569373 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:49.569373 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 359/734] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:49.569647 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af103f2e-2e5a-4cdb-a28c-f7c430462c87 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:49.659234 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df89d5-b3c2-44c6-8900-d6a102591fbb None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:49.661309 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:49.680588 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af103f2e-2e5a-4cdb-a28c-f7c430462c87 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:49.700171 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff31454-2b54-4c46-8450-5032d59568ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:49.701217 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff31454-2b54-4c46-8450-5032d59568ab None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:49.701502 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff31454-2b54-4c46-8450-5032d59568ab None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:49.701779 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff31454-2b54-4c46-8450-5032d59568ab None admin] PATH_INFO: `/v3/users/swift` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:49.709675 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff31454-2b54-4c46-8450-5032d59568ab None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:49.711124 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff31454-2b54-4c46-8450-5032d59568ab None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:49.717590 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbc35a-8805-4e43-b59f-bdf819b206cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:49.718290 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbc35a-8805-4e43-b59f-bdf819b206cc None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:49.718568 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbc35a-8805-4e43-b59f-bdf819b206cc None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:49.718837 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbc35a-8805-4e43-b59f-bdf819b206cc None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:49.719699 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fbc35a-8805-4e43-b59f-bdf819b206cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:49.720006 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fbc35a-8805-4e43-b59f-bdf819b206cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:49.721433 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fbc35a-8805-4e43-b59f-bdf819b206cc None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:49.725407 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-fff31454-2b54-4c46-8450-5032d59568ab None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 03 11:45:49.725407 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:49.725407 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:49.725407 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:49.725407 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:49.725407 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:49.725407 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:49.725407 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:49.725407 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:49.725407 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:49.725407 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:49.725407 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:49.725407 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 11:45:49.725407 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 11:45:49.725407 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 11:45:49.725407 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 11:45:49.726348 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:49.726348 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:49.726348 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 11:45:49.726348 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:45:49.726348 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 11:45:49.726348 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:45:49.726348 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:49.726348 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:49.726348 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:49.726348 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:49.726348 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:49.726348 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:49.726348 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:49.726348 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:49.726348 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:49.726348 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:49.726348 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:49.726348 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:49.727314 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:49.727314 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:49.727314 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 11:45:49.727314 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 11:45:49.727314 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 11:45:49.727314 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 11:45:49.727314 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 11:45:49.727314 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 11:45:49.727314 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 03 11:45:49.727314 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:49.727314 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 376/735] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 3 11:45:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:49.728856 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2006f73-cb7e-4681-bd8d-def2e629afcd None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:49.728856 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2006f73-cb7e-4681-bd8d-def2e629afcd None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:49.728856 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2006f73-cb7e-4681-bd8d-def2e629afcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:49.734569 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 360/736] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:45:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:49.740255 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbc35a-8805-4e43-b59f-bdf819b206cc None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:49.747304 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-a2006f73-cb7e-4681-bd8d-def2e629afcd None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:49.748624 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-a2006f73-cb7e-4681-bd8d-def2e629afcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:49.799803 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:49.819112 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 377/737] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:45:49.823348 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2006f73-cb7e-4681-bd8d-def2e629afcd None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:49.849051 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbc35a-8805-4e43-b59f-bdf819b206cc None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:49.887003 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae09832-6c3e-4960-9c79-9ca151d26c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:49.887702 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae09832-6c3e-4960-9c79-9ca151d26c2c None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:49.887981 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae09832-6c3e-4960-9c79-9ca151d26c2c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:49.888254 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae09832-6c3e-4960-9c79-9ca151d26c2c None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:49.888965 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae09832-6c3e-4960-9c79-9ca151d26c2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:49.889283 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae09832-6c3e-4960-9c79-9ca151d26c2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:49.893667 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae09832-6c3e-4960-9c79-9ca151d26c2c None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:49.911567 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 361/738] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:49.912432 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae09832-6c3e-4960-9c79-9ca151d26c2c None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:49.932306 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:49.941498 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2006f73-cb7e-4681-bd8d-def2e629afcd None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:49.975059 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3befb-c3c3-4594-8f87-6b1ec50ffc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:49.975757 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3befb-c3c3-4594-8f87-6b1ec50ffc93 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:49.976042 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3befb-c3c3-4594-8f87-6b1ec50ffc93 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:49.976317 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3befb-c3c3-4594-8f87-6b1ec50ffc93 None admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:49.977271 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f3befb-c3c3-4594-8f87-6b1ec50ffc93 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:49.977541 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f3befb-c3c3-4594-8f87-6b1ec50ffc93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:49.978967 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f3befb-c3c3-4594-8f87-6b1ec50ffc93 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:49.996175 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 378/739] 10.222.0.15 () {56 vars in 1135 bytes} [Fri Jun 3 11:45:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:49.997023 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3befb-c3c3-4594-8f87-6b1ec50ffc93 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:50.016887 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae09832-6c3e-4960-9c79-9ca151d26c2c None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:50.030792 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:50.052881 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b7154-7fcb-4eef-b76c-372edc4ca36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:50.053655 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b7154-7fcb-4eef-b76c-372edc4ca36c None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:50.053930 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b7154-7fcb-4eef-b76c-372edc4ca36c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:50.054202 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b7154-7fcb-4eef-b76c-372edc4ca36c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:50.064361 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b7154-7fcb-4eef-b76c-372edc4ca36c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:50.065818 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b7154-7fcb-4eef-b76c-372edc4ca36c None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:50.082818 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-ac1b7154-7fcb-4eef-b76c-372edc4ca36c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:50.082818 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:50.082818 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:50.082818 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:50.082818 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:50.082818 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:50.082818 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:50.082818 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:50.082818 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:50.082818 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:50.082818 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:50.082818 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:50.082818 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:50.082818 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:50.082818 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:50.083751 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:50.083751 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:50.083751 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:50.083751 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:50.083751 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:50.083751 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:50.083751 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:50.083751 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:50.083751 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:50.083751 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:50.083751 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:50.083751 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:50.083751 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:50.083751 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:50.083751 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:50.083751 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:50.083751 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:50.084679 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:50.084679 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:50.084679 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:50.084679 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:50.084679 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 362/740] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:50.084966 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b7154-7fcb-4eef-b76c-372edc4ca36c None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:50.098237 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3befb-c3c3-4594-8f87-6b1ec50ffc93 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:50.132843 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ad3be-305b-4d2e-9bdd-09c9089f748a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:50.133488 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ad3be-305b-4d2e-9bdd-09c9089f748a None admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:50.133764 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ad3be-305b-4d2e-9bdd-09c9089f748a None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:50.134034 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ad3be-305b-4d2e-9bdd-09c9089f748a None admin] PATH_INFO: `/v3/services` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:50.134738 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ad3be-305b-4d2e-9bdd-09c9089f748a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:50.136151 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ad3be-305b-4d2e-9bdd-09c9089f748a None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:50.161543 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 379/741] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Jun 3 11:45:49 2022] POST /identity/v3/services => generated 251 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:45:50.161543 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b29bc8-0df1-4518-8680-44a9f8806757 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:50.161543 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b29bc8-0df1-4518-8680-44a9f8806757 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:50.161543 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b29bc8-0df1-4518-8680-44a9f8806757 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:50.161543 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 380/742] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:45:50.161543 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b29bc8-0df1-4518-8680-44a9f8806757 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:50.169261 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:50.203465 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b7154-7fcb-4eef-b76c-372edc4ca36c None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:50.260213 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4631b092-cc83-4964-a2e0-01d6137ec949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:50.261503 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631b092-cc83-4964-a2e0-01d6137ec949 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:50.261963 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631b092-cc83-4964-a2e0-01d6137ec949 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:50.262766 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631b092-cc83-4964-a2e0-01d6137ec949 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:50.272554 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b29bc8-0df1-4518-8680-44a9f8806757 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:50.273913 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4631b092-cc83-4964-a2e0-01d6137ec949 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:50.276735 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4631b092-cc83-4964-a2e0-01d6137ec949 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:50.293205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-4631b092-cc83-4964-a2e0-01d6137ec949 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 11:45:50.293205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:50.293205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:50.293205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:50.293205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:50.293205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:50.293205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:50.293205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:50.293205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:50.293205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:50.293205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:50.293205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:50.293205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 11:45:50.293205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 11:45:50.293205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 11:45:50.293205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 11:45:50.294257 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:50.294257 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:50.294257 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 11:45:50.294257 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:45:50.294257 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 11:45:50.294257 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:45:50.294257 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:50.294257 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:50.294257 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:50.294257 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:50.294257 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:50.294257 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:50.294257 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:50.294257 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:50.294257 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:50.294257 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:50.294257 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:50.294257 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:50.295224 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:50.295224 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:50.295224 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 11:45:50.295224 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 11:45:50.295224 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 11:45:50.295224 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 11:45:50.295224 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 11:45:50.295224 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 11:45:50.295224 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 11:45:50.295224 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:50.295224 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 363/743] 10.222.0.15 () {56 vars in 1117 bytes} [Fri Jun 3 11:45:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:50.295870 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4631b092-cc83-4964-a2e0-01d6137ec949 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:50.322506 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5669fe-cc29-45de-b441-8c2b4d297c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:50.323229 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:50.323623 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5669fe-cc29-45de-b441-8c2b4d297c98 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:50.324355 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5669fe-cc29-45de-b441-8c2b4d297c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:50.324785 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5669fe-cc29-45de-b441-8c2b4d297c98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:50.402567 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5669fe-cc29-45de-b441-8c2b4d297c98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:50.404073 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5669fe-cc29-45de-b441-8c2b4d297c98 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:50.407953 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4631b092-cc83-4964-a2e0-01d6137ec949 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:50.415552 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:50.444750 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b4f7e-82d3-4a49-9f85-6f7d07e10369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:50.445577 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b4f7e-82d3-4a49-9f85-6f7d07e10369 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:50.445931 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b4f7e-82d3-4a49-9f85-6f7d07e10369 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:50.446275 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b4f7e-82d3-4a49-9f85-6f7d07e10369 None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:50.447096 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b4f7e-82d3-4a49-9f85-6f7d07e10369 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:50.447469 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b4f7e-82d3-4a49-9f85-6f7d07e10369 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:50.448989 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b4f7e-82d3-4a49-9f85-6f7d07e10369 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:50.461216 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 364/744] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:50.462525 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc72b77-7a8b-4d98-9a8b-db0308b14b08 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:50.462875 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc72b77-7a8b-4d98-9a8b-db0308b14b08 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:50.463211 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc72b77-7a8b-4d98-9a8b-db0308b14b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:50.480546 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-cbc72b77-7a8b-4d98-9a8b-db0308b14b08 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:50.481827 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-cbc72b77-7a8b-4d98-9a8b-db0308b14b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:50.518970 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 381/745] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:45:50 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 03 11:45:50.519819 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5669fe-cc29-45de-b441-8c2b4d297c98 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:50.555823 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 365/746] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:50 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 03 11:45:50.556680 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc72b77-7a8b-4d98-9a8b-db0308b14b08 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:50.571470 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:50.643713 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5669fe-cc29-45de-b441-8c2b4d297c98 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:50.656415 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:50.665602 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc72b77-7a8b-4d98-9a8b-db0308b14b08 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:50.682380 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ebc91-2217-42d0-aeeb-26a88b1eaf3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:50.683226 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ebc91-2217-42d0-aeeb-26a88b1eaf3c None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:50.683694 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ebc91-2217-42d0-aeeb-26a88b1eaf3c None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:50.684018 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ebc91-2217-42d0-aeeb-26a88b1eaf3c None admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:50.684860 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430ebc91-2217-42d0-aeeb-26a88b1eaf3c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:50.685171 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430ebc91-2217-42d0-aeeb-26a88b1eaf3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:50.686602 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430ebc91-2217-42d0-aeeb-26a88b1eaf3c None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:50.704924 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326eb7d0-e1aa-4623-9db3-1068be0d2a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:50.709653 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 382/747] 10.222.0.15 () {56 vars in 1149 bytes} [Fri Jun 3 11:45:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:50.709804 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326eb7d0-e1aa-4623-9db3-1068be0d2a4a None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:50.709804 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326eb7d0-e1aa-4623-9db3-1068be0d2a4a None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:50.709804 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326eb7d0-e1aa-4623-9db3-1068be0d2a4a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:50.710060 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ebc91-2217-42d0-aeeb-26a88b1eaf3c None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:50.717349 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326eb7d0-e1aa-4623-9db3-1068be0d2a4a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:50.718885 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326eb7d0-e1aa-4623-9db3-1068be0d2a4a None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:50.733748 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-326eb7d0-e1aa-4623-9db3-1068be0d2a4a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 11:45:50.733748 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:50.733748 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:50.733748 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:50.733748 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:50.733748 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:50.733748 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:50.733748 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:50.733748 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:50.733748 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:50.733748 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:50.733748 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:50.733748 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 11:45:50.733748 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 11:45:50.733748 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 11:45:50.733748 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 11:45:50.734932 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:50.734932 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:50.734932 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 11:45:50.734932 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:45:50.734932 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 11:45:50.734932 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:45:50.734932 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:50.734932 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:50.734932 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:50.734932 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:50.734932 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:50.734932 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:50.734932 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:50.734932 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:50.734932 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:50.734932 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:50.734932 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:50.734932 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:50.736883 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:50.736883 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:50.736883 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 11:45:50.736883 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 11:45:50.736883 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 11:45:50.736883 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 11:45:50.736883 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 11:45:50.736883 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 11:45:50.736883 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 11:45:50.736883 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:50.736883 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 366/748] 10.222.0.15 () {56 vars in 1093 bytes} [Fri Jun 3 11:45:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:50.736883 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326eb7d0-e1aa-4623-9db3-1068be0d2a4a None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:50.821056 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ebc91-2217-42d0-aeeb-26a88b1eaf3c None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:50.822365 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:50.855701 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326eb7d0-e1aa-4623-9db3-1068be0d2a4a None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:50.855943 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c961c-6654-485c-859f-752c98e47312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:50.856839 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c961c-6654-485c-859f-752c98e47312 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:50.857203 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c961c-6654-485c-859f-752c98e47312 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:50.857559 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c961c-6654-485c-859f-752c98e47312 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:50.868089 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c961c-6654-485c-859f-752c98e47312 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:50.869642 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c961c-6654-485c-859f-752c98e47312 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:50.887587 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-2f6c961c-6654-485c-859f-752c98e47312 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:50.887587 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:50.887587 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:50.887587 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:50.887587 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:50.887587 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:50.887587 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:50.887587 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:50.887587 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:50.887587 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:50.887587 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:50.887587 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:50.887587 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:50.887587 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:50.887587 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:50.888660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:50.888660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:50.888660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:50.888660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:50.888660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:50.888660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:50.888660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:50.888660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:50.888660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:50.888660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:50.888660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:50.888660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:50.888660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:50.888660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:50.888660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:50.888660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:50.888660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:50.889745 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:50.889745 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:50.889745 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:50.889745 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:50.893766 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 383/749] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:50.893766 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c961c-6654-485c-859f-752c98e47312 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:50.896392 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba8bb2-5192-4df5-bfed-05b810d83f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:50.897461 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba8bb2-5192-4df5-bfed-05b810d83f46 None admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:50.897461 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba8bb2-5192-4df5-bfed-05b810d83f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:50.897668 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba8bb2-5192-4df5-bfed-05b810d83f46 None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:50.898843 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba8bb2-5192-4df5-bfed-05b810d83f46 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:50.899898 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba8bb2-5192-4df5-bfed-05b810d83f46 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:50.916896 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 367/750] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Jun 3 11:45:50 2022] POST /identity/v3/services => generated 240 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:45:50.920461 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba8bb2-5192-4df5-bfed-05b810d83f46 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:50.921850 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:51.028497 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c961c-6654-485c-859f-752c98e47312 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:51.058941 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba8bb2-5192-4df5-bfed-05b810d83f46 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:51.069533 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe5fec-e377-4f79-9555-e7de92141b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:51.070597 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe5fec-e377-4f79-9555-e7de92141b76 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:51.071197 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe5fec-e377-4f79-9555-e7de92141b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:51.071729 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe5fec-e377-4f79-9555-e7de92141b76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:51.090570 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:51.099434 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4bd21-9907-44a9-96c1-f5de2db0e569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:51.099899 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4bd21-9907-44a9-96c1-f5de2db0e569 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:51.100547 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4bd21-9907-44a9-96c1-f5de2db0e569 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:51.101144 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4bd21-9907-44a9-96c1-f5de2db0e569 None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:51.102244 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4bd21-9907-44a9-96c1-f5de2db0e569 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:51.103117 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4bd21-9907-44a9-96c1-f5de2db0e569 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:51.105098 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4bd21-9907-44a9-96c1-f5de2db0e569 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:51.127591 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 368/751] 10.222.0.15 () {56 vars in 1133 bytes} [Fri Jun 3 11:45:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:51.128911 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4bd21-9907-44a9-96c1-f5de2db0e569 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:51.157525 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe5fec-e377-4f79-9555-e7de92141b76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:51.159051 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe5fec-e377-4f79-9555-e7de92141b76 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:51.184744 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:51.269971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4bd21-9907-44a9-96c1-f5de2db0e569 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:51.279099 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 384/752] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:45:50 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 11:45:51.280244 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe5fec-e377-4f79-9555-e7de92141b76 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:51.315659 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b880760e-ce00-4182-9597-15c68088572c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:51.316624 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880760e-ce00-4182-9597-15c68088572c None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:51.317337 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880760e-ce00-4182-9597-15c68088572c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:51.317622 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880760e-ce00-4182-9597-15c68088572c None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:51.318629 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b880760e-ce00-4182-9597-15c68088572c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:51.318938 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b880760e-ce00-4182-9597-15c68088572c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:51.321366 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b880760e-ce00-4182-9597-15c68088572c None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:51.337134 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 369/753] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:51.338006 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b880760e-ce00-4182-9597-15c68088572c None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:51.389376 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:51.406770 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe5fec-e377-4f79-9555-e7de92141b76 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:51.430013 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:51.445977 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96b6d9-184d-443c-a55f-d8f6c1ee1e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:51.446309 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b880760e-ce00-4182-9597-15c68088572c None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:51.446777 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96b6d9-184d-443c-a55f-d8f6c1ee1e15 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:51.447057 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96b6d9-184d-443c-a55f-d8f6c1ee1e15 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:51.447326 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96b6d9-184d-443c-a55f-d8f6c1ee1e15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:51.458740 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b96b6d9-184d-443c-a55f-d8f6c1ee1e15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:51.460431 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b96b6d9-184d-443c-a55f-d8f6c1ee1e15 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:51.480887 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-3b96b6d9-184d-443c-a55f-d8f6c1ee1e15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:51.480887 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:51.480887 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:51.480887 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:51.480887 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:51.480887 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:51.480887 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:51.480887 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:51.480887 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:51.480887 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:51.480887 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:51.480887 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:51.480887 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:51.480887 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:51.480887 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:51.481994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:51.481994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:51.481994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:51.481994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:51.481994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:51.481994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:51.481994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:51.481994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:51.481994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:51.481994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:51.481994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:51.481994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:51.481994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:51.481994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:51.481994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:51.481994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:51.481994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:51.483094 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:51.483094 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:51.483094 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:51.483094 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:51.483362 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea98824-c2ab-41b7-ad34-f6ab5916174a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:51.483474 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 385/754] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:51.483474 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96b6d9-184d-443c-a55f-d8f6c1ee1e15 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:51.488681 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea98824-c2ab-41b7-ad34-f6ab5916174a None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:51.488681 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea98824-c2ab-41b7-ad34-f6ab5916174a None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:51.488681 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea98824-c2ab-41b7-ad34-f6ab5916174a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:51.497662 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea98824-c2ab-41b7-ad34-f6ab5916174a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:51.499227 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea98824-c2ab-41b7-ad34-f6ab5916174a None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:51.516637 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-1ea98824-c2ab-41b7-ad34-f6ab5916174a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:51.516637 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:51.516637 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:51.516637 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:51.516637 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:51.516637 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:51.516637 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:51.516637 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:51.516637 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:51.516637 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:51.516637 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:51.516637 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:51.516637 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:51.516637 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:51.516637 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:51.518447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:51.518447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:51.518447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:51.518447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:51.518447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:51.518447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:51.518447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:51.518447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:51.518447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:51.518447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:51.518447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:51.518447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:51.518447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:51.518447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:51.518447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:51.518447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:51.518447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:51.520174 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:51.520174 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:51.520174 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:51.520174 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:51.523636 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 370/755] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:51.524357 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea98824-c2ab-41b7-ad34-f6ab5916174a None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:51.592694 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96b6d9-184d-443c-a55f-d8f6c1ee1e15 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:51.625063 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:51.628966 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea98824-c2ab-41b7-ad34-f6ab5916174a None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:51.631374 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe2e16a-2d27-4fd4-bb74-9447c9188c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:51.632315 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2e16a-2d27-4fd4-bb74-9447c9188c38 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:51.632597 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2e16a-2d27-4fd4-bb74-9447c9188c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:51.632878 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2e16a-2d27-4fd4-bb74-9447c9188c38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:51.641095 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe2e16a-2d27-4fd4-bb74-9447c9188c38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:51.642618 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe2e16a-2d27-4fd4-bb74-9447c9188c38 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:51.658266 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-1fe2e16a-2d27-4fd4-bb74-9447c9188c38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:45:51.658266 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:51.658266 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:51.658266 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:51.658266 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:51.658266 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:51.658266 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:51.658266 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:51.658266 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:51.658266 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:51.658266 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:51.658266 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:51.658266 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 11:45:51.658266 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 11:45:51.658266 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 11:45:51.660379 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 11:45:51.660379 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:51.660379 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:51.660379 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:51.660379 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:51.660379 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:51.660379 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:51.660379 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:51.660379 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:51.660379 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:51.660379 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:51.660379 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:51.660379 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:51.660379 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:51.660379 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:51.660379 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:51.660379 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:51.662588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 11:45:51.662588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 11:45:51.662588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 11:45:51.662588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 11:45:51.662588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 11:45:51.662588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 11:45:51.662588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:45:51.662588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:51.662588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 386/756] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:45:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:51.662588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe2e16a-2d27-4fd4-bb74-9447c9188c38 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:51.670067 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557d49e-d310-44f4-8d15-596674976914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:51.670744 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557d49e-d310-44f4-8d15-596674976914 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:51.671028 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557d49e-d310-44f4-8d15-596674976914 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:51.671305 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557d49e-d310-44f4-8d15-596674976914 None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:51.672066 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1557d49e-d310-44f4-8d15-596674976914 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:51.672375 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1557d49e-d310-44f4-8d15-596674976914 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:51.674436 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1557d49e-d310-44f4-8d15-596674976914 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:51.687433 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 371/757] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:51.688428 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557d49e-d310-44f4-8d15-596674976914 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:51.695925 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:51.771155 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe2e16a-2d27-4fd4-bb74-9447c9188c38 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:51.794067 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557d49e-d310-44f4-8d15-596674976914 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:51.807749 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182fd1c6-c89f-45c5-8328-4a3ab207ac7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:51.808535 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182fd1c6-c89f-45c5-8328-4a3ab207ac7e None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:51.808822 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182fd1c6-c89f-45c5-8328-4a3ab207ac7e None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:51.809099 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182fd1c6-c89f-45c5-8328-4a3ab207ac7e None admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:51.809824 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182fd1c6-c89f-45c5-8328-4a3ab207ac7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:51.810131 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182fd1c6-c89f-45c5-8328-4a3ab207ac7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:51.811646 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182fd1c6-c89f-45c5-8328-4a3ab207ac7e None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:51.830394 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 387/758] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:51.831534 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182fd1c6-c89f-45c5-8328-4a3ab207ac7e None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:51.833144 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b6403-684a-4264-be3a-01c7918c9fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:51.833921 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b6403-684a-4264-be3a-01c7918c9fec None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:51.834211 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b6403-684a-4264-be3a-01c7918c9fec None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:51.834492 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b6403-684a-4264-be3a-01c7918c9fec None admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:51.835287 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b6403-684a-4264-be3a-01c7918c9fec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:51.835644 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b6403-684a-4264-be3a-01c7918c9fec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:51.837150 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b6403-684a-4264-be3a-01c7918c9fec None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:51.855995 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 372/759] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 3 11:45:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:51.856811 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b6403-684a-4264-be3a-01c7918c9fec None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:51.876453 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:51.951118 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182fd1c6-c89f-45c5-8328-4a3ab207ac7e None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:51.959837 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:51.962064 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b6403-684a-4264-be3a-01c7918c9fec None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:51.989629 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c965a-c14b-4197-90c4-b026f28a5690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:51.990812 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c965a-c14b-4197-90c4-b026f28a5690 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:51.991242 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c965a-c14b-4197-90c4-b026f28a5690 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:51.991736 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c965a-c14b-4197-90c4-b026f28a5690 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:51.998387 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864592a6-32a7-44c7-a620-8076fc5e2299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:51.999152 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864592a6-32a7-44c7-a620-8076fc5e2299 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:51.999440 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864592a6-32a7-44c7-a620-8076fc5e2299 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:51.999765 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864592a6-32a7-44c7-a620-8076fc5e2299 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:52.000104 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c965a-c14b-4197-90c4-b026f28a5690 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:52.002608 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c965a-c14b-4197-90c4-b026f28a5690 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:52.007492 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864592a6-32a7-44c7-a620-8076fc5e2299 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:52.008992 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864592a6-32a7-44c7-a620-8076fc5e2299 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:52.017704 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-bb1c965a-c14b-4197-90c4-b026f28a5690 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:45:52.017704 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:52.017704 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:52.017704 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:52.017704 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:52.017704 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:52.017704 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:52.017704 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:52.017704 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:52.017704 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:52.017704 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:52.017704 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:52.017704 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 11:45:52.017704 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 11:45:52.017704 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 11:45:52.018764 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 11:45:52.018764 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:52.018764 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:52.018764 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:52.018764 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:52.018764 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:52.018764 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:52.018764 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:52.018764 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:52.018764 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:52.018764 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:52.018764 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:52.018764 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:52.018764 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:52.018764 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:52.018764 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:52.018764 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:52.019872 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 11:45:52.019872 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 11:45:52.019872 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 11:45:52.019872 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 11:45:52.019872 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 11:45:52.019872 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 11:45:52.019872 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:45:52.019872 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:52.021842 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 388/760] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:45:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:52.022933 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c965a-c14b-4197-90c4-b026f28a5690 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:52.023043 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-864592a6-32a7-44c7-a620-8076fc5e2299 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:45:52.023043 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:52.023043 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:52.023043 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:52.023043 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:52.023043 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:52.023043 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:52.023043 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:52.023043 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:52.023043 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:52.023043 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:52.023043 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:52.023043 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 11:45:52.023043 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 11:45:52.023043 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 11:45:52.023886 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 11:45:52.023886 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:52.023886 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:52.023886 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:52.023886 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:52.023886 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:52.023886 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:52.023886 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:52.023886 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:52.023886 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:52.023886 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:52.023886 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:52.023886 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:52.023886 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:52.023886 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:52.023886 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:52.023886 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:52.024812 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 11:45:52.024812 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 11:45:52.024812 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 11:45:52.024812 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 11:45:52.024812 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 11:45:52.024812 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 11:45:52.024812 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:45:52.024812 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:52.029062 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 373/761] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:45:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:52.030556 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864592a6-32a7-44c7-a620-8076fc5e2299 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:52.113696 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:52.138700 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864592a6-32a7-44c7-a620-8076fc5e2299 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:52.141885 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c965a-c14b-4197-90c4-b026f28a5690 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:52.176978 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06b923-1608-4102-a087-4052b3087a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:52.177809 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06b923-1608-4102-a087-4052b3087a2c None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:52.178393 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06b923-1608-4102-a087-4052b3087a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:52.178694 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06b923-1608-4102-a087-4052b3087a2c None admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:52.179793 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa06b923-1608-4102-a087-4052b3087a2c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:52.180112 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa06b923-1608-4102-a087-4052b3087a2c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:52.182429 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa06b923-1608-4102-a087-4052b3087a2c None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:52.186309 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69360bc8-d5bf-4384-9e42-674cb5a80b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:52.186965 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69360bc8-d5bf-4384-9e42-674cb5a80b65 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:52.187245 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69360bc8-d5bf-4384-9e42-674cb5a80b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:52.187539 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69360bc8-d5bf-4384-9e42-674cb5a80b65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:52.188370 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69360bc8-d5bf-4384-9e42-674cb5a80b65 None admin] RBAC: Adding query filter params (role.id=c486e164840b41a59fd118dece2ce572, scope.project.id=cff223ee05524cf4bf3591fc5a39559e, user.id=5f52901fe535420bb0019272d4eafe72) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:52.188681 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69360bc8-d5bf-4384-9e42-674cb5a80b65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:52.190783 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69360bc8-d5bf-4384-9e42-674cb5a80b65 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:52.196422 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 374/762] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 3 11:45:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:52.197277 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 389/763] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:45:52 2022] GET /identity/v3/role_assignments?user.id=5f52901fe535420bb0019272d4eafe72&scope.project.id=cff223ee05524cf4bf3591fc5a39559e&role.id=c486e164840b41a59fd118dece2ce572 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:52.201197 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06b923-1608-4102-a087-4052b3087a2c None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:52.202382 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69360bc8-d5bf-4384-9e42-674cb5a80b65 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:52.224669 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:52.380917 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06b923-1608-4102-a087-4052b3087a2c None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:52.426787 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf2338-ff2e-45e8-ba9b-45d841ec65b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:52.427868 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf2338-ff2e-45e8-ba9b-45d841ec65b3 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:52.428384 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf2338-ff2e-45e8-ba9b-45d841ec65b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:52.428864 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf2338-ff2e-45e8-ba9b-45d841ec65b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:52.429873 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf2338-ff2e-45e8-ba9b-45d841ec65b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:52.430407 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf2338-ff2e-45e8-ba9b-45d841ec65b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:52.432211 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf2338-ff2e-45e8-ba9b-45d841ec65b3 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:52.443538 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69360bc8-d5bf-4384-9e42-674cb5a80b65 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:52.449083 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:52.458648 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 375/764] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 3 11:45:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:52.465330 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf2338-ff2e-45e8-ba9b-45d841ec65b3 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:52.479021 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ec84c-6cfc-4520-816c-1672a392a500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:52.480363 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ec84c-6cfc-4520-816c-1672a392a500 None admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:52.480653 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ec84c-6cfc-4520-816c-1672a392a500 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:52.481067 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ec84c-6cfc-4520-816c-1672a392a500 None admin] PATH_INFO: `/v3/projects/cff223ee05524cf4bf3591fc5a39559e/users/6247bfb7aebd45eeb97ba5933be44c6d/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:52.486254 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ec84c-6cfc-4520-816c-1672a392a500 None admin] RBAC: Authorizing `identity:create_grant(project_id=cff223ee05524cf4bf3591fc5a39559e, user_id=6247bfb7aebd45eeb97ba5933be44c6d, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:52.488300 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4ec84c-6cfc-4520-816c-1672a392a500 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:52.513286 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 390/765] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Jun 3 11:45:52 2022] PUT /identity/v3/projects/cff223ee05524cf4bf3591fc5a39559e/users/6247bfb7aebd45eeb97ba5933be44c6d/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:45:52.515664 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9c64c-baed-479c-81ad-d7d263f7f83f None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:52.516201 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9c64c-baed-479c-81ad-d7d263f7f83f None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:52.516780 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9c64c-baed-479c-81ad-d7d263f7f83f None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:52.519831 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 391/766] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:45:52.526238 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e60572-38b2-4afe-91dc-54c7ab5f51c8 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:52.526527 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e60572-38b2-4afe-91dc-54c7ab5f51c8 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:52.526808 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e60572-38b2-4afe-91dc-54c7ab5f51c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:52.545177 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-c9e60572-38b2-4afe-91dc-54c7ab5f51c8 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:52.546480 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-c9e60572-38b2-4afe-91dc-54c7ab5f51c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:52.615302 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf2338-ff2e-45e8-ba9b-45d841ec65b3 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:52.624204 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 392/767] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 11:45:52.654242 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e60572-38b2-4afe-91dc-54c7ab5f51c8 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:52.664063 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:52.680613 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d693013-ff58-4b4d-96e9-b31030b13319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:52.681367 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d693013-ff58-4b4d-96e9-b31030b13319 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:52.681797 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d693013-ff58-4b4d-96e9-b31030b13319 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:52.682119 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d693013-ff58-4b4d-96e9-b31030b13319 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:52.683094 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d693013-ff58-4b4d-96e9-b31030b13319 None admin] RBAC: Adding query filter params (role.id=41158ae54c7a437284af718034e9b354, scope.project.id=cff223ee05524cf4bf3591fc5a39559e, user.id=a55cbe88e78e4f3a82b8703a3b1804e5) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:52.684596 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d693013-ff58-4b4d-96e9-b31030b13319 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:52.686229 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d693013-ff58-4b4d-96e9-b31030b13319 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:52.703433 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 376/768] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:45:52 2022] GET /identity/v3/role_assignments?user.id=a55cbe88e78e4f3a82b8703a3b1804e5&scope.project.id=cff223ee05524cf4bf3591fc5a39559e&role.id=41158ae54c7a437284af718034e9b354 => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:52.779397 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e60572-38b2-4afe-91dc-54c7ab5f51c8 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:52.819889 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de231eba-9a0e-4e21-ad56-38dfec6fe5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:52.821149 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de231eba-9a0e-4e21-ad56-38dfec6fe5c5 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:52.821642 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de231eba-9a0e-4e21-ad56-38dfec6fe5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:52.822121 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de231eba-9a0e-4e21-ad56-38dfec6fe5c5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:52.823016 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de231eba-9a0e-4e21-ad56-38dfec6fe5c5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:52.824715 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de231eba-9a0e-4e21-ad56-38dfec6fe5c5 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:52.839009 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-de231eba-9a0e-4e21-ad56-38dfec6fe5c5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 11:45:52.839009 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:52.839009 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 11:45:52.839009 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 11:45:52.839009 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 11:45:52.839009 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 11:45:52.839009 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 11:45:52.839009 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:45:52.839009 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 11:45:52.839009 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:52.839009 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 11:45:52.839009 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:52.839009 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:52.839009 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:52.839009 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:52.839009 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:52.840156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:52.840156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:52.840156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:52.840156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:52.840156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:52.840156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:52.840156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:52.840156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 11:45:52.840156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 11:45:52.840156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 11:45:52.840156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 11:45:52.840156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:52.840156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:52.840156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:52.840156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:52.840156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:52.841214 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:52.841214 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:52.841214 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:52.841214 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:52.841214 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:52.841214 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:52.841214 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:52.841214 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:52.841214 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:52.841214 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:52.841214 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:52.841214 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 11:45:52.841214 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:45:52.841214 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 11:45:52.841214 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:52.844007 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 393/769] 10.222.0.15 () {56 vars in 1129 bytes} [Fri Jun 3 11:45:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:45:52.851170 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d693013-ff58-4b4d-96e9-b31030b13319 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:52.962136 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:53.011636 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d693013-ff58-4b4d-96e9-b31030b13319 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:53.047926 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af69169c-c6e4-4a50-8d8e-7980c0031c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:53.049333 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69169c-c6e4-4a50-8d8e-7980c0031c4d None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:53.049630 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69169c-c6e4-4a50-8d8e-7980c0031c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:53.049907 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69169c-c6e4-4a50-8d8e-7980c0031c4d None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:53.050615 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af69169c-c6e4-4a50-8d8e-7980c0031c4d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:53.050926 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af69169c-c6e4-4a50-8d8e-7980c0031c4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:53.052335 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af69169c-c6e4-4a50-8d8e-7980c0031c4d None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:53.057314 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 377/770] 10.222.0.15 () {56 vars in 1124 bytes} [Fri Jun 3 11:45:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:53.062780 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de231eba-9a0e-4e21-ad56-38dfec6fe5c5 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:53.136339 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:53.170256 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de231eba-9a0e-4e21-ad56-38dfec6fe5c5 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:53.205434 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29068ddc-e7c4-46c8-82f9-677f751a494a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:53.206116 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29068ddc-e7c4-46c8-82f9-677f751a494a None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:53.206397 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29068ddc-e7c4-46c8-82f9-677f751a494a None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:53.206671 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29068ddc-e7c4-46c8-82f9-677f751a494a None admin] PATH_INFO: `/v3/services` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:53.207385 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29068ddc-e7c4-46c8-82f9-677f751a494a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:53.207717 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29068ddc-e7c4-46c8-82f9-677f751a494a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:53.209102 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29068ddc-e7c4-46c8-82f9-677f751a494a None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:53.214570 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 394/771] 10.222.0.15 () {56 vars in 1124 bytes} [Fri Jun 3 11:45:53 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:53.220806 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af69169c-c6e4-4a50-8d8e-7980c0031c4d None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:53.331680 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af69169c-c6e4-4a50-8d8e-7980c0031c4d None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:53.357573 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:53.368298 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe9561-13a5-4865-b21a-2665da44cc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:53.369025 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe9561-13a5-4865-b21a-2665da44cc6c None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:53.369313 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe9561-13a5-4865-b21a-2665da44cc6c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:53.369594 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe9561-13a5-4865-b21a-2665da44cc6c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:53.370380 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe9561-13a5-4865-b21a-2665da44cc6c None admin] RBAC: Adding query filter params (interface=public, service_id=a37f99951ba84fd995c06da1f38647f0, region_id=RegionOne) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:53.370692 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe9561-13a5-4865-b21a-2665da44cc6c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:53.372081 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe9561-13a5-4865-b21a-2665da44cc6c None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:53.380713 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 378/772] 10.222.0.15 () {56 vars in 1251 bytes} [Fri Jun 3 11:45:53 2022] GET /identity/v3/endpoints?service_id=a37f99951ba84fd995c06da1f38647f0&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:53.385562 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22009b3-9174-4695-92ae-1f9c16565854 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:53.385849 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22009b3-9174-4695-92ae-1f9c16565854 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:53.386124 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22009b3-9174-4695-92ae-1f9c16565854 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:53.386232 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe9561-13a5-4865-b21a-2665da44cc6c None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:53.387729 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 395/773] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:45:53.392627 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d058df-0b30-4401-94ba-eacba7b700e6 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:53.392912 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d058df-0b30-4401-94ba-eacba7b700e6 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:53.393189 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d058df-0b30-4401-94ba-eacba7b700e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:53.410327 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-18d058df-0b30-4401-94ba-eacba7b700e6 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:53.411604 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-18d058df-0b30-4401-94ba-eacba7b700e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:53.491198 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 396/774] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 11:45:53.499073 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe9561-13a5-4865-b21a-2665da44cc6c None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:53.526799 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d058df-0b30-4401-94ba-eacba7b700e6 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:53.563457 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5c2a1-5906-48eb-b7e6-c30eadf33655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:53.565141 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5c2a1-5906-48eb-b7e6-c30eadf33655 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:53.565418 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5c2a1-5906-48eb-b7e6-c30eadf33655 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:53.566456 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5c2a1-5906-48eb-b7e6-c30eadf33655 None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:53.567139 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb5c2a1-5906-48eb-b7e6-c30eadf33655 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:53.568550 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb5c2a1-5906-48eb-b7e6-c30eadf33655 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:53.584694 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 379/775] 10.222.0.15 () {56 vars in 1087 bytes} [Fri Jun 3 11:45:53 2022] GET /identity/v3/services => generated 772 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:45:53.625687 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:53.687389 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d058df-0b30-4401-94ba-eacba7b700e6 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:53.727072 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60a300-940b-44e0-bb0f-cd75060fc916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:53.727931 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60a300-940b-44e0-bb0f-cd75060fc916 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:53.728217 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60a300-940b-44e0-bb0f-cd75060fc916 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:53.728495 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60a300-940b-44e0-bb0f-cd75060fc916 None admin] PATH_INFO: `/v3/services/network` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:53.729162 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac60a300-940b-44e0-bb0f-cd75060fc916 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:53.730575 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac60a300-940b-44e0-bb0f-cd75060fc916 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:53.743822 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-ac60a300-940b-44e0-bb0f-cd75060fc916 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 11:45:53.743822 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:53.743822 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 11:45:53.743822 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 11:45:53.743822 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 11:45:53.743822 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 11:45:53.743822 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 11:45:53.743822 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:45:53.743822 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 11:45:53.743822 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:53.743822 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 11:45:53.743822 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:53.743822 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:53.743822 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:53.743822 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:53.743822 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:53.743822 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:53.744851 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:53.744851 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:53.744851 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:53.744851 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:53.744851 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:53.744851 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:53.744851 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 11:45:53.744851 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 11:45:53.744851 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 11:45:53.744851 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 11:45:53.744851 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:53.744851 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:53.744851 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:53.744851 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:53.744851 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:53.744851 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:53.746199 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:53.746199 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:53.746199 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:53.746199 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:53.746199 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:53.746199 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:53.746199 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:53.746199 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:53.746199 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:53.746199 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:53.746199 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 11:45:53.746199 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:45:53.746199 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 11:45:53.746199 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:53.746199 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 397/776] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:45:53 2022] GET /identity/v3/services/network => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:53.750993 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5c2a1-5906-48eb-b7e6-c30eadf33655 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:53.873949 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:53.932465 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5c2a1-5906-48eb-b7e6-c30eadf33655 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:53.970008 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c346e81-c95c-4399-8b12-607ac69d5859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:53.971256 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c346e81-c95c-4399-8b12-607ac69d5859 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:53.971569 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c346e81-c95c-4399-8b12-607ac69d5859 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:53.971852 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c346e81-c95c-4399-8b12-607ac69d5859 None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:53.972558 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c346e81-c95c-4399-8b12-607ac69d5859 None admin] RBAC: Adding query filter params (name=network) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:53.972865 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c346e81-c95c-4399-8b12-607ac69d5859 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:53.974248 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c346e81-c95c-4399-8b12-607ac69d5859 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:53.979239 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 380/777] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Jun 3 11:45:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:53.986341 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60a300-940b-44e0-bb0f-cd75060fc916 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:54.118596 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60a300-940b-44e0-bb0f-cd75060fc916 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:54.160253 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:54.172399 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e909d-8c42-4c29-8f16-0045fa2f4378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:54.173400 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e909d-8c42-4c29-8f16-0045fa2f4378 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:54.173884 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e909d-8c42-4c29-8f16-0045fa2f4378 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:54.174355 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e909d-8c42-4c29-8f16-0045fa2f4378 None admin] PATH_INFO: `/v3/services` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:54.175262 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e909d-8c42-4c29-8f16-0045fa2f4378 None admin] RBAC: Adding query filter params (type=network) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:54.175798 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e909d-8c42-4c29-8f16-0045fa2f4378 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:54.177390 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e909d-8c42-4c29-8f16-0045fa2f4378 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:54.187679 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 398/778] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Jun 3 11:45:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:54.193660 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c346e81-c95c-4399-8b12-607ac69d5859 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:54.368709 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c346e81-c95c-4399-8b12-607ac69d5859 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:54.396361 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:54.419036 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ecf54-41d1-43f3-9138-e66f92d76107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:54.419735 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ecf54-41d1-43f3-9138-e66f92d76107 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:54.420023 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ecf54-41d1-43f3-9138-e66f92d76107 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:54.420304 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ecf54-41d1-43f3-9138-e66f92d76107 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:54.421096 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ecf54-41d1-43f3-9138-e66f92d76107 None admin] RBAC: Adding query filter params (interface=public, service_id=3a72e625b1434ecb9aa44cda0479d777, region_id=RegionOne) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:54.421410 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ecf54-41d1-43f3-9138-e66f92d76107 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:54.422809 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ecf54-41d1-43f3-9138-e66f92d76107 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:54.429540 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 381/779] 10.222.0.15 () {56 vars in 1251 bytes} [Fri Jun 3 11:45:54 2022] GET /identity/v3/endpoints?service_id=3a72e625b1434ecb9aa44cda0479d777&interface=public®ion_id=RegionOne => generated 194 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:54.434784 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e909d-8c42-4c29-8f16-0045fa2f4378 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:54.586279 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e909d-8c42-4c29-8f16-0045fa2f4378 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:54.632259 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf864ac2-0737-441b-940c-996f7a6a89e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:54.633699 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf864ac2-0737-441b-940c-996f7a6a89e8 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:54.634200 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf864ac2-0737-441b-940c-996f7a6a89e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:54.634673 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf864ac2-0737-441b-940c-996f7a6a89e8 None admin] PATH_INFO: `/v3/services` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:54.635587 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf864ac2-0737-441b-940c-996f7a6a89e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:54.637151 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf864ac2-0737-441b-940c-996f7a6a89e8 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:54.643030 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 399/780] 10.222.0.15 () {56 vars in 1087 bytes} [Fri Jun 3 11:45:54 2022] GET /identity/v3/services => generated 772 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:55.102281 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8793fc-6869-4b47-b3f0-5d9f6887de95 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:55.102828 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8793fc-6869-4b47-b3f0-5d9f6887de95 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:55.102828 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8793fc-6869-4b47-b3f0-5d9f6887de95 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:55.104506 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 382/781] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:45:55.109849 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f8196-6c97-48e0-9d21-cba8f2a6b934 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:55.110143 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f8196-6c97-48e0-9d21-cba8f2a6b934 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:55.110420 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f8196-6c97-48e0-9d21-cba8f2a6b934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:55.136503 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-e04f8196-6c97-48e0-9d21-cba8f2a6b934 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:55.137681 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-e04f8196-6c97-48e0-9d21-cba8f2a6b934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:55.211849 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:55.232267 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 400/782] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:45:55.270172 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8793fc-6869-4b47-b3f0-5d9f6887de95 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:55.425162 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8793fc-6869-4b47-b3f0-5d9f6887de95 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:55.470256 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e78d0-581a-4841-b1a2-eb2a0f2b213a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:55.470974 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e78d0-581a-4841-b1a2-eb2a0f2b213a None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:55.471259 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e78d0-581a-4841-b1a2-eb2a0f2b213a None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:55.471554 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e78d0-581a-4841-b1a2-eb2a0f2b213a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:55.488340 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e78d0-581a-4841-b1a2-eb2a0f2b213a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:45:55.495951 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-c07e78d0-581a-4841-b1a2-eb2a0f2b213a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:45:55.495951 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:55.495951 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:55.495951 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:55.495951 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:55.495951 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:55.495951 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:55.495951 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:55.495951 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:55.495951 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:55.495951 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:55.495951 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:55.495951 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:45:55.495951 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:45:55.495951 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:45:55.495951 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:45:55.496888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:45:55.496888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:45:55.496888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:45:55.496888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:45:55.496888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:55.496888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:55.496888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:55.496888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:55.496888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:55.496888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:55.496888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:55.496888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:55.496888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:55.496888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:55.496888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:55.496888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:55.497767 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:55.497767 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:55.497767 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:55.497767 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:55.497767 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:45:55.497767 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:45:55.497767 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:45:55.497767 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:45:55.497767 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:45:55.497767 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:45:55.497767 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:45:55.497767 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:55.499934 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 383/783] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 3 11:45:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:55.505644 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f8196-6c97-48e0-9d21-cba8f2a6b934 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:55.529670 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1f8b7-4e41-44dd-8513-e063865f0720 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:55.529979 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1f8b7-4e41-44dd-8513-e063865f0720 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:55.530227 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1f8b7-4e41-44dd-8513-e063865f0720 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:55.531869 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 384/784] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:45:55.537578 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2971f11-7739-4f20-a704-cdf10ea26ce0 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:55.537864 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2971f11-7739-4f20-a704-cdf10ea26ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:55.538141 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2971f11-7739-4f20-a704-cdf10ea26ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:55.568447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-c2971f11-7739-4f20-a704-cdf10ea26ce0 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:55.569627 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-c2971f11-7739-4f20-a704-cdf10ea26ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:55.647086 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:55.699655 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 385/785] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 11:45:55.700427 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f8196-6c97-48e0-9d21-cba8f2a6b934 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:55.701001 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918d85f-740b-4f86-b999-bbaeeba14ec6 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:55.701290 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918d85f-740b-4f86-b999-bbaeeba14ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:55.701569 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918d85f-740b-4f86-b999-bbaeeba14ec6 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:55.704079 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 386/786] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:45:55.717279 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fdfa98-ba74-4489-a7b5-4e84b2975fa7 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:55.717551 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fdfa98-ba74-4489-a7b5-4e84b2975fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:55.717827 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fdfa98-ba74-4489-a7b5-4e84b2975fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:55.737325 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-42fdfa98-ba74-4489-a7b5-4e84b2975fa7 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:55.738413 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-42fdfa98-ba74-4489-a7b5-4e84b2975fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:55.748842 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe757c55-a5ca-4352-bd73-9a6995ced8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:55.749523 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe757c55-a5ca-4352-bd73-9a6995ced8c4 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:55.749812 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe757c55-a5ca-4352-bd73-9a6995ced8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:55.750088 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe757c55-a5ca-4352-bd73-9a6995ced8c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:55.750841 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe757c55-a5ca-4352-bd73-9a6995ced8c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:55.751147 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe757c55-a5ca-4352-bd73-9a6995ced8c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:55.753141 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe757c55-a5ca-4352-bd73-9a6995ced8c4 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:55.762368 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 401/787] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:45:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:55.763213 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe757c55-a5ca-4352-bd73-9a6995ced8c4 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:55.812972 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 387/788] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:45:55.814784 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fdfa98-ba74-4489-a7b5-4e84b2975fa7 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:55.818723 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:55.874239 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe757c55-a5ca-4352-bd73-9a6995ced8c4 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:55.920275 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0cdd26-100d-4be5-b27a-394c350831d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:55.921586 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0cdd26-100d-4be5-b27a-394c350831d8 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:55.922024 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0cdd26-100d-4be5-b27a-394c350831d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:55.922477 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0cdd26-100d-4be5-b27a-394c350831d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:55.936914 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0cdd26-100d-4be5-b27a-394c350831d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:45:55.937797 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fdfa98-ba74-4489-a7b5-4e84b2975fa7 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:55.939470 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:55.946275 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-7a0cdd26-100d-4be5-b27a-394c350831d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:45:55.946275 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:55.946275 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:55.946275 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:55.946275 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:55.946275 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:55.946275 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:55.946275 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:55.946275 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:55.946275 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:55.946275 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:55.946275 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:55.946275 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:45:55.946275 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:45:55.946275 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:45:55.946275 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:45:55.947413 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:45:55.947413 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:45:55.947413 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:45:55.947413 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:45:55.947413 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:55.947413 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:55.947413 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:55.947413 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:55.947413 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:55.947413 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:55.947413 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:55.947413 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:55.947413 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:55.947413 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:55.947413 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:55.947413 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:55.948479 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:55.948479 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:55.948479 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:55.948479 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:55.948479 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:45:55.948479 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:45:55.948479 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:45:55.948479 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:45:55.948479 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:45:55.948479 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:45:55.948479 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:45:55.948479 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:55.955909 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 402/789] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 3 11:45:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:55.957855 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0cdd26-100d-4be5-b27a-394c350831d8 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:55.984423 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44066bf3-624d-4303-961b-a39a80cd430d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:55.985157 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44066bf3-624d-4303-961b-a39a80cd430d None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:55.985446 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44066bf3-624d-4303-961b-a39a80cd430d None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:55.986281 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44066bf3-624d-4303-961b-a39a80cd430d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:55.997537 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44066bf3-624d-4303-961b-a39a80cd430d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:55.998885 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44066bf3-624d-4303-961b-a39a80cd430d None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:56.017316 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-44066bf3-624d-4303-961b-a39a80cd430d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:56.017316 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:56.017316 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:56.017316 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:56.017316 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:56.017316 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:56.017316 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:56.017316 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:56.017316 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:56.017316 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:56.017316 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:56.017316 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:56.017316 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:56.017316 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:56.017316 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:56.018261 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:56.018261 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:56.018261 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:56.018261 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:56.018261 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:56.018261 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:56.018261 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:56.018261 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:56.018261 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:56.018261 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:56.018261 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:56.018261 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:56.018261 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:56.018261 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:56.018261 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:56.018261 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:56.018261 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:56.019146 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:56.019146 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:56.019146 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:56.019146 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:56.023455 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 388/790] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:56.024153 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44066bf3-624d-4303-961b-a39a80cd430d None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:56.099741 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0cdd26-100d-4be5-b27a-394c350831d8 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:56.114425 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:56.140718 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44066bf3-624d-4303-961b-a39a80cd430d None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:56.155766 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700269ce-2e36-4264-83bc-d66edd9a6712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:56.157191 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700269ce-2e36-4264-83bc-d66edd9a6712 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:56.157722 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700269ce-2e36-4264-83bc-d66edd9a6712 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:56.158668 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700269ce-2e36-4264-83bc-d66edd9a6712 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:56.174547 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700269ce-2e36-4264-83bc-d66edd9a6712 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:45:56.182712 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-700269ce-2e36-4264-83bc-d66edd9a6712 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 11:45:56.182712 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:56.182712 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:56.182712 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:56.182712 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:56.182712 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:56.182712 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:56.182712 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:56.182712 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:56.182712 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:56.182712 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:56.182712 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:56.182712 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:45:56.182712 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:45:56.182712 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:45:56.182712 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:45:56.183802 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:45:56.183802 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:45:56.183802 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:45:56.183802 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:45:56.183802 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:56.183802 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:56.183802 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:56.183802 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:56.183802 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:56.183802 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:56.183802 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:56.183802 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:56.183802 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:56.183802 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:56.183802 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:56.183802 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:56.184661 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:56.184661 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:56.184661 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:56.184661 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:56.184661 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:45:56.184661 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:45:56.184661 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:45:56.184661 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:45:56.184661 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:45:56.184661 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:45:56.184661 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 11:45:56.184661 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:56.188309 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ebe401-bc83-4342-bfc1-80e85c7252f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:56.189686 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 403/791] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Jun 3 11:45:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:56.190089 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebe401-bc83-4342-bfc1-80e85c7252f7 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:56.190578 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebe401-bc83-4342-bfc1-80e85c7252f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:56.190683 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700269ce-2e36-4264-83bc-d66edd9a6712 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:56.191292 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebe401-bc83-4342-bfc1-80e85c7252f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:56.192335 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ebe401-bc83-4342-bfc1-80e85c7252f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:56.192902 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ebe401-bc83-4342-bfc1-80e85c7252f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:56.194721 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ebe401-bc83-4342-bfc1-80e85c7252f7 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:56.212205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 389/792] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:45:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:56.213205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ebe401-bc83-4342-bfc1-80e85c7252f7 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:56.233690 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:56.328216 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700269ce-2e36-4264-83bc-d66edd9a6712 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:56.329660 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ebe401-bc83-4342-bfc1-80e85c7252f7 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:56.364316 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66731d5a-5a09-4c74-8851-01d6b048920e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:56.364865 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66731d5a-5a09-4c74-8851-01d6b048920e None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:56.365225 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66731d5a-5a09-4c74-8851-01d6b048920e None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:56.365585 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66731d5a-5a09-4c74-8851-01d6b048920e None admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:56.366380 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66731d5a-5a09-4c74-8851-01d6b048920e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:56.366758 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66731d5a-5a09-4c74-8851-01d6b048920e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:56.368307 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66731d5a-5a09-4c74-8851-01d6b048920e None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:56.374034 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d5c81-2506-46e1-af35-47742300de43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:56.374957 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d5c81-2506-46e1-af35-47742300de43 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:56.375427 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d5c81-2506-46e1-af35-47742300de43 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:56.376949 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d5c81-2506-46e1-af35-47742300de43 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:56.377897 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d5c81-2506-46e1-af35-47742300de43 None admin] RBAC: Adding query filter params (name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:56.378841 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d5c81-2506-46e1-af35-47742300de43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:56.380706 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d5c81-2506-46e1-af35-47742300de43 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:56.386290 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 404/793] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:56.387255 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66731d5a-5a09-4c74-8851-01d6b048920e None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:56.390829 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 390/794] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Jun 3 11:45:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:56.392644 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d5c81-2506-46e1-af35-47742300de43 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:56.420475 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:56.484142 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:56.497257 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66731d5a-5a09-4c74-8851-01d6b048920e None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:56.508499 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d5c81-2506-46e1-af35-47742300de43 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:56.532688 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2775b09-6609-437b-aa82-fca3419417d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:56.533579 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2775b09-6609-437b-aa82-fca3419417d0 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:56.533932 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2775b09-6609-437b-aa82-fca3419417d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:56.534301 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2775b09-6609-437b-aa82-fca3419417d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:56.544017 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca516f-c342-4012-98ed-5d1fc798619f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:56.544515 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2775b09-6609-437b-aa82-fca3419417d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:56.544806 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca516f-c342-4012-98ed-5d1fc798619f None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:56.545090 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca516f-c342-4012-98ed-5d1fc798619f None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:56.545368 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca516f-c342-4012-98ed-5d1fc798619f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:56.545964 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2775b09-6609-437b-aa82-fca3419417d0 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:56.554219 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca516f-c342-4012-98ed-5d1fc798619f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:56.555681 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca516f-c342-4012-98ed-5d1fc798619f None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:56.564880 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-d2775b09-6609-437b-aa82-fca3419417d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:56.564880 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:56.564880 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:56.564880 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:56.564880 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:56.564880 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:56.564880 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:56.564880 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:56.564880 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:56.564880 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:56.564880 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:56.564880 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:56.564880 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:56.564880 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:56.564880 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:56.565752 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:56.565752 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:56.565752 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:56.565752 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:56.565752 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:56.565752 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:56.565752 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:56.565752 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:56.565752 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:56.565752 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:56.565752 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:56.565752 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:56.565752 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:56.565752 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:56.565752 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:56.565752 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:56.565752 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:56.566628 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:56.566628 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:56.566628 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:56.566628 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:56.567819 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 405/795] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:56.568826 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2775b09-6609-437b-aa82-fca3419417d0 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:56.570548 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-c2ca516f-c342-4012-98ed-5d1fc798619f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 03 11:45:56.570548 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:56.570548 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:56.570548 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:56.570548 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:56.570548 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:56.570548 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:56.570548 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:56.570548 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:56.570548 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:56.570548 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:56.570548 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:56.570548 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 11:45:56.570548 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 11:45:56.570548 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 11:45:56.570548 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 11:45:56.571671 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:56.571671 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:56.571671 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 11:45:56.571671 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:45:56.571671 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 11:45:56.571671 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:45:56.571671 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:56.571671 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:56.571671 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:56.571671 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:56.571671 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:56.571671 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:56.571671 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:56.571671 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:56.571671 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:56.571671 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:56.571671 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:56.571671 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:56.572651 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:56.572651 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:56.572651 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 11:45:56.572651 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 11:45:56.572651 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 11:45:56.572651 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 11:45:56.572651 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 11:45:56.572651 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 11:45:56.572651 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 03 11:45:56.572651 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:56.572651 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 391/796] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 3 11:45:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:56.573223 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901180e-0dc2-45f3-b315-a2628096bc3d None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:56.573223 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901180e-0dc2-45f3-b315-a2628096bc3d None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:56.573509 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901180e-0dc2-45f3-b315-a2628096bc3d None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:56.578776 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 392/797] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:45:56.578776 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901180e-0dc2-45f3-b315-a2628096bc3d None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:56.669220 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:56.690805 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2775b09-6609-437b-aa82-fca3419417d0 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:56.692659 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901180e-0dc2-45f3-b315-a2628096bc3d None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:56.726784 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a7c1f-8ab4-488b-bce5-63df44ead861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:56.727611 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a7c1f-8ab4-488b-bce5-63df44ead861 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:56.727899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a7c1f-8ab4-488b-bce5-63df44ead861 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:56.728175 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a7c1f-8ab4-488b-bce5-63df44ead861 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:56.729990 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215fa2bb-337d-4043-b109-83957f587cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:56.730624 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215fa2bb-337d-4043-b109-83957f587cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:56.730904 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215fa2bb-337d-4043-b109-83957f587cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:56.731345 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215fa2bb-337d-4043-b109-83957f587cb2 None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:56.731914 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215fa2bb-337d-4043-b109-83957f587cb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:56.732218 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215fa2bb-337d-4043-b109-83957f587cb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:56.733569 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215fa2bb-337d-4043-b109-83957f587cb2 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:56.739703 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a7c1f-8ab4-488b-bce5-63df44ead861 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:56.741150 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a7c1f-8ab4-488b-bce5-63df44ead861 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:56.741288 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:56.747165 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 393/798] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:56.748543 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215fa2bb-337d-4043-b109-83957f587cb2 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:56.759040 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-ac8a7c1f-8ab4-488b-bce5-63df44ead861 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:56.759040 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:56.759040 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:56.759040 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:56.759040 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:56.759040 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:56.759040 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:56.759040 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:56.759040 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:56.759040 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:56.759040 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:56.759040 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:56.759040 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:56.759040 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:56.759040 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:56.759970 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:56.759970 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:56.759970 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:56.759970 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:56.759970 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:56.759970 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:56.759970 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:56.759970 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:56.759970 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:56.759970 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:56.759970 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:56.759970 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:56.759970 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:56.759970 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:56.759970 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:56.759970 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:56.759970 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:56.760887 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:56.760887 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:56.760887 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:56.760887 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:56.764945 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 406/799] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:56.766236 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d29ab-9391-4031-88d3-65e64cbbe983 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:56.766530 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d29ab-9391-4031-88d3-65e64cbbe983 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:56.766814 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d29ab-9391-4031-88d3-65e64cbbe983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:56.784047 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-d99d29ab-9391-4031-88d3-65e64cbbe983 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:56.785240 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-d99d29ab-9391-4031-88d3-65e64cbbe983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:56.857749 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 407/800] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:45:56.858531 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d29ab-9391-4031-88d3-65e64cbbe983 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:56.873291 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215fa2bb-337d-4043-b109-83957f587cb2 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:56.919723 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e715b-2656-4ffc-afe2-16128a98a9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:56.920404 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e715b-2656-4ffc-afe2-16128a98a9e5 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:56.920684 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e715b-2656-4ffc-afe2-16128a98a9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:56.920955 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e715b-2656-4ffc-afe2-16128a98a9e5 None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:56.921795 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8e715b-2656-4ffc-afe2-16128a98a9e5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:56.922104 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8e715b-2656-4ffc-afe2-16128a98a9e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:56.924258 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8e715b-2656-4ffc-afe2-16128a98a9e5 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:56.938171 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:56.944450 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 394/801] 10.222.0.15 () {56 vars in 1135 bytes} [Fri Jun 3 11:45:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:56.945338 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e715b-2656-4ffc-afe2-16128a98a9e5 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:56.988529 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d29ab-9391-4031-88d3-65e64cbbe983 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:57.008674 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:57.025608 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b30d81-42ab-4af6-a4bf-09fb53eab85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:57.026781 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b30d81-42ab-4af6-a4bf-09fb53eab85c None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:57.027065 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b30d81-42ab-4af6-a4bf-09fb53eab85c None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:57.027333 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b30d81-42ab-4af6-a4bf-09fb53eab85c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:57.035262 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b30d81-42ab-4af6-a4bf-09fb53eab85c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:57.036740 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b30d81-42ab-4af6-a4bf-09fb53eab85c None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:57.050994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-b0b30d81-42ab-4af6-a4bf-09fb53eab85c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 11:45:57.050994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:57.050994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:57.050994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:57.050994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:57.050994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:57.050994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:57.050994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:57.050994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:57.050994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:57.050994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:57.050994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:57.050994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 11:45:57.050994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 11:45:57.050994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 11:45:57.050994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 11:45:57.052162 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:57.052162 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:57.052162 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 11:45:57.052162 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:45:57.052162 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 11:45:57.052162 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:45:57.052162 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:57.052162 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:57.052162 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:57.052162 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:57.052162 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:57.052162 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:57.052162 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:57.052162 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:57.052162 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:57.052162 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:57.052162 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:57.052162 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:57.053125 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:57.053125 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:57.053125 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 11:45:57.053125 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 11:45:57.053125 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 11:45:57.053125 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 11:45:57.053125 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 11:45:57.053125 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 11:45:57.053125 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 11:45:57.053125 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:57.053125 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 408/802] 10.222.0.15 () {56 vars in 1093 bytes} [Fri Jun 3 11:45:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:57.053713 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b30d81-42ab-4af6-a4bf-09fb53eab85c None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:57.063146 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e715b-2656-4ffc-afe2-16128a98a9e5 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:57.100494 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943e677-5dd5-4b9b-9ab0-c413ebef8ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:57.101394 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943e677-5dd5-4b9b-9ab0-c413ebef8ccf None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:57.101830 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943e677-5dd5-4b9b-9ab0-c413ebef8ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:57.102251 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943e677-5dd5-4b9b-9ab0-c413ebef8ccf None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:57.103154 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943e677-5dd5-4b9b-9ab0-c413ebef8ccf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:57.103469 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943e677-5dd5-4b9b-9ab0-c413ebef8ccf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:57.104858 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943e677-5dd5-4b9b-9ab0-c413ebef8ccf None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:57.116778 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 395/803] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:57.117526 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943e677-5dd5-4b9b-9ab0-c413ebef8ccf None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:57.165752 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b30d81-42ab-4af6-a4bf-09fb53eab85c None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:57.188473 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:57.204246 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab3134-fd44-42c1-92b4-b30e255c54c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:57.205684 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab3134-fd44-42c1-92b4-b30e255c54c2 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:57.205963 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab3134-fd44-42c1-92b4-b30e255c54c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:57.206341 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab3134-fd44-42c1-92b4-b30e255c54c2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:57.206895 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab3134-fd44-42c1-92b4-b30e255c54c2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:57.208307 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab3134-fd44-42c1-92b4-b30e255c54c2 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:57.221044 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-b6ab3134-fd44-42c1-92b4-b30e255c54c2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 11:45:57.221044 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:57.221044 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 11:45:57.221044 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 11:45:57.221044 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 11:45:57.221044 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 11:45:57.221044 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 11:45:57.221044 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:45:57.221044 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 11:45:57.221044 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:57.221044 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 11:45:57.221044 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:57.221044 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:57.221044 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:57.221044 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:57.221044 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:57.221954 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:57.221954 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:57.221954 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:57.221954 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:57.221954 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:57.221954 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:57.221954 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:57.221954 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 11:45:57.221954 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 11:45:57.221954 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 11:45:57.221954 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 11:45:57.221954 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:57.221954 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:57.221954 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:57.221954 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:57.221954 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:57.222769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:57.222769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:57.222769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:57.222769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:57.222769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:57.222769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:57.222769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:57.222769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:57.222769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:57.222769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:57.222769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:57.222769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 11:45:57.222769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:45:57.222769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 03 11:45:57.222769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:57.222769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 409/804] 10.222.0.15 () {56 vars in 1129 bytes} [Fri Jun 3 11:45:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:57.224549 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab3134-fd44-42c1-92b4-b30e255c54c2 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:57.227228 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943e677-5dd5-4b9b-9ab0-c413ebef8ccf None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:57.245005 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:57.265650 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26465ed-46ba-40e4-826e-02691669f8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:57.266710 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26465ed-46ba-40e4-826e-02691669f8a4 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:57.267748 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26465ed-46ba-40e4-826e-02691669f8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:57.268200 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26465ed-46ba-40e4-826e-02691669f8a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:57.279772 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26465ed-46ba-40e4-826e-02691669f8a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:57.281214 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26465ed-46ba-40e4-826e-02691669f8a4 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:57.298504 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-c26465ed-46ba-40e4-826e-02691669f8a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:57.298504 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:57.298504 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:57.298504 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:57.298504 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:57.298504 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:57.298504 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:57.298504 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:57.298504 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:57.298504 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:57.298504 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:57.298504 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:57.298504 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:57.298504 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:57.298504 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:57.299591 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:57.299591 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:57.299591 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:57.299591 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:57.299591 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:57.299591 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:57.299591 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:57.299591 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:57.299591 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:57.299591 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:57.299591 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:57.299591 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:57.299591 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:57.299591 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:57.299591 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:57.299591 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:57.299591 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:57.300500 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:57.300500 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:57.300500 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:57.300500 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:57.303639 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 396/805] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:57.304758 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26465ed-46ba-40e4-826e-02691669f8a4 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:57.329974 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab3134-fd44-42c1-92b4-b30e255c54c2 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:57.362752 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc09af4-883e-4346-8ffc-76d2f0f6572c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:57.363419 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc09af4-883e-4346-8ffc-76d2f0f6572c None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:57.363743 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc09af4-883e-4346-8ffc-76d2f0f6572c None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:57.364032 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc09af4-883e-4346-8ffc-76d2f0f6572c None admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:57.364868 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc09af4-883e-4346-8ffc-76d2f0f6572c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:57.365186 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc09af4-883e-4346-8ffc-76d2f0f6572c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:57.366610 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc09af4-883e-4346-8ffc-76d2f0f6572c None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:57.383841 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 410/806] 10.222.0.15 () {56 vars in 1133 bytes} [Fri Jun 3 11:45:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:57.384578 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc09af4-883e-4346-8ffc-76d2f0f6572c None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:57.403749 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26465ed-46ba-40e4-826e-02691669f8a4 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:57.433818 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:57.436803 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41ec6b-b7dd-4cae-be2d-57e5a3d76e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:57.437608 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41ec6b-b7dd-4cae-be2d-57e5a3d76e8f None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:57.437894 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41ec6b-b7dd-4cae-be2d-57e5a3d76e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:57.438169 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41ec6b-b7dd-4cae-be2d-57e5a3d76e8f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:57.446091 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd41ec6b-b7dd-4cae-be2d-57e5a3d76e8f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:57.447558 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd41ec6b-b7dd-4cae-be2d-57e5a3d76e8f None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:57.462301 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-cd41ec6b-b7dd-4cae-be2d-57e5a3d76e8f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 11:45:57.462301 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:57.462301 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:57.462301 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:57.462301 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:57.462301 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:57.462301 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:57.462301 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:57.462301 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:57.462301 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:57.462301 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:57.462301 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:57.462301 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 11:45:57.462301 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 11:45:57.462301 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 11:45:57.462301 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 11:45:57.463424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:57.463424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:57.463424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 11:45:57.463424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:45:57.463424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 11:45:57.463424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:45:57.463424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:57.463424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:57.463424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:57.463424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:57.463424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:57.463424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:57.463424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:57.463424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:57.463424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:57.463424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:57.463424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:57.463424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:57.464689 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:57.464689 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:57.464689 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 11:45:57.464689 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 11:45:57.464689 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 11:45:57.464689 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 11:45:57.464689 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 11:45:57.464689 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 11:45:57.464689 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 11:45:57.464689 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:57.467664 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 397/807] 10.222.0.15 () {56 vars in 1117 bytes} [Fri Jun 3 11:45:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:57.468925 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ecd92-2300-470d-a81e-eb311e7392b7 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:57.469217 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ecd92-2300-470d-a81e-eb311e7392b7 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:57.469496 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ecd92-2300-470d-a81e-eb311e7392b7 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:57.470795 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 398/808] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:45:57.471475 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ecd92-2300-470d-a81e-eb311e7392b7 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:57.492221 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc09af4-883e-4346-8ffc-76d2f0f6572c None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:57.498723 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:57.528314 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9603e06-25da-43c6-b799-bcdce159dfbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:57.529058 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9603e06-25da-43c6-b799-bcdce159dfbd None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:57.529418 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9603e06-25da-43c6-b799-bcdce159dfbd None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:57.529694 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9603e06-25da-43c6-b799-bcdce159dfbd None admin] PATH_INFO: `/v3/services` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:57.530400 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9603e06-25da-43c6-b799-bcdce159dfbd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:57.530705 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9603e06-25da-43c6-b799-bcdce159dfbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:57.532124 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9603e06-25da-43c6-b799-bcdce159dfbd None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:57.536590 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 411/809] 10.222.0.15 () {56 vars in 1124 bytes} [Fri Jun 3 11:45:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:57.537560 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9603e06-25da-43c6-b799-bcdce159dfbd None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:57.575536 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ecd92-2300-470d-a81e-eb311e7392b7 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:57.608567 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d94520-37bf-4c8b-8aa1-421578b5ca7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:57.609213 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d94520-37bf-4c8b-8aa1-421578b5ca7a None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:57.609491 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d94520-37bf-4c8b-8aa1-421578b5ca7a None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:57.609798 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d94520-37bf-4c8b-8aa1-421578b5ca7a None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:57.610504 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d94520-37bf-4c8b-8aa1-421578b5ca7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:57.610834 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d94520-37bf-4c8b-8aa1-421578b5ca7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:57.612224 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d94520-37bf-4c8b-8aa1-421578b5ca7a None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:57.623218 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 399/810] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:57.623911 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d94520-37bf-4c8b-8aa1-421578b5ca7a None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:57.634782 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9603e06-25da-43c6-b799-bcdce159dfbd None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:57.644695 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:57.669779 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c0be8-b98d-4398-94ed-a39d8df926cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:57.670425 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c0be8-b98d-4398-94ed-a39d8df926cf None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:57.670711 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c0be8-b98d-4398-94ed-a39d8df926cf None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:57.670992 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c0be8-b98d-4398-94ed-a39d8df926cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:57.712989 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:57.725493 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d94520-37bf-4c8b-8aa1-421578b5ca7a None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:57.737973 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651c0be8-b98d-4398-94ed-a39d8df926cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:57.739436 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651c0be8-b98d-4398-94ed-a39d8df926cf None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:57.759054 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6814f7-c09f-4f49-a5c6-41b098ccb49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:57.759748 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6814f7-c09f-4f49-a5c6-41b098ccb49c None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:57.760028 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6814f7-c09f-4f49-a5c6-41b098ccb49c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:57.760300 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6814f7-c09f-4f49-a5c6-41b098ccb49c None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:57.761122 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6814f7-c09f-4f49-a5c6-41b098ccb49c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:57.761427 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6814f7-c09f-4f49-a5c6-41b098ccb49c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:57.762845 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6814f7-c09f-4f49-a5c6-41b098ccb49c None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:57.779680 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 400/811] 10.222.0.15 () {56 vars in 1149 bytes} [Fri Jun 3 11:45:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:57.780862 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df704955-f75c-4a8c-a191-818605ecb328 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:57.781151 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df704955-f75c-4a8c-a191-818605ecb328 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:57.781430 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df704955-f75c-4a8c-a191-818605ecb328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:57.797120 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-df704955-f75c-4a8c-a191-818605ecb328 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:45:57.798835 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-df704955-f75c-4a8c-a191-818605ecb328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:45:57.838015 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 412/812] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:45:57 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 11:45:57.838847 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c0be8-b98d-4398-94ed-a39d8df926cf None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:57.848446 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:57.865586 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 401/813] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:45:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:45:57.866246 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df704955-f75c-4a8c-a191-818605ecb328 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:57.946234 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:57.951564 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c0be8-b98d-4398-94ed-a39d8df926cf None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:57.969301 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df704955-f75c-4a8c-a191-818605ecb328 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:57.983879 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4539d1-8956-453b-8861-832a5b4715fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:57.984536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4539d1-8956-453b-8861-832a5b4715fb None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:57.984813 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4539d1-8956-453b-8861-832a5b4715fb None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:57.985085 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4539d1-8956-453b-8861-832a5b4715fb None admin] PATH_INFO: `/v3/services` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:57.986308 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4539d1-8956-453b-8861-832a5b4715fb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:57.986607 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4539d1-8956-453b-8861-832a5b4715fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:57.988035 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4539d1-8956-453b-8861-832a5b4715fb None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:57.992866 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 413/814] 10.222.0.15 () {56 vars in 1124 bytes} [Fri Jun 3 11:45:57 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:57.993457 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4539d1-8956-453b-8861-832a5b4715fb None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:58.004385 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a7992-f91b-4282-8e17-a63793fc38c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:58.005173 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a7992-f91b-4282-8e17-a63793fc38c5 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:58.005457 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a7992-f91b-4282-8e17-a63793fc38c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:58.005731 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a7992-f91b-4282-8e17-a63793fc38c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:58.012589 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60a7992-f91b-4282-8e17-a63793fc38c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:58.014023 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60a7992-f91b-4282-8e17-a63793fc38c5 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:58.027617 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-e60a7992-f91b-4282-8e17-a63793fc38c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:45:58.027617 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:58.027617 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:58.027617 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:58.027617 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:58.027617 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:58.027617 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:58.027617 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:58.027617 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:58.027617 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:58.027617 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:58.027617 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:58.027617 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 11:45:58.027617 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 11:45:58.027617 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 11:45:58.028663 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 11:45:58.028663 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:58.028663 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:58.028663 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:58.028663 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:58.028663 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:58.028663 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:58.028663 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:58.028663 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:58.028663 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:58.028663 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:58.028663 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:58.028663 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:58.028663 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:58.028663 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:58.028663 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:58.028663 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:58.034434 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 11:45:58.034434 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 11:45:58.034434 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 11:45:58.034434 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 11:45:58.034434 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 11:45:58.034434 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 11:45:58.034434 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:45:58.034434 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:58.034434 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 402/815] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:45:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:58.034434 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a7992-f91b-4282-8e17-a63793fc38c5 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:58.062458 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:58.091469 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4539d1-8956-453b-8861-832a5b4715fb None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:58.125219 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044afee-5398-4f8a-9c8c-5e73d3ce3273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:58.126003 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044afee-5398-4f8a-9c8c-5e73d3ce3273 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:58.126286 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044afee-5398-4f8a-9c8c-5e73d3ce3273 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:58.126560 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044afee-5398-4f8a-9c8c-5e73d3ce3273 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:58.131073 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a7992-f91b-4282-8e17-a63793fc38c5 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:58.136384 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044afee-5398-4f8a-9c8c-5e73d3ce3273 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:58.137805 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044afee-5398-4f8a-9c8c-5e73d3ce3273 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:58.155031 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-a044afee-5398-4f8a-9c8c-5e73d3ce3273 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:58.155031 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:58.155031 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:58.155031 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:58.155031 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:58.155031 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:58.155031 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:58.155031 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:58.155031 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:58.155031 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:58.155031 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:58.155031 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:58.155031 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:58.155031 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:58.155031 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:58.155966 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:58.155966 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:58.155966 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:58.155966 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:58.155966 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:58.155966 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:58.155966 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:58.155966 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:58.155966 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:58.155966 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:58.155966 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:58.155966 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:58.155966 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:58.155966 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:58.155966 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:58.155966 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:58.155966 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:58.156853 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:58.156853 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:58.156853 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:58.156853 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:58.156853 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 414/816] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:58.157152 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044afee-5398-4f8a-9c8c-5e73d3ce3273 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:58.166897 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46218ee-53d9-4416-97e3-5c7ad9eb12b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:58.167788 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46218ee-53d9-4416-97e3-5c7ad9eb12b5 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:58.168074 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46218ee-53d9-4416-97e3-5c7ad9eb12b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:58.168350 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46218ee-53d9-4416-97e3-5c7ad9eb12b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:58.171027 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:58.180216 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46218ee-53d9-4416-97e3-5c7ad9eb12b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:58.181695 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46218ee-53d9-4416-97e3-5c7ad9eb12b5 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:58.198466 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-b46218ee-53d9-4416-97e3-5c7ad9eb12b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:58.198466 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:58.198466 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:58.198466 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:58.198466 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:58.198466 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:58.198466 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:58.198466 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:58.198466 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:58.198466 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:58.198466 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:58.198466 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:58.198466 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:45:58.198466 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:45:58.198466 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:45:58.199467 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:45:58.199467 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:58.199467 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:58.199467 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:58.199467 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:58.199467 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:58.199467 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:58.199467 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:58.199467 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:58.199467 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:58.199467 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:58.199467 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:58.199467 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:58.199467 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:58.199467 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:58.199467 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:58.199467 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:58.200417 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:45:58.200417 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:45:58.200417 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:45:58.200417 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:58.200417 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 403/817] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:45:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:58.200790 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46218ee-53d9-4416-97e3-5c7ad9eb12b5 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:58.261675 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044afee-5398-4f8a-9c8c-5e73d3ce3273 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:58.285318 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:58.296990 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64774a10-3ef6-4553-bac6-791a8b530523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:58.297786 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64774a10-3ef6-4553-bac6-791a8b530523 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:58.298070 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64774a10-3ef6-4553-bac6-791a8b530523 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:58.298347 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64774a10-3ef6-4553-bac6-791a8b530523 None admin] PATH_INFO: `/v3/services/network` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:58.299001 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64774a10-3ef6-4553-bac6-791a8b530523 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:58.300393 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64774a10-3ef6-4553-bac6-791a8b530523 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:58.301552 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46218ee-53d9-4416-97e3-5c7ad9eb12b5 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:58.315791 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-64774a10-3ef6-4553-bac6-791a8b530523 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 11:45:58.315791 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:58.315791 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 11:45:58.315791 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 11:45:58.315791 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 11:45:58.315791 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 11:45:58.315791 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 11:45:58.315791 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:45:58.315791 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 11:45:58.315791 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:58.315791 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 11:45:58.315791 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:58.315791 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:58.315791 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:58.315791 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:58.315791 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:58.315791 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:58.316990 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:58.316990 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:58.316990 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:58.316990 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:58.316990 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:58.316990 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:58.316990 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 11:45:58.316990 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 11:45:58.316990 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 11:45:58.316990 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 11:45:58.316990 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:58.316990 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:58.316990 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:58.316990 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:58.316990 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:58.316990 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:58.318029 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:58.318029 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:58.318029 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:58.318029 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:58.318029 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:58.318029 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:58.318029 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:58.318029 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:58.318029 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:58.318029 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:58.318029 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 11:45:58.318029 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:45:58.318029 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 03 11:45:58.318029 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:58.318029 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 415/818] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:45:58 2022] GET /identity/v3/services/network => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:58.318950 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64774a10-3ef6-4553-bac6-791a8b530523 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:58.339483 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165f5b1-37af-4d33-a664-3d19cf9ac67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:58.340237 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165f5b1-37af-4d33-a664-3d19cf9ac67b None admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:58.340522 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165f5b1-37af-4d33-a664-3d19cf9ac67b None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:58.340799 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165f5b1-37af-4d33-a664-3d19cf9ac67b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:58.341530 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165f5b1-37af-4d33-a664-3d19cf9ac67b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:58.342904 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165f5b1-37af-4d33-a664-3d19cf9ac67b None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:58.362516 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 404/819] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Jun 3 11:45:58 2022] POST /identity/v3/endpoints => generated 346 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:45:58.363422 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165f5b1-37af-4d33-a664-3d19cf9ac67b None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:58.419076 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:58.442168 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64774a10-3ef6-4553-bac6-791a8b530523 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:58.487447 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc773faf-dd54-4a3e-a665-dd96d3df8c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:58.488147 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc773faf-dd54-4a3e-a665-dd96d3df8c45 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:58.488434 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc773faf-dd54-4a3e-a665-dd96d3df8c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:58.488717 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc773faf-dd54-4a3e-a665-dd96d3df8c45 None admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:58.489511 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc773faf-dd54-4a3e-a665-dd96d3df8c45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:58.489821 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc773faf-dd54-4a3e-a665-dd96d3df8c45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:58.491274 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc773faf-dd54-4a3e-a665-dd96d3df8c45 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:58.492728 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165f5b1-37af-4d33-a664-3d19cf9ac67b None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:58.505101 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 416/820] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 3 11:45:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:58.506047 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc773faf-dd54-4a3e-a665-dd96d3df8c45 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:58.536007 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a1d0b-128e-47ad-84c5-2a79b2469981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:58.536856 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a1d0b-128e-47ad-84c5-2a79b2469981 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:58.537236 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a1d0b-128e-47ad-84c5-2a79b2469981 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:58.537612 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a1d0b-128e-47ad-84c5-2a79b2469981 None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:58.538422 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a1d0b-128e-47ad-84c5-2a79b2469981 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:58.538731 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a1d0b-128e-47ad-84c5-2a79b2469981 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:58.540165 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a1d0b-128e-47ad-84c5-2a79b2469981 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:58.555926 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 405/821] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:58.555926 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a1d0b-128e-47ad-84c5-2a79b2469981 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:58.560332 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:58.625653 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc773faf-dd54-4a3e-a665-dd96d3df8c45 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:58.659908 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a643a-1db4-48e7-8ec9-68e857e2d81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:58.660570 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a643a-1db4-48e7-8ec9-68e857e2d81d None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:58.660868 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a643a-1db4-48e7-8ec9-68e857e2d81d None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:58.661134 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a643a-1db4-48e7-8ec9-68e857e2d81d None admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:58.661839 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1a643a-1db4-48e7-8ec9-68e857e2d81d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:58.662142 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1a643a-1db4-48e7-8ec9-68e857e2d81d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:58.663518 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1a643a-1db4-48e7-8ec9-68e857e2d81d None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:58.663779 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:58.667727 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a1d0b-128e-47ad-84c5-2a79b2469981 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:58.679764 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 417/822] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:58.679764 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a643a-1db4-48e7-8ec9-68e857e2d81d None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:58.708116 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe1b32-aa54-4141-b5b3-b8627667ed2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:58.708876 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe1b32-aa54-4141-b5b3-b8627667ed2c None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:58.709221 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe1b32-aa54-4141-b5b3-b8627667ed2c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:58.709560 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe1b32-aa54-4141-b5b3-b8627667ed2c None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:58.710323 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fe1b32-aa54-4141-b5b3-b8627667ed2c None admin] RBAC: Adding query filter params (name=network) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:58.710693 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fe1b32-aa54-4141-b5b3-b8627667ed2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:58.712142 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fe1b32-aa54-4141-b5b3-b8627667ed2c None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:58.721034 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 406/823] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Jun 3 11:45:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:58.721034 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe1b32-aa54-4141-b5b3-b8627667ed2c None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:58.786853 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a643a-1db4-48e7-8ec9-68e857e2d81d None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:58.789287 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:58.824726 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c9432-f6ea-4cdf-9afc-63f1fe60c18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:58.825526 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe1b32-aa54-4141-b5b3-b8627667ed2c None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:58.825641 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c9432-f6ea-4cdf-9afc-63f1fe60c18b None admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:58.825889 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c9432-f6ea-4cdf-9afc-63f1fe60c18b None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:58.826163 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c9432-f6ea-4cdf-9afc-63f1fe60c18b None admin] PATH_INFO: `/v3/projects/cff223ee05524cf4bf3591fc5a39559e/users/5f52901fe535420bb0019272d4eafe72/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:58.829079 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c9432-f6ea-4cdf-9afc-63f1fe60c18b None admin] RBAC: Authorizing `identity:create_grant(project_id=cff223ee05524cf4bf3591fc5a39559e, user_id=5f52901fe535420bb0019272d4eafe72, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:58.830594 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c9432-f6ea-4cdf-9afc-63f1fe60c18b None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:58.844105 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 418/824] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Jun 3 11:45:58 2022] PUT /identity/v3/projects/cff223ee05524cf4bf3591fc5a39559e/users/5f52901fe535420bb0019272d4eafe72/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:45:58.845603 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c9432-f6ea-4cdf-9afc-63f1fe60c18b None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:58.872053 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920dc65-d94f-45e5-99f0-ee597ab34fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:58.873279 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920dc65-d94f-45e5-99f0-ee597ab34fac None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:58.873748 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920dc65-d94f-45e5-99f0-ee597ab34fac None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:58.874218 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920dc65-d94f-45e5-99f0-ee597ab34fac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:58.890079 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3920dc65-d94f-45e5-99f0-ee597ab34fac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:58.895135 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3920dc65-d94f-45e5-99f0-ee597ab34fac None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:58.917183 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-3920dc65-d94f-45e5-99f0-ee597ab34fac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:45:58.917183 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:58.917183 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:58.917183 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:58.917183 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:58.917183 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:58.917183 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:58.917183 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:58.917183 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:58.917183 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:58.917183 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:58.917183 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:58.917183 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 11:45:58.917183 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 11:45:58.917183 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 11:45:58.918342 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 11:45:58.918342 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:58.918342 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:58.918342 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:58.918342 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:58.918342 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:58.918342 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:58.918342 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:58.918342 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:58.918342 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:58.918342 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:58.918342 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:58.918342 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:58.918342 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:58.918342 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:58.918342 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:58.918342 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:58.919469 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 11:45:58.919469 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 11:45:58.919469 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 11:45:58.919469 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 11:45:58.919469 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 11:45:58.919469 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 11:45:58.919469 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:45:58.919469 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:45:58.927335 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 407/825] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:45:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:58.928628 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920dc65-d94f-45e5-99f0-ee597ab34fac None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:58.969607 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:59.004810 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c9432-f6ea-4cdf-9afc-63f1fe60c18b None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:59.056750 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc668b40-f570-44a3-8c7f-bc09b7a31424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:59.057320 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc668b40-f570-44a3-8c7f-bc09b7a31424 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:59.057697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc668b40-f570-44a3-8c7f-bc09b7a31424 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:59.058065 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc668b40-f570-44a3-8c7f-bc09b7a31424 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:59.063055 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920dc65-d94f-45e5-99f0-ee597ab34fac None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:59.072711 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc668b40-f570-44a3-8c7f-bc09b7a31424 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:59.074324 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc668b40-f570-44a3-8c7f-bc09b7a31424 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:59.091211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-fc668b40-f570-44a3-8c7f-bc09b7a31424 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:45:59.091211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:45:59.091211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:45:59.091211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:45:59.091211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:45:59.091211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:45:59.091211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:45:59.091211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:45:59.091211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:45:59.091211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:45:59.091211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:45:59.091211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:45:59.091211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 11:45:59.091211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 11:45:59.091211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 11:45:59.092363 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 11:45:59.092363 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:45:59.092363 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:45:59.092363 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:45:59.092363 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:45:59.092363 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:45:59.092363 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:45:59.092363 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:45:59.092363 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:45:59.092363 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:45:59.092363 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:45:59.092363 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:45:59.092363 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:45:59.092363 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:45:59.092363 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:45:59.092363 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:45:59.092363 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:45:59.093394 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 11:45:59.093394 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 11:45:59.093394 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 11:45:59.093394 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 11:45:59.093394 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 11:45:59.093394 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 11:45:59.093394 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:45:59.093394 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:45:59.093394 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 419/826] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:45:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:45:59.093991 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc668b40-f570-44a3-8c7f-bc09b7a31424 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:59.107626 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b7811-9b58-4a56-aad3-95106669826b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:59.108293 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b7811-9b58-4a56-aad3-95106669826b None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:59.108567 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b7811-9b58-4a56-aad3-95106669826b None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:59.108840 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b7811-9b58-4a56-aad3-95106669826b None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:59.109540 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b7811-9b58-4a56-aad3-95106669826b None admin] RBAC: Adding query filter params (type=network) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:59.109841 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b7811-9b58-4a56-aad3-95106669826b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:59.111859 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b7811-9b58-4a56-aad3-95106669826b None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:59.121629 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 408/827] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Jun 3 11:45:58 2022] GET /identity/v3/services?type=network => generated 350 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:59.121629 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b7811-9b58-4a56-aad3-95106669826b None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:59.147482 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:59.222135 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:59.236731 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b7811-9b58-4a56-aad3-95106669826b None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:59.251955 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc668b40-f570-44a3-8c7f-bc09b7a31424 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:59.281243 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b40c5-3898-4073-9191-a98740cf3070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:59.282556 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b40c5-3898-4073-9191-a98740cf3070 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:59.283205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b40c5-3898-4073-9191-a98740cf3070 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:59.283610 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b40c5-3898-4073-9191-a98740cf3070 None admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:59.284756 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b40c5-3898-4073-9191-a98740cf3070 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:59.285169 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b40c5-3898-4073-9191-a98740cf3070 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:59.287425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b40c5-3898-4073-9191-a98740cf3070 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:59.293587 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d2b9d-ff88-4ee6-a209-4e381d2eb7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:59.294485 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d2b9d-ff88-4ee6-a209-4e381d2eb7a6 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:59.294906 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d2b9d-ff88-4ee6-a209-4e381d2eb7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:59.295323 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d2b9d-ff88-4ee6-a209-4e381d2eb7a6 None admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:59.296325 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d2b9d-ff88-4ee6-a209-4e381d2eb7a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:59.296858 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d2b9d-ff88-4ee6-a209-4e381d2eb7a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:59.299354 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d2b9d-ff88-4ee6-a209-4e381d2eb7a6 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:59.307886 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 409/828] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 3 11:45:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:59.307886 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b40c5-3898-4073-9191-a98740cf3070 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:59.318650 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 420/829] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 3 11:45:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:59.319881 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d2b9d-ff88-4ee6-a209-4e381d2eb7a6 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:59.406787 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:59.424901 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d2b9d-ff88-4ee6-a209-4e381d2eb7a6 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:59.443966 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b40c5-3898-4073-9191-a98740cf3070 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:59.460720 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98a53b0-a7c6-4e52-87f5-4200d4a66eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:59.461696 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a53b0-a7c6-4e52-87f5-4200d4a66eb0 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:59.462189 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a53b0-a7c6-4e52-87f5-4200d4a66eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:59.462658 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a53b0-a7c6-4e52-87f5-4200d4a66eb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:59.463725 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98a53b0-a7c6-4e52-87f5-4200d4a66eb0 None admin] RBAC: Adding query filter params (role.id=c486e164840b41a59fd118dece2ce572, scope.project.id=cff223ee05524cf4bf3591fc5a39559e, user.id=6247bfb7aebd45eeb97ba5933be44c6d) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:45:59.464252 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98a53b0-a7c6-4e52-87f5-4200d4a66eb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:59.465883 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98a53b0-a7c6-4e52-87f5-4200d4a66eb0 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:59.472285 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 421/830] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:45:59 2022] GET /identity/v3/role_assignments?user.id=6247bfb7aebd45eeb97ba5933be44c6d&scope.project.id=cff223ee05524cf4bf3591fc5a39559e&role.id=c486e164840b41a59fd118dece2ce572 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:45:59.473266 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98a53b0-a7c6-4e52-87f5-4200d4a66eb0 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:45:59.488734 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46d089-e22f-4b31-8681-a5da5d5797a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:59.489410 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46d089-e22f-4b31-8681-a5da5d5797a2 None admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:59.489697 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46d089-e22f-4b31-8681-a5da5d5797a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:59.489975 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46d089-e22f-4b31-8681-a5da5d5797a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:59.490721 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46d089-e22f-4b31-8681-a5da5d5797a2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:59.492882 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46d089-e22f-4b31-8681-a5da5d5797a2 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:59.525618 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 410/831] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Jun 3 11:45:59 2022] POST /identity/v3/endpoints => generated 327 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:45:59.645702 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98a53b0-a7c6-4e52-87f5-4200d4a66eb0 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:45:59.707796 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e74e13-230f-4aa2-bb27-a8997b43fe45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:45:59.709132 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e74e13-230f-4aa2-bb27-a8997b43fe45 None admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:45:59.709655 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e74e13-230f-4aa2-bb27-a8997b43fe45 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:45:59.709935 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e74e13-230f-4aa2-bb27-a8997b43fe45 None admin] PATH_INFO: `/v3/projects/cff223ee05524cf4bf3591fc5a39559e/users/a55cbe88e78e4f3a82b8703a3b1804e5/roles/41158ae54c7a437284af718034e9b354` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:45:59.728802 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e74e13-230f-4aa2-bb27-a8997b43fe45 None admin] RBAC: Authorizing `identity:create_grant(project_id=cff223ee05524cf4bf3591fc5a39559e, user_id=a55cbe88e78e4f3a82b8703a3b1804e5, role_id=41158ae54c7a437284af718034e9b354)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:45:59.730635 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e74e13-230f-4aa2-bb27-a8997b43fe45 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:45:59.741170 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:45:59.764662 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 422/832] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Jun 3 11:45:59 2022] PUT /identity/v3/projects/cff223ee05524cf4bf3591fc5a39559e/users/a55cbe88e78e4f3a82b8703a3b1804e5/roles/41158ae54c7a437284af718034e9b354 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:46:00.703408 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c7e83-1447-4942-bb6e-d828883eb133 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:00.705124 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c7e83-1447-4942-bb6e-d828883eb133 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:00.705716 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c7e83-1447-4942-bb6e-d828883eb133 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:00.707582 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 411/833] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:46:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:46:00.713151 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0ec7e-d803-4c56-880b-3a1423d814f3 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:00.713969 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0ec7e-d803-4c56-880b-3a1423d814f3 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:00.714454 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0ec7e-d803-4c56-880b-3a1423d814f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:00.731556 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-e7e0ec7e-d803-4c56-880b-3a1423d814f3 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:46:00.733056 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-e7e0ec7e-d803-4c56-880b-3a1423d814f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:46:00.811606 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 423/834] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:46:00 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:46:00.828165 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c7e83-1447-4942-bb6e-d828883eb133 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:00.832406 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:00.938668 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c7e83-1447-4942-bb6e-d828883eb133 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:00.980298 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb283492-a55a-496e-848f-b4678515ac34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:00.981058 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb283492-a55a-496e-848f-b4678515ac34 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:00.981383 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb283492-a55a-496e-848f-b4678515ac34 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:00.981703 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb283492-a55a-496e-848f-b4678515ac34 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:00.982387 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb283492-a55a-496e-848f-b4678515ac34 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:00.983917 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb283492-a55a-496e-848f-b4678515ac34 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:00.997687 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-eb283492-a55a-496e-848f-b4678515ac34 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 11:46:00.997687 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:00.997687 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 11:46:00.997687 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 11:46:00.997687 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 11:46:00.997687 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 11:46:00.997687 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 11:46:00.997687 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:46:00.997687 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 11:46:00.997687 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:00.997687 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 11:46:00.997687 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:00.997687 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:00.997687 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:00.997687 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:00.997687 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:00.997687 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:00.998770 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:00.998770 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:00.998770 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:00.998770 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:00.998770 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:00.998770 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:00.998770 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 11:46:00.998770 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 11:46:00.998770 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 11:46:00.998770 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 11:46:00.998770 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:00.998770 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:00.998770 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:00.998770 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:00.998770 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:00.998770 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:00.999854 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:00.999854 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:00.999854 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:00.999854 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:00.999854 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:00.999854 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:00.999854 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:00.999854 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:00.999854 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:00.999854 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:00.999854 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 11:46:00.999854 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:46:00.999854 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 11:46:00.999854 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:00.999854 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 412/835] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Jun 3 11:46:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:46:01.007904 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0ec7e-d803-4c56-880b-3a1423d814f3 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:01.109430 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0ec7e-d803-4c56-880b-3a1423d814f3 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:01.134267 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:01.145496 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9c87c-b1fc-4035-9c4d-17134af755da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:01.146323 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9c87c-b1fc-4035-9c4d-17134af755da None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:01.146724 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9c87c-b1fc-4035-9c4d-17134af755da None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:01.147114 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9c87c-b1fc-4035-9c4d-17134af755da None admin] PATH_INFO: `/v3/services` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:01.147969 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9c87c-b1fc-4035-9c4d-17134af755da None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:01.148731 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9c87c-b1fc-4035-9c4d-17134af755da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:01.150218 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9c87c-b1fc-4035-9c4d-17134af755da None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:01.159609 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 424/836] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Jun 3 11:46:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:01.164578 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb283492-a55a-496e-848f-b4678515ac34 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:01.234148 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:01.273596 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb283492-a55a-496e-848f-b4678515ac34 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:01.309552 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc141f1-16b4-44c0-80fd-ddbcd2b1c51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:01.310227 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc141f1-16b4-44c0-80fd-ddbcd2b1c51f None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:01.310516 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc141f1-16b4-44c0-80fd-ddbcd2b1c51f None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:01.310794 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc141f1-16b4-44c0-80fd-ddbcd2b1c51f None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:01.311533 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc141f1-16b4-44c0-80fd-ddbcd2b1c51f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:01.311842 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc141f1-16b4-44c0-80fd-ddbcd2b1c51f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:01.313465 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc141f1-16b4-44c0-80fd-ddbcd2b1c51f None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:01.318520 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 413/837] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Jun 3 11:46:01 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:01.348731 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53752ee-78ae-4a05-aeff-2918aae5b39d None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:01.349133 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53752ee-78ae-4a05-aeff-2918aae5b39d None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:01.349493 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53752ee-78ae-4a05-aeff-2918aae5b39d None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:01.351014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 425/838] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:46:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:46:01.357426 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf895b65-1a21-49ca-b6b8-db9bd417b5d8 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:01.357821 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf895b65-1a21-49ca-b6b8-db9bd417b5d8 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:01.358179 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf895b65-1a21-49ca-b6b8-db9bd417b5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:01.377022 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-bf895b65-1a21-49ca-b6b8-db9bd417b5d8 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:46:01.378368 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-bf895b65-1a21-49ca-b6b8-db9bd417b5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:46:01.456111 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 414/839] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:46:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:46:01.480534 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53752ee-78ae-4a05-aeff-2918aae5b39d None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:01.590289 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53752ee-78ae-4a05-aeff-2918aae5b39d None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:01.628850 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0ba2d-b335-469c-9ca5-928806ce4adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:01.629652 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0ba2d-b335-469c-9ca5-928806ce4adf None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:01.629938 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0ba2d-b335-469c-9ca5-928806ce4adf None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:01.630212 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0ba2d-b335-469c-9ca5-928806ce4adf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:01.642074 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e0ba2d-b335-469c-9ca5-928806ce4adf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:46:01.650496 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-82e0ba2d-b335-469c-9ca5-928806ce4adf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:46:01.650496 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:01.650496 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:01.650496 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:01.650496 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:01.650496 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:01.650496 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:01.650496 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:01.650496 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:01.650496 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:01.650496 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:01.650496 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:01.650496 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:46:01.650496 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:46:01.650496 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:46:01.650496 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:46:01.651828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:46:01.651828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:46:01.651828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:46:01.651828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:46:01.651828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:01.651828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:01.651828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:01.651828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:01.651828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:01.651828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:01.651828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:01.651828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:01.651828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:01.651828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:01.651828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:01.651828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:01.652679 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:01.652679 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:01.652679 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:01.652679 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:01.652679 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:46:01.652679 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:46:01.652679 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:46:01.652679 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:46:01.652679 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:46:01.652679 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:46:01.652679 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:46:01.652679 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:01.652679 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 426/840] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 3 11:46:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:46:01.658415 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf895b65-1a21-49ca-b6b8-db9bd417b5d8 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:01.724556 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:01.765963 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf895b65-1a21-49ca-b6b8-db9bd417b5d8 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:01.803191 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50236239-cb04-4a1e-bc2f-2f3017787541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:01.803925 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50236239-cb04-4a1e-bc2f-2f3017787541 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:01.804213 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50236239-cb04-4a1e-bc2f-2f3017787541 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:01.804490 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50236239-cb04-4a1e-bc2f-2f3017787541 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:01.805269 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50236239-cb04-4a1e-bc2f-2f3017787541 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:01.805586 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50236239-cb04-4a1e-bc2f-2f3017787541 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:01.807019 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50236239-cb04-4a1e-bc2f-2f3017787541 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:01.818187 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 415/841] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:46:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:01.823910 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0ba2d-b335-469c-9ca5-928806ce4adf None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:01.876183 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:01.933091 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0ba2d-b335-469c-9ca5-928806ce4adf None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:01.967992 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b082a-5f92-4438-8fe7-9453ae6afe1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:01.968791 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b082a-5f92-4438-8fe7-9453ae6afe1c None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:01.969075 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b082a-5f92-4438-8fe7-9453ae6afe1c None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:01.969348 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b082a-5f92-4438-8fe7-9453ae6afe1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:01.980948 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5b082a-5f92-4438-8fe7-9453ae6afe1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:01.982502 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5b082a-5f92-4438-8fe7-9453ae6afe1c None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:02.000676 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-8a5b082a-5f92-4438-8fe7-9453ae6afe1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:46:02.000676 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:02.000676 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:02.000676 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:02.000676 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:02.000676 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:02.000676 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:02.000676 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:02.000676 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:02.000676 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:02.000676 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:02.000676 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:02.000676 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:46:02.000676 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:46:02.000676 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:46:02.003344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:46:02.003344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:02.003344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:02.003344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:02.003344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:02.003344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:02.003344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:02.003344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:02.003344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:02.003344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:02.003344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:02.003344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:02.003344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:02.003344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:02.003344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:02.003344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:02.003344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:02.005230 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:46:02.005230 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:46:02.005230 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:46:02.005230 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:02.005230 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 427/842] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:46:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:46:02.008030 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50236239-cb04-4a1e-bc2f-2f3017787541 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:02.011133 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb83f0-1c64-4b2f-90c9-36be84cd3b5d None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:02.011533 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb83f0-1c64-4b2f-90c9-36be84cd3b5d None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:02.011746 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb83f0-1c64-4b2f-90c9-36be84cd3b5d None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:02.013323 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 428/843] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 11:46:02.018812 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9efe3-44fd-44f3-9720-de4f71484e2c None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:02.019102 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9efe3-44fd-44f3-9720-de4f71484e2c None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:02.019383 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9efe3-44fd-44f3-9720-de4f71484e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:02.036707 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-85e9efe3-44fd-44f3-9720-de4f71484e2c None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:46:02.038008 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-85e9efe3-44fd-44f3-9720-de4f71484e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:46:02.116483 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 429/844] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:46:02 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 11:46:02.139138 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9efe3-44fd-44f3-9720-de4f71484e2c None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:02.146156 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50236239-cb04-4a1e-bc2f-2f3017787541 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:02.171000 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:02.174777 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:02.184181 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af690abc-8e54-4669-9a4f-61fc0600b52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:02.184852 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af690abc-8e54-4669-9a4f-61fc0600b52b None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:02.185137 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af690abc-8e54-4669-9a4f-61fc0600b52b None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:02.185413 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af690abc-8e54-4669-9a4f-61fc0600b52b None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:02.186137 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af690abc-8e54-4669-9a4f-61fc0600b52b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:02.186568 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af690abc-8e54-4669-9a4f-61fc0600b52b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:02.188018 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af690abc-8e54-4669-9a4f-61fc0600b52b None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:02.201074 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 416/845] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:46:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:02.203100 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f98fb-13a5-4de1-8dcd-bede921a6814 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:02.203973 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f98fb-13a5-4de1-8dcd-bede921a6814 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:02.205241 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f98fb-13a5-4de1-8dcd-bede921a6814 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:02.206952 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 417/846] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:46:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:46:02.207860 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f98fb-13a5-4de1-8dcd-bede921a6814 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:02.255940 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9efe3-44fd-44f3-9720-de4f71484e2c None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:02.289415 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47b8d4-eb32-4e11-b1eb-f146ce9b1674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:02.290219 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47b8d4-eb32-4e11-b1eb-f146ce9b1674 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:02.290506 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47b8d4-eb32-4e11-b1eb-f146ce9b1674 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:02.290774 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47b8d4-eb32-4e11-b1eb-f146ce9b1674 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:02.291430 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f47b8d4-eb32-4e11-b1eb-f146ce9b1674 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:02.292828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f47b8d4-eb32-4e11-b1eb-f146ce9b1674 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:02.305389 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-6f47b8d4-eb32-4e11-b1eb-f146ce9b1674 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 11:46:02.305389 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:02.305389 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 11:46:02.305389 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 11:46:02.305389 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 11:46:02.305389 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 11:46:02.305389 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 11:46:02.305389 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:46:02.305389 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 11:46:02.305389 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:02.305389 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 11:46:02.305389 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:02.305389 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:02.305389 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:02.305389 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:02.305389 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:02.306325 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:02.306325 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:02.306325 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:02.306325 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:02.306325 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:02.306325 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:02.306325 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:02.306325 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 11:46:02.306325 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 11:46:02.306325 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 11:46:02.306325 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 11:46:02.306325 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:02.306325 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:02.306325 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:02.306325 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:02.306325 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:02.307184 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:02.307184 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:02.307184 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:02.307184 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:02.307184 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:02.307184 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:02.307184 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:02.307184 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:02.307184 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:02.307184 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:02.307184 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:02.307184 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 11:46:02.307184 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:46:02.307184 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 11:46:02.307184 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:02.307184 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 430/847] 10.222.0.15 () {56 vars in 1132 bytes} [Fri Jun 3 11:46:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:46:02.308088 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6504ac-4dd8-480d-a1c4-98d6a6e039e5 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:02.308088 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6504ac-4dd8-480d-a1c4-98d6a6e039e5 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:02.308223 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6504ac-4dd8-480d-a1c4-98d6a6e039e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:02.324204 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f98fb-13a5-4de1-8dcd-bede921a6814 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:02.324881 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-2a6504ac-4dd8-480d-a1c4-98d6a6e039e5 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:46:02.326049 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-2a6504ac-4dd8-480d-a1c4-98d6a6e039e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:46:02.362415 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42e75e-a34e-44b7-82af-423f0a273ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:02.363199 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42e75e-a34e-44b7-82af-423f0a273ccf None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:02.363480 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42e75e-a34e-44b7-82af-423f0a273ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:02.363806 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42e75e-a34e-44b7-82af-423f0a273ccf None admin] PATH_INFO: `/v3/users/swift` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:02.370809 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42e75e-a34e-44b7-82af-423f0a273ccf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:02.372290 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42e75e-a34e-44b7-82af-423f0a273ccf None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:02.388068 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-1b42e75e-a34e-44b7-82af-423f0a273ccf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 03 11:46:02.388068 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:02.388068 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:02.388068 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:02.388068 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:02.388068 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:02.388068 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:02.388068 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:02.388068 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:02.388068 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:02.388068 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:02.388068 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:02.388068 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 11:46:02.388068 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 11:46:02.388068 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 11:46:02.388068 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 11:46:02.389004 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:02.389004 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:02.389004 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 11:46:02.389004 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:46:02.389004 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 11:46:02.389004 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:46:02.389004 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:02.389004 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:02.389004 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:02.389004 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:02.389004 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:02.389004 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:02.389004 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:02.389004 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:02.389004 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:02.389004 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:02.389004 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:02.389004 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:02.389995 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:02.389995 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:02.389995 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 11:46:02.389995 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 11:46:02.389995 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 11:46:02.389995 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 11:46:02.389995 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 11:46:02.389995 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 11:46:02.389995 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 03 11:46:02.389995 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:02.389995 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 418/848] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 3 11:46:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:46:02.389995 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42e75e-a34e-44b7-82af-423f0a273ccf None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:02.403543 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 431/849] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:46:02 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:46:02.403543 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6504ac-4dd8-480d-a1c4-98d6a6e039e5 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:02.439890 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:02.450360 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:02.511998 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42e75e-a34e-44b7-82af-423f0a273ccf None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:02.523955 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6504ac-4dd8-480d-a1c4-98d6a6e039e5 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:02.548718 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381af72e-32e2-4c3e-8a6f-82d364792cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:02.549410 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381af72e-32e2-4c3e-8a6f-82d364792cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:02.549692 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381af72e-32e2-4c3e-8a6f-82d364792cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:02.549970 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381af72e-32e2-4c3e-8a6f-82d364792cf6 None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:02.550700 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381af72e-32e2-4c3e-8a6f-82d364792cf6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:02.551008 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381af72e-32e2-4c3e-8a6f-82d364792cf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:02.552447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381af72e-32e2-4c3e-8a6f-82d364792cf6 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:02.557799 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 419/850] 10.222.0.15 () {56 vars in 1126 bytes} [Fri Jun 3 11:46:02 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:02.560643 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381af72e-32e2-4c3e-8a6f-82d364792cf6 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:02.561549 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fae6e7-da12-4c46-bc55-083cc4373134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:02.562357 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fae6e7-da12-4c46-bc55-083cc4373134 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:02.562654 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fae6e7-da12-4c46-bc55-083cc4373134 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:02.562937 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fae6e7-da12-4c46-bc55-083cc4373134 None admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:02.564386 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fae6e7-da12-4c46-bc55-083cc4373134 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:02.564704 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fae6e7-da12-4c46-bc55-083cc4373134 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:02.566868 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fae6e7-da12-4c46-bc55-083cc4373134 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:02.584883 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 432/851] 10.222.0.15 () {56 vars in 1135 bytes} [Fri Jun 3 11:46:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:02.585714 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fae6e7-da12-4c46-bc55-083cc4373134 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:02.674009 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:02.674187 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381af72e-32e2-4c3e-8a6f-82d364792cf6 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:02.685124 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:02.695464 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fae6e7-da12-4c46-bc55-083cc4373134 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:02.712255 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ec456-3827-4ae5-a915-674382bb2733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:02.713055 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ec456-3827-4ae5-a915-674382bb2733 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:02.713341 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ec456-3827-4ae5-a915-674382bb2733 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:02.713615 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ec456-3827-4ae5-a915-674382bb2733 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:02.724959 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ec456-3827-4ae5-a915-674382bb2733 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:46:02.732577 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-e52ec456-3827-4ae5-a915-674382bb2733 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 11:46:02.732577 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:02.732577 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:02.732577 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:02.732577 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:02.732577 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:02.732577 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:02.732577 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:02.732577 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:02.732577 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:02.732577 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:02.732577 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:02.732577 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:46:02.732577 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:46:02.732577 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:46:02.732577 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:46:02.733712 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:46:02.733712 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:46:02.733712 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:46:02.733712 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:46:02.733712 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:02.733712 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:02.733712 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:02.733712 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:02.733712 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:02.733712 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:02.733712 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:02.733712 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:02.733712 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:02.733712 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:02.733712 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:02.733712 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:02.734760 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:02.734760 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:02.734760 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:02.734760 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:02.734760 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:46:02.734760 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:46:02.734760 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:46:02.734760 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:46:02.734760 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:46:02.734760 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:46:02.734760 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 11:46:02.734760 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:02.736435 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07202b68-2a9d-4876-9d58-d9f85a6fc9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:02.737269 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07202b68-2a9d-4876-9d58-d9f85a6fc9f2 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:02.737697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07202b68-2a9d-4876-9d58-d9f85a6fc9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:02.738120 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07202b68-2a9d-4876-9d58-d9f85a6fc9f2 None admin] PATH_INFO: `/v3/services` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:02.738969 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 420/852] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Jun 3 11:46:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:46:02.739117 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07202b68-2a9d-4876-9d58-d9f85a6fc9f2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:02.739587 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07202b68-2a9d-4876-9d58-d9f85a6fc9f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:02.739857 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ec456-3827-4ae5-a915-674382bb2733 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:02.741257 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07202b68-2a9d-4876-9d58-d9f85a6fc9f2 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:02.747139 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 433/853] 10.222.0.15 () {56 vars in 1126 bytes} [Fri Jun 3 11:46:02 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:02.748129 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07202b68-2a9d-4876-9d58-d9f85a6fc9f2 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:02.862603 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ec456-3827-4ae5-a915-674382bb2733 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:02.878593 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07202b68-2a9d-4876-9d58-d9f85a6fc9f2 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:02.903822 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10856d5-db7c-42a6-b71c-009fc8305a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:02.904490 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10856d5-db7c-42a6-b71c-009fc8305a48 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:02.904771 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10856d5-db7c-42a6-b71c-009fc8305a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:02.905042 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10856d5-db7c-42a6-b71c-009fc8305a48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:02.923040 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a41e04-bfc1-4274-80a6-bd5f463fe11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:02.923873 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a41e04-bfc1-4274-80a6-bd5f463fe11a None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:02.924222 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a41e04-bfc1-4274-80a6-bd5f463fe11a None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:02.924442 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a41e04-bfc1-4274-80a6-bd5f463fe11a None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:02.925312 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a41e04-bfc1-4274-80a6-bd5f463fe11a None admin] RBAC: Adding query filter params (name=service) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:02.925627 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a41e04-bfc1-4274-80a6-bd5f463fe11a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:02.927166 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a41e04-bfc1-4274-80a6-bd5f463fe11a None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:02.937275 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 434/854] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Jun 3 11:46:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:02.942972 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a41e04-bfc1-4274-80a6-bd5f463fe11a None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:02.949838 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:02.962815 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:02.997047 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10856d5-db7c-42a6-b71c-009fc8305a48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:02.998388 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10856d5-db7c-42a6-b71c-009fc8305a48 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:03.070828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a41e04-bfc1-4274-80a6-bd5f463fe11a None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:03.111254 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52afdf1-1346-4655-8fd4-966f5f48a80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:03.112106 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52afdf1-1346-4655-8fd4-966f5f48a80e None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:03.112392 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52afdf1-1346-4655-8fd4-966f5f48a80e None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:03.112672 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52afdf1-1346-4655-8fd4-966f5f48a80e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:03.124429 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52afdf1-1346-4655-8fd4-966f5f48a80e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:03.126201 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52afdf1-1346-4655-8fd4-966f5f48a80e None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:03.131647 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 421/855] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:46:02 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 11:46:03.137329 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10856d5-db7c-42a6-b71c-009fc8305a48 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:03.149710 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-f52afdf1-1346-4655-8fd4-966f5f48a80e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:46:03.149710 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:03.149710 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:03.149710 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:03.149710 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:03.149710 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:03.149710 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:03.149710 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:03.149710 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:03.149710 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:03.149710 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:03.149710 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:03.149710 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:46:03.149710 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:46:03.149710 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:46:03.150665 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:46:03.150665 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:03.150665 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:03.150665 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:03.150665 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:03.150665 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:03.150665 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:03.150665 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:03.150665 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:03.150665 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:03.150665 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:03.150665 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:03.150665 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:03.150665 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:03.150665 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:03.150665 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:03.150665 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:03.151867 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:46:03.151867 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:46:03.151867 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:46:03.151867 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:03.151867 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 435/856] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:46:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:46:03.157330 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52afdf1-1346-4655-8fd4-966f5f48a80e None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:03.210566 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:03.225916 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:03.247300 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10856d5-db7c-42a6-b71c-009fc8305a48 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:03.273332 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52afdf1-1346-4655-8fd4-966f5f48a80e None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:03.284265 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9a579-a2d1-4e9f-97c1-a933f8ba0f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:03.285367 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9a579-a2d1-4e9f-97c1-a933f8ba0f51 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:03.285883 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9a579-a2d1-4e9f-97c1-a933f8ba0f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:03.286383 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9a579-a2d1-4e9f-97c1-a933f8ba0f51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:03.297877 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd9a579-a2d1-4e9f-97c1-a933f8ba0f51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:03.299875 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd9a579-a2d1-4e9f-97c1-a933f8ba0f51 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:03.311475 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd98a7d-65a8-4c72-a8c4-acdea5fecd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:03.312177 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd98a7d-65a8-4c72-a8c4-acdea5fecd07 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:03.312466 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd98a7d-65a8-4c72-a8c4-acdea5fecd07 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:03.312748 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd98a7d-65a8-4c72-a8c4-acdea5fecd07 None admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:03.313539 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd98a7d-65a8-4c72-a8c4-acdea5fecd07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:03.313885 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd98a7d-65a8-4c72-a8c4-acdea5fecd07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:03.315367 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd98a7d-65a8-4c72-a8c4-acdea5fecd07 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:03.320061 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-fcd9a579-a2d1-4e9f-97c1-a933f8ba0f51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:46:03.320061 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:03.320061 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:03.320061 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:03.320061 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:03.320061 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:03.320061 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:03.320061 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:03.320061 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:03.320061 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:03.320061 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:03.320061 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:03.320061 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:46:03.320061 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:46:03.320061 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:46:03.320954 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:46:03.320954 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:03.320954 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:03.320954 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:03.320954 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:03.320954 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:03.320954 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:03.320954 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:03.320954 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:03.320954 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:03.320954 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:03.320954 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:03.320954 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:03.320954 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:03.320954 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:03.320954 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:03.320954 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:03.321847 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:46:03.321847 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:46:03.321847 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:46:03.321847 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:03.328646 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 422/857] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:46:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:46:03.331058 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9a579-a2d1-4e9f-97c1-a933f8ba0f51 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:03.333149 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 436/858] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:46:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:46:03.334082 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd98a7d-65a8-4c72-a8c4-acdea5fecd07 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:03.440324 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9a579-a2d1-4e9f-97c1-a933f8ba0f51 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:03.444451 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd98a7d-65a8-4c72-a8c4-acdea5fecd07 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:03.467404 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:03.467877 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:03.477876 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7c5d3-96ad-446c-85cf-3b1615057638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:03.478871 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7c5d3-96ad-446c-85cf-3b1615057638 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:03.479366 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7c5d3-96ad-446c-85cf-3b1615057638 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:03.479886 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7c5d3-96ad-446c-85cf-3b1615057638 None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:03.480951 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc7c5d3-96ad-446c-85cf-3b1615057638 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:03.481551 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc7c5d3-96ad-446c-85cf-3b1615057638 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:03.483793 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc7c5d3-96ad-446c-85cf-3b1615057638 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:03.484373 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823c2ec-0e2f-42dc-8237-51d762186f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:03.485186 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823c2ec-0e2f-42dc-8237-51d762186f8c None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:03.485490 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823c2ec-0e2f-42dc-8237-51d762186f8c None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:03.486358 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823c2ec-0e2f-42dc-8237-51d762186f8c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:03.494145 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8823c2ec-0e2f-42dc-8237-51d762186f8c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:03.495648 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8823c2ec-0e2f-42dc-8237-51d762186f8c None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:03.503806 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 423/859] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:46:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:03.505066 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7c5d3-96ad-446c-85cf-3b1615057638 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:03.512149 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-8823c2ec-0e2f-42dc-8237-51d762186f8c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 11:46:03.512149 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:03.512149 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:03.512149 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:03.512149 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:03.512149 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:03.512149 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:03.512149 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:03.512149 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:03.512149 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:03.512149 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:03.512149 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:03.512149 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 11:46:03.512149 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 11:46:03.512149 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 11:46:03.512149 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 11:46:03.513115 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:03.513115 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:03.513115 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 11:46:03.513115 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:46:03.513115 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 11:46:03.513115 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:46:03.513115 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:03.513115 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:03.513115 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:03.513115 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:03.513115 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:03.513115 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:03.513115 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:03.513115 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:03.513115 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:03.513115 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:03.513115 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:03.513115 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:03.514077 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:03.514077 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:03.514077 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 11:46:03.514077 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 11:46:03.514077 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 11:46:03.514077 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 11:46:03.514077 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 11:46:03.514077 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 11:46:03.514077 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 11:46:03.514077 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:03.514077 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 437/860] 10.222.0.15 () {56 vars in 1117 bytes} [Fri Jun 3 11:46:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:46:03.519721 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823c2ec-0e2f-42dc-8237-51d762186f8c None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:03.612003 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7c5d3-96ad-446c-85cf-3b1615057638 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:03.626850 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823c2ec-0e2f-42dc-8237-51d762186f8c None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:03.650482 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0164287-b525-4a5d-8040-6adc0883783c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:03.651909 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0164287-b525-4a5d-8040-6adc0883783c None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:03.652406 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0164287-b525-4a5d-8040-6adc0883783c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:03.652911 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0164287-b525-4a5d-8040-6adc0883783c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:03.660185 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0164287-b525-4a5d-8040-6adc0883783c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:03.662292 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0164287-b525-4a5d-8040-6adc0883783c None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:03.664081 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da21a7e-74fc-43d0-b334-75b0629f49da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:03.664826 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da21a7e-74fc-43d0-b334-75b0629f49da None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:03.665182 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da21a7e-74fc-43d0-b334-75b0629f49da None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:03.665532 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da21a7e-74fc-43d0-b334-75b0629f49da None admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:03.666465 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da21a7e-74fc-43d0-b334-75b0629f49da None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:03.666849 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da21a7e-74fc-43d0-b334-75b0629f49da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:03.668392 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da21a7e-74fc-43d0-b334-75b0629f49da None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:03.678180 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-a0164287-b525-4a5d-8040-6adc0883783c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:46:03.678180 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:03.678180 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:03.678180 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:03.678180 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:03.678180 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:03.678180 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:03.678180 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:03.678180 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:03.678180 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:03.678180 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:03.678180 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:03.678180 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 11:46:03.678180 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 11:46:03.678180 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 11:46:03.679077 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 11:46:03.679077 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:03.679077 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:03.679077 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:03.679077 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:03.679077 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:03.679077 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:03.679077 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:03.679077 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:03.679077 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:03.679077 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:03.679077 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:03.679077 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:03.679077 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:03.679077 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:03.679077 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:03.679077 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:03.680005 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 11:46:03.680005 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 11:46:03.680005 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 11:46:03.680005 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 11:46:03.680005 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 11:46:03.680005 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 11:46:03.680005 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:46:03.680005 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:03.686172 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 424/861] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:46:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:46:03.686748 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 438/862] 10.222.0.15 () {56 vars in 1149 bytes} [Fri Jun 3 11:46:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:46:03.687880 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0164287-b525-4a5d-8040-6adc0883783c None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:03.696520 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da21a7e-74fc-43d0-b334-75b0629f49da None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:03.733639 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:03.744126 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:03.795688 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0164287-b525-4a5d-8040-6adc0883783c None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:03.806387 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da21a7e-74fc-43d0-b334-75b0629f49da None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:03.830659 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e73baf-0c47-4e09-8172-661cc29fde68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:03.831315 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e73baf-0c47-4e09-8172-661cc29fde68 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:03.831626 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e73baf-0c47-4e09-8172-661cc29fde68 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:03.831901 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e73baf-0c47-4e09-8172-661cc29fde68 None admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:03.832680 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e73baf-0c47-4e09-8172-661cc29fde68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:03.832988 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e73baf-0c47-4e09-8172-661cc29fde68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:03.834422 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e73baf-0c47-4e09-8172-661cc29fde68 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:03.841134 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c788c-ceba-451f-996b-a5663ef0cf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:03.841908 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c788c-ceba-451f-996b-a5663ef0cf25 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:03.842195 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c788c-ceba-451f-996b-a5663ef0cf25 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:03.842474 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c788c-ceba-451f-996b-a5663ef0cf25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:03.855088 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 425/863] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 3 11:46:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:03.855088 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bd8a8-64d8-4c3b-ae51-d9ed79c71833 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:03.855088 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bd8a8-64d8-4c3b-ae51-d9ed79c71833 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:03.855088 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bd8a8-64d8-4c3b-ae51-d9ed79c71833 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:03.855088 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 426/864] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:46:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:46:03.855088 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bd8a8-64d8-4c3b-ae51-d9ed79c71833 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:03.921432 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c788c-ceba-451f-996b-a5663ef0cf25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:03.923542 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c788c-ceba-451f-996b-a5663ef0cf25 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:03.964365 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:03.972839 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:03.977175 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bd8a8-64d8-4c3b-ae51-d9ed79c71833 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:04.015565 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f02f3e-054c-4b7e-91d7-d5ab6fa22376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:04.016144 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f02f3e-054c-4b7e-91d7-d5ab6fa22376 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:04.016433 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f02f3e-054c-4b7e-91d7-d5ab6fa22376 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:04.016755 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f02f3e-054c-4b7e-91d7-d5ab6fa22376 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:04.017593 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f02f3e-054c-4b7e-91d7-d5ab6fa22376 None admin] RBAC: Adding query filter params (role.id=c486e164840b41a59fd118dece2ce572, scope.project.id=cff223ee05524cf4bf3591fc5a39559e, user.id=5f52901fe535420bb0019272d4eafe72) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:04.017904 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f02f3e-054c-4b7e-91d7-d5ab6fa22376 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:04.019327 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f02f3e-054c-4b7e-91d7-d5ab6fa22376 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:04.025634 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 427/865] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:46:03 2022] GET /identity/v3/role_assignments?user.id=5f52901fe535420bb0019272d4eafe72&scope.project.id=cff223ee05524cf4bf3591fc5a39559e&role.id=c486e164840b41a59fd118dece2ce572 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:46:04.027181 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58fb3e3-65df-4c23-ac09-2f7d708b1154 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:04.027478 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58fb3e3-65df-4c23-ac09-2f7d708b1154 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:04.027785 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58fb3e3-65df-4c23-ac09-2f7d708b1154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:04.041023 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 439/866] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:46:03 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 11:46:04.042341 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c788c-ceba-451f-996b-a5663ef0cf25 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:04.046042 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-f58fb3e3-65df-4c23-ac09-2f7d708b1154 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:46:04.047303 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-f58fb3e3-65df-4c23-ac09-2f7d708b1154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:46:04.141329 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 428/867] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:46:04 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:46:04.165399 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c788c-ceba-451f-996b-a5663ef0cf25 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:04.168551 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58fb3e3-65df-4c23-ac09-2f7d708b1154 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:04.202926 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e2c9f-61be-48b6-9863-6bea1e0696bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:04.203755 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e2c9f-61be-48b6-9863-6bea1e0696bc None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:04.204042 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e2c9f-61be-48b6-9863-6bea1e0696bc None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:04.204862 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e2c9f-61be-48b6-9863-6bea1e0696bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:04.215775 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215e2c9f-61be-48b6-9863-6bea1e0696bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:04.217373 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215e2c9f-61be-48b6-9863-6bea1e0696bc None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:04.218233 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:04.238853 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-215e2c9f-61be-48b6-9863-6bea1e0696bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:46:04.238853 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:04.238853 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:04.238853 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:04.238853 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:04.238853 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:04.238853 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:04.238853 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:04.238853 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:04.238853 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:04.238853 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:04.238853 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:04.238853 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:46:04.238853 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:46:04.238853 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:46:04.240014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:46:04.240014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:04.240014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:04.240014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:04.240014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:04.240014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:04.240014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:04.240014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:04.240014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:04.240014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:04.240014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:04.240014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:04.240014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:04.240014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:04.240014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:04.240014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:04.240014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:04.241070 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:46:04.241070 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:46:04.241070 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:46:04.241070 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:04.247084 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 440/868] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:46:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:46:04.249365 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e2c9f-61be-48b6-9863-6bea1e0696bc None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:04.286492 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:04.294557 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58fb3e3-65df-4c23-ac09-2f7d708b1154 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:04.337501 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67fcbf-33f4-4b10-b20d-da9fc2f609cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:04.338591 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67fcbf-33f4-4b10-b20d-da9fc2f609cb None admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:04.338888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67fcbf-33f4-4b10-b20d-da9fc2f609cb None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:04.339311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67fcbf-33f4-4b10-b20d-da9fc2f609cb None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:04.340211 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df67fcbf-33f4-4b10-b20d-da9fc2f609cb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:04.342313 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df67fcbf-33f4-4b10-b20d-da9fc2f609cb None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:04.360689 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 429/869] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Jun 3 11:46:04 2022] POST /identity/v3/services => generated 251 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:46:04.365000 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e2c9f-61be-48b6-9863-6bea1e0696bc None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:04.421073 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8ab01-1ec8-40ff-a090-bd85113e46e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:04.421889 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8ab01-1ec8-40ff-a090-bd85113e46e4 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:04.422025 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8ab01-1ec8-40ff-a090-bd85113e46e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:04.426627 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8ab01-1ec8-40ff-a090-bd85113e46e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:04.426627 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b8ab01-1ec8-40ff-a090-bd85113e46e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:04.426627 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b8ab01-1ec8-40ff-a090-bd85113e46e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:04.426627 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b8ab01-1ec8-40ff-a090-bd85113e46e4 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:04.440415 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 441/870] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:46:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:46:04.446176 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67fcbf-33f4-4b10-b20d-da9fc2f609cb None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:04.562170 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67fcbf-33f4-4b10-b20d-da9fc2f609cb None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:04.600815 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194199f-4294-400c-ae6d-9ebadf9baf5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:04.601614 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194199f-4294-400c-ae6d-9ebadf9baf5a None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:04.601898 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194199f-4294-400c-ae6d-9ebadf9baf5a None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:04.602170 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194199f-4294-400c-ae6d-9ebadf9baf5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:04.609471 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0194199f-4294-400c-ae6d-9ebadf9baf5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:04.611622 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0194199f-4294-400c-ae6d-9ebadf9baf5a None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:04.627279 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-0194199f-4294-400c-ae6d-9ebadf9baf5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:46:04.627279 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:04.627279 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:04.627279 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:04.627279 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:04.627279 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:04.627279 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:04.627279 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:04.627279 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:04.627279 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:04.627279 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:04.627279 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:04.627279 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 11:46:04.627279 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 11:46:04.627279 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 11:46:04.628272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 11:46:04.628272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:04.628272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:04.628272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:04.628272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:04.628272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:04.628272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:04.628272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:04.628272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:04.628272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:04.628272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:04.628272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:04.628272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:04.628272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:04.628272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:04.628272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:04.628272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:04.629788 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 11:46:04.629788 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 11:46:04.629788 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 11:46:04.629788 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 11:46:04.629788 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 11:46:04.629788 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 11:46:04.629788 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:46:04.629788 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:04.629788 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 430/871] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:46:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:46:04.634546 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8ab01-1ec8-40ff-a090-bd85113e46e4 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:04.686667 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:04.744663 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8ab01-1ec8-40ff-a090-bd85113e46e4 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:04.782939 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d943fa4-244a-4eef-82a8-bc2f635400df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:04.783628 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d943fa4-244a-4eef-82a8-bc2f635400df None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:04.783913 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d943fa4-244a-4eef-82a8-bc2f635400df None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:04.784189 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d943fa4-244a-4eef-82a8-bc2f635400df None admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:04.784982 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d943fa4-244a-4eef-82a8-bc2f635400df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:04.785288 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d943fa4-244a-4eef-82a8-bc2f635400df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:04.786721 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d943fa4-244a-4eef-82a8-bc2f635400df None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:04.799774 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 442/872] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 3 11:46:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:46:04.805941 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194199f-4294-400c-ae6d-9ebadf9baf5a None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:04.823133 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:04.917850 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194199f-4294-400c-ae6d-9ebadf9baf5a None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:04.954443 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8fa64-8253-41a3-a187-f03d363f129f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:04.955101 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8fa64-8253-41a3-a187-f03d363f129f None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:04.955384 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8fa64-8253-41a3-a187-f03d363f129f None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:04.955699 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8fa64-8253-41a3-a187-f03d363f129f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:04.956531 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8fa64-8253-41a3-a187-f03d363f129f None admin] RBAC: Adding query filter params (role.id=41158ae54c7a437284af718034e9b354, scope.project.id=cff223ee05524cf4bf3591fc5a39559e, user.id=a55cbe88e78e4f3a82b8703a3b1804e5) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:04.956845 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8fa64-8253-41a3-a187-f03d363f129f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:04.958289 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8fa64-8253-41a3-a187-f03d363f129f None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:04.964877 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 431/873] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:46:04 2022] GET /identity/v3/role_assignments?user.id=a55cbe88e78e4f3a82b8703a3b1804e5&scope.project.id=cff223ee05524cf4bf3591fc5a39559e&role.id=41158ae54c7a437284af718034e9b354 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:05.086488 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a6fb5-e062-491b-ad4f-f3b85c1d1b86 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:05.087017 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a6fb5-e062-491b-ad4f-f3b85c1d1b86 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:05.087122 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a6fb5-e062-491b-ad4f-f3b85c1d1b86 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:05.088748 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 443/874] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:46:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:46:05.094478 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf7dfe-c073-48e3-b863-de02f394f5d6 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:05.094777 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf7dfe-c073-48e3-b863-de02f394f5d6 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:05.095732 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf7dfe-c073-48e3-b863-de02f394f5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:05.114089 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-c0bf7dfe-c073-48e3-b863-de02f394f5d6 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:46:05.115314 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-c0bf7dfe-c073-48e3-b863-de02f394f5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:46:05.191119 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 432/875] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:46:05 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:46:05.214337 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a6fb5-e062-491b-ad4f-f3b85c1d1b86 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:05.329580 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a6fb5-e062-491b-ad4f-f3b85c1d1b86 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:05.337794 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:05.368373 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f2799-6353-4d01-b139-dc02db528266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:05.369041 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f2799-6353-4d01-b139-dc02db528266 None admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:05.369323 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f2799-6353-4d01-b139-dc02db528266 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:05.369597 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f2799-6353-4d01-b139-dc02db528266 None admin] PATH_INFO: `/v3/services` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:05.370395 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f2799-6353-4d01-b139-dc02db528266 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:05.371858 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f2799-6353-4d01-b139-dc02db528266 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:05.387970 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 444/876] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Jun 3 11:46:05 2022] POST /identity/v3/services => generated 269 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:46:06.455461 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b5d33-303d-43d0-8786-86e11eeb389e None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:06.456074 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b5d33-303d-43d0-8786-86e11eeb389e None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:06.456074 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b5d33-303d-43d0-8786-86e11eeb389e None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:06.457797 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 433/877] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:46:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:46:06.463774 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f50e05-d32d-4d2a-be16-0d750ef42924 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:06.464635 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f50e05-d32d-4d2a-be16-0d750ef42924 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:06.465074 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f50e05-d32d-4d2a-be16-0d750ef42924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:06.482879 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-30f50e05-d32d-4d2a-be16-0d750ef42924 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:46:06.484312 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-30f50e05-d32d-4d2a-be16-0d750ef42924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:46:06.567615 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 445/878] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:46:06 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 11:46:06.584719 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b5d33-303d-43d0-8786-86e11eeb389e None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:06.596568 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:06.690679 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b5d33-303d-43d0-8786-86e11eeb389e None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:06.725830 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50295604-5b30-4770-b519-36d2dfef8833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:06.726874 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50295604-5b30-4770-b519-36d2dfef8833 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:06.727306 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50295604-5b30-4770-b519-36d2dfef8833 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:06.727759 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50295604-5b30-4770-b519-36d2dfef8833 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:06.728554 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50295604-5b30-4770-b519-36d2dfef8833 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:06.730066 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50295604-5b30-4770-b519-36d2dfef8833 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:06.742669 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-50295604-5b30-4770-b519-36d2dfef8833 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 11:46:06.742669 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:06.742669 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 11:46:06.742669 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 11:46:06.742669 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 11:46:06.742669 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 11:46:06.742669 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 11:46:06.742669 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:46:06.742669 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 11:46:06.742669 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:06.742669 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 11:46:06.742669 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:06.742669 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:06.742669 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:06.742669 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:06.742669 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:06.742669 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:06.743972 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:06.743972 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:06.743972 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:06.743972 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:06.743972 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:06.743972 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:06.743972 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 11:46:06.743972 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 11:46:06.743972 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 11:46:06.743972 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 11:46:06.743972 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:06.743972 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:06.743972 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:06.743972 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:06.743972 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:06.743972 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:06.745070 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:06.745070 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:06.745070 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:06.745070 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:06.745070 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:06.745070 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:06.745070 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:06.745070 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:06.745070 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:06.745070 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:06.745070 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 11:46:06.745070 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:46:06.745070 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 11:46:06.745070 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:06.751563 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 434/879] 10.222.0.15 () {56 vars in 1126 bytes} [Fri Jun 3 11:46:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:46:06.753714 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f50e05-d32d-4d2a-be16-0d750ef42924 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:06.807410 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b8d58-6070-453d-bd51-c0ea53384eec None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:06.807739 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b8d58-6070-453d-bd51-c0ea53384eec None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:06.808028 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b8d58-6070-453d-bd51-c0ea53384eec None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:06.809653 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 435/880] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:46:06.814617 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a356942-671a-4d40-9008-80a031f83498 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:06.814907 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a356942-671a-4d40-9008-80a031f83498 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:06.815188 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a356942-671a-4d40-9008-80a031f83498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:06.832785 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-6a356942-671a-4d40-9008-80a031f83498 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:46:06.833973 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-6a356942-671a-4d40-9008-80a031f83498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:46:06.853540 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:06.863855 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f50e05-d32d-4d2a-be16-0d750ef42924 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:06.904466 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de978ab-4444-48a1-8a48-65233ae572d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:06.904466 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de978ab-4444-48a1-8a48-65233ae572d4 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:06.904466 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de978ab-4444-48a1-8a48-65233ae572d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:06.904466 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de978ab-4444-48a1-8a48-65233ae572d4 None admin] PATH_INFO: `/v3/services` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:06.905002 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de978ab-4444-48a1-8a48-65233ae572d4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:06.905568 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de978ab-4444-48a1-8a48-65233ae572d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:06.908479 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de978ab-4444-48a1-8a48-65233ae572d4 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:06.909061 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 436/881] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:46:06 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 11:46:06.914412 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 446/882] 10.222.0.15 () {56 vars in 1122 bytes} [Fri Jun 3 11:46:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:06.923055 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a356942-671a-4d40-9008-80a031f83498 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:06.932260 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:06.933085 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de978ab-4444-48a1-8a48-65233ae572d4 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:07.046950 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a356942-671a-4d40-9008-80a031f83498 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:07.050201 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de978ab-4444-48a1-8a48-65233ae572d4 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:07.085611 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666cafb-0d3b-477f-b283-ae07f4c54806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:07.086055 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a325281-e745-444d-9f85-84f1974b1621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:07.086533 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666cafb-0d3b-477f-b283-ae07f4c54806 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:07.086966 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666cafb-0d3b-477f-b283-ae07f4c54806 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:07.087317 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a325281-e745-444d-9f85-84f1974b1621 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:07.087440 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666cafb-0d3b-477f-b283-ae07f4c54806 None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:07.087952 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a325281-e745-444d-9f85-84f1974b1621 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:07.088145 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666cafb-0d3b-477f-b283-ae07f4c54806 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:07.088526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a325281-e745-444d-9f85-84f1974b1621 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:07.088796 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666cafb-0d3b-477f-b283-ae07f4c54806 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:07.089389 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a325281-e745-444d-9f85-84f1974b1621 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:07.090482 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666cafb-0d3b-477f-b283-ae07f4c54806 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:07.090957 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a325281-e745-444d-9f85-84f1974b1621 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:07.097383 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 437/883] 10.222.0.15 () {56 vars in 1122 bytes} [Fri Jun 3 11:46:06 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:46:07.104339 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-9a325281-e745-444d-9f85-84f1974b1621 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 11:46:07.104339 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:07.104339 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 11:46:07.104339 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 11:46:07.104339 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 11:46:07.104339 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 11:46:07.104339 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 11:46:07.104339 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:46:07.104339 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 11:46:07.104339 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:07.104339 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 11:46:07.104339 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:07.104339 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:07.104339 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:07.104339 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:07.104339 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:07.104339 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:07.105432 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:07.105432 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:07.105432 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:07.105432 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:07.105432 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:07.105432 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:07.105432 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 11:46:07.105432 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 11:46:07.105432 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 11:46:07.105432 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 11:46:07.105432 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:07.105432 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:07.105432 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:07.105432 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:07.105432 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:07.105432 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:07.106286 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:07.106286 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:07.106286 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:07.106286 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:07.106286 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:07.106286 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:07.106286 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:07.106286 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:07.106286 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:07.106286 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:07.106286 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 11:46:07.106286 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:46:07.106286 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 11:46:07.106286 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:07.109539 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 447/884] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Jun 3 11:46:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:46:07.116205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666cafb-0d3b-477f-b283-ae07f4c54806 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:07.196452 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:07.236197 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666cafb-0d3b-477f-b283-ae07f4c54806 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:07.276569 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2403856-cd72-4d5c-80f7-c2c28a2274af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:07.277254 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2403856-cd72-4d5c-80f7-c2c28a2274af None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:07.277541 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2403856-cd72-4d5c-80f7-c2c28a2274af None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:07.277820 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2403856-cd72-4d5c-80f7-c2c28a2274af None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:07.278550 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2403856-cd72-4d5c-80f7-c2c28a2274af None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:07.278860 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2403856-cd72-4d5c-80f7-c2c28a2274af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:07.280279 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2403856-cd72-4d5c-80f7-c2c28a2274af None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:07.286276 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 438/885] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Jun 3 11:46:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:07.291910 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a325281-e745-444d-9f85-84f1974b1621 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:07.317972 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:07.408934 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a325281-e745-444d-9f85-84f1974b1621 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:07.448231 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e48d6-4d3c-4638-abb7-24db3e056582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:07.449272 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e48d6-4d3c-4638-abb7-24db3e056582 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:07.449990 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e48d6-4d3c-4638-abb7-24db3e056582 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:07.450550 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e48d6-4d3c-4638-abb7-24db3e056582 None admin] PATH_INFO: `/v3/services` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:07.451472 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e48d6-4d3c-4638-abb7-24db3e056582 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:07.452004 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e48d6-4d3c-4638-abb7-24db3e056582 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:07.453583 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e48d6-4d3c-4638-abb7-24db3e056582 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:07.460473 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 448/886] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Jun 3 11:46:07 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:07.461384 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f875f-48d3-4cf4-bcc4-ac13cd35ff02 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:07.461825 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f875f-48d3-4cf4-bcc4-ac13cd35ff02 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:07.462007 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f875f-48d3-4cf4-bcc4-ac13cd35ff02 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:07.463303 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 439/887] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:46:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:46:07.465993 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e48d6-4d3c-4638-abb7-24db3e056582 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:07.468963 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2552d-fcee-4e05-b61e-3386a9b618c3 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:07.469484 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2552d-fcee-4e05-b61e-3386a9b618c3 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:07.470053 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2552d-fcee-4e05-b61e-3386a9b618c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:07.487393 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-96f2552d-fcee-4e05-b61e-3386a9b618c3 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:46:07.488918 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-96f2552d-fcee-4e05-b61e-3386a9b618c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:46:07.557092 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:07.564646 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 440/888] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:46:07 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 11:46:07.576032 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e48d6-4d3c-4638-abb7-24db3e056582 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:07.586459 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f2552d-fcee-4e05-b61e-3386a9b618c3 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:07.612568 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75871ad-c9a5-4820-b1ce-4b1e8ae8f7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:07.613602 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75871ad-c9a5-4820-b1ce-4b1e8ae8f7b4 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:07.614123 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75871ad-c9a5-4820-b1ce-4b1e8ae8f7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:07.614542 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75871ad-c9a5-4820-b1ce-4b1e8ae8f7b4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:07.615483 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75871ad-c9a5-4820-b1ce-4b1e8ae8f7b4 None admin] RBAC: Adding query filter params (interface=public, service_id=26325623077e4cc5b52913234dc1db86, region_id=RegionOne) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:07.615961 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75871ad-c9a5-4820-b1ce-4b1e8ae8f7b4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:07.617677 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75871ad-c9a5-4820-b1ce-4b1e8ae8f7b4 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:07.626707 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 449/889] 10.222.0.15 () {56 vars in 1251 bytes} [Fri Jun 3 11:46:07 2022] GET /identity/v3/endpoints?service_id=26325623077e4cc5b52913234dc1db86&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:46:07.635670 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75871ad-c9a5-4820-b1ce-4b1e8ae8f7b4 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:07.652502 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:07.698537 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f2552d-fcee-4e05-b61e-3386a9b618c3 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:07.732859 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a1ae0-aa74-457e-b5a0-a8112198e2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:07.733671 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a1ae0-aa74-457e-b5a0-a8112198e2eb None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:07.733955 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a1ae0-aa74-457e-b5a0-a8112198e2eb None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:07.734229 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a1ae0-aa74-457e-b5a0-a8112198e2eb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:07.743376 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75871ad-c9a5-4820-b1ce-4b1e8ae8f7b4 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:07.745133 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267a1ae0-aa74-457e-b5a0-a8112198e2eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:46:07.753947 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-267a1ae0-aa74-457e-b5a0-a8112198e2eb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 11:46:07.753947 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:07.753947 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:07.753947 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:07.753947 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:07.753947 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:07.753947 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:07.753947 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:07.753947 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:07.753947 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:07.753947 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:07.753947 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:07.753947 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:46:07.753947 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:46:07.753947 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:46:07.753947 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:46:07.754929 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:46:07.754929 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:46:07.754929 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:46:07.754929 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:46:07.754929 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:07.754929 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:07.754929 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:07.754929 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:07.754929 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:07.754929 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:07.754929 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:07.754929 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:07.754929 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:07.754929 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:07.754929 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:07.754929 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:07.755859 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:07.755859 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:07.755859 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:07.755859 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:07.755859 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:46:07.755859 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:46:07.755859 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:46:07.755859 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:46:07.755859 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:46:07.755859 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:46:07.755859 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 11:46:07.755859 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:07.760079 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 441/890] 10.222.0.15 () {56 vars in 1120 bytes} [Fri Jun 3 11:46:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:46:07.761195 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b0d6b-37ad-41c4-9bd5-df51bca61c50 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:07.761483 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b0d6b-37ad-41c4-9bd5-df51bca61c50 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:07.761766 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b0d6b-37ad-41c4-9bd5-df51bca61c50 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:07.763548 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 442/891] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:46:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:46:07.763747 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b0d6b-37ad-41c4-9bd5-df51bca61c50 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:07.787175 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab58def-31f3-4d88-89aa-5ee4ed041bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:07.788113 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab58def-31f3-4d88-89aa-5ee4ed041bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:07.788564 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab58def-31f3-4d88-89aa-5ee4ed041bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:07.789113 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab58def-31f3-4d88-89aa-5ee4ed041bf8 None admin] PATH_INFO: `/v3/services` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:07.790055 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab58def-31f3-4d88-89aa-5ee4ed041bf8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:07.791606 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab58def-31f3-4d88-89aa-5ee4ed041bf8 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:07.799673 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 450/892] 10.222.0.15 () {56 vars in 1087 bytes} [Fri Jun 3 11:46:07 2022] GET /identity/v3/services => generated 1268 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:46:07.800965 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29a1eb-9fd5-4aa2-ac6c-d5e22fe984f7 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:07.801259 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29a1eb-9fd5-4aa2-ac6c-d5e22fe984f7 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:07.801548 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29a1eb-9fd5-4aa2-ac6c-d5e22fe984f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:07.825928 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-eb29a1eb-9fd5-4aa2-ac6c-d5e22fe984f7 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:46:07.827732 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-eb29a1eb-9fd5-4aa2-ac6c-d5e22fe984f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:46:07.836777 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:07.903883 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b0d6b-37ad-41c4-9bd5-df51bca61c50 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:07.927659 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 451/893] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:46:07 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:46:07.946578 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:07.951609 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29a1eb-9fd5-4aa2-ac6c-d5e22fe984f7 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:07.958882 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574678ac-1821-46ec-81c1-26b49fb602dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:07.959604 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574678ac-1821-46ec-81c1-26b49fb602dd None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:07.960003 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574678ac-1821-46ec-81c1-26b49fb602dd None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:07.960282 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574678ac-1821-46ec-81c1-26b49fb602dd None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:07.961057 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574678ac-1821-46ec-81c1-26b49fb602dd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:07.961364 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574678ac-1821-46ec-81c1-26b49fb602dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:07.963371 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574678ac-1821-46ec-81c1-26b49fb602dd None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:07.980546 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 443/894] 10.222.0.15 () {56 vars in 1115 bytes} [Fri Jun 3 11:46:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:07.983416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574678ac-1821-46ec-81c1-26b49fb602dd None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:08.078908 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29a1eb-9fd5-4aa2-ac6c-d5e22fe984f7 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:08.104605 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574678ac-1821-46ec-81c1-26b49fb602dd None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:08.122716 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27af408-a4b5-47a1-a728-69fca331f18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:08.123885 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27af408-a4b5-47a1-a728-69fca331f18d None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:08.124374 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27af408-a4b5-47a1-a728-69fca331f18d None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:08.124870 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27af408-a4b5-47a1-a728-69fca331f18d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:08.125916 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27af408-a4b5-47a1-a728-69fca331f18d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:08.128181 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27af408-a4b5-47a1-a728-69fca331f18d None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:08.141697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-e27af408-a4b5-47a1-a728-69fca331f18d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 11:46:08.141697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:08.141697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 11:46:08.141697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 11:46:08.141697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 11:46:08.141697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 11:46:08.141697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 11:46:08.141697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:46:08.141697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 11:46:08.141697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:08.141697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 11:46:08.141697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:08.141697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:08.141697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:08.141697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:08.141697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:08.143168 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:08.143168 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:08.143168 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:08.143168 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:08.143168 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:08.143168 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:08.143168 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:08.143168 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 11:46:08.143168 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 11:46:08.143168 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 11:46:08.143168 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 11:46:08.143168 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:08.143168 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:08.143168 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:08.143168 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:08.143168 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:08.144036 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:08.144036 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:08.144036 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:08.144036 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:08.144036 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:08.144036 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:08.144036 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:08.144036 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:08.144036 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:08.144036 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:08.144036 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:08.144036 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 11:46:08.144036 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:46:08.144036 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 11:46:08.144036 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:08.146757 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 452/895] 10.222.0.15 () {56 vars in 1132 bytes} [Fri Jun 3 11:46:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:46:08.147723 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff5ba0-2f40-4b06-9473-e113ab883b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:08.148699 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff5ba0-2f40-4b06-9473-e113ab883b39 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:08.149122 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff5ba0-2f40-4b06-9473-e113ab883b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:08.149583 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff5ba0-2f40-4b06-9473-e113ab883b39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:08.153041 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27af408-a4b5-47a1-a728-69fca331f18d None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:08.163685 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff5ba0-2f40-4b06-9473-e113ab883b39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:08.165188 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff5ba0-2f40-4b06-9473-e113ab883b39 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:08.168963 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:08.184956 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-53ff5ba0-2f40-4b06-9473-e113ab883b39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:46:08.184956 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:08.184956 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:08.184956 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:08.184956 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:08.184956 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:08.184956 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:08.184956 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:08.184956 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:08.184956 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:08.184956 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:08.184956 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:08.184956 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:46:08.184956 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:46:08.184956 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:46:08.185886 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:46:08.185886 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:08.185886 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:08.185886 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:08.185886 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:08.185886 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:08.185886 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:08.185886 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:08.185886 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:08.185886 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:08.185886 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:08.185886 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:08.185886 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:08.185886 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:08.185886 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:08.185886 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:08.185886 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:08.186793 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:46:08.186793 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:46:08.186793 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:46:08.186793 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:08.186793 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 444/896] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:46:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:46:08.192114 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff5ba0-2f40-4b06-9473-e113ab883b39 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:08.228814 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:08.292712 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27af408-a4b5-47a1-a728-69fca331f18d None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:08.307231 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff5ba0-2f40-4b06-9473-e113ab883b39 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:08.341314 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2eeef1-31f3-433b-a736-41b8bd643004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:08.342219 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2eeef1-31f3-433b-a736-41b8bd643004 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:08.342650 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2eeef1-31f3-433b-a736-41b8bd643004 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:08.343095 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2eeef1-31f3-433b-a736-41b8bd643004 None admin] PATH_INFO: `/v3/services` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:08.344132 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2eeef1-31f3-433b-a736-41b8bd643004 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:08.344587 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2eeef1-31f3-433b-a736-41b8bd643004 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:08.345723 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8967350-150e-47f3-895f-2ad372d98cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:08.346484 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8967350-150e-47f3-895f-2ad372d98cb9 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:08.346909 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8967350-150e-47f3-895f-2ad372d98cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:08.347160 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2eeef1-31f3-433b-a736-41b8bd643004 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:08.347360 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8967350-150e-47f3-895f-2ad372d98cb9 None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:08.348263 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8967350-150e-47f3-895f-2ad372d98cb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:08.348671 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8967350-150e-47f3-895f-2ad372d98cb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:08.350166 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8967350-150e-47f3-895f-2ad372d98cb9 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:08.354492 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 453/897] 10.222.0.15 () {56 vars in 1126 bytes} [Fri Jun 3 11:46:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:46:08.361177 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2eeef1-31f3-433b-a736-41b8bd643004 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:08.370513 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 445/898] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:46:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:08.371626 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8967350-150e-47f3-895f-2ad372d98cb9 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:08.443877 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:08.470821 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2eeef1-31f3-433b-a736-41b8bd643004 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:08.494555 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:08.504799 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8967350-150e-47f3-895f-2ad372d98cb9 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:08.506943 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542866a-1418-48f7-bcf5-e88383fe2c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:08.508252 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542866a-1418-48f7-bcf5-e88383fe2c7c None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:08.508252 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542866a-1418-48f7-bcf5-e88383fe2c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:08.508651 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542866a-1418-48f7-bcf5-e88383fe2c7c None admin] PATH_INFO: `/v3/services` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:08.509454 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6542866a-1418-48f7-bcf5-e88383fe2c7c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:08.509873 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6542866a-1418-48f7-bcf5-e88383fe2c7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:08.511338 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6542866a-1418-48f7-bcf5-e88383fe2c7c None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:08.521348 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 454/899] 10.222.0.15 () {56 vars in 1126 bytes} [Fri Jun 3 11:46:08 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:08.522537 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542866a-1418-48f7-bcf5-e88383fe2c7c None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:08.549313 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fdcbc8-789a-44d9-a43f-fa1765575706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:08.550178 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fdcbc8-789a-44d9-a43f-fa1765575706 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:08.550459 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fdcbc8-789a-44d9-a43f-fa1765575706 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:08.550730 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fdcbc8-789a-44d9-a43f-fa1765575706 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:08.558540 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fdcbc8-789a-44d9-a43f-fa1765575706 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:08.560093 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fdcbc8-789a-44d9-a43f-fa1765575706 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:08.576447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-44fdcbc8-789a-44d9-a43f-fa1765575706 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 11:46:08.576447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:08.576447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:08.576447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:08.576447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:08.576447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:08.576447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:08.576447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:08.576447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:08.576447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:08.576447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:08.576447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:08.576447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 11:46:08.576447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 11:46:08.576447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 11:46:08.576447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 11:46:08.577448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:08.577448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:08.577448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 11:46:08.577448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:46:08.577448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 11:46:08.577448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:46:08.577448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:08.577448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:08.577448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:08.577448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:08.577448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:08.577448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:08.577448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:08.577448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:08.577448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:08.577448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:08.577448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:08.577448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:08.578392 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:08.578392 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:08.578392 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 11:46:08.578392 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 11:46:08.578392 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 11:46:08.578392 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 11:46:08.578392 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 11:46:08.578392 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 11:46:08.578392 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 11:46:08.578392 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:08.583684 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 446/900] 10.222.0.15 () {56 vars in 1117 bytes} [Fri Jun 3 11:46:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:46:08.584665 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fdcbc8-789a-44d9-a43f-fa1765575706 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:08.644843 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542866a-1418-48f7-bcf5-e88383fe2c7c None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:08.680618 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14149767-7799-49bd-b7e4-51a44bfd425f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:08.681829 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14149767-7799-49bd-b7e4-51a44bfd425f None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:08.682344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14149767-7799-49bd-b7e4-51a44bfd425f None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:08.682823 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14149767-7799-49bd-b7e4-51a44bfd425f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:08.683931 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14149767-7799-49bd-b7e4-51a44bfd425f None admin] RBAC: Adding query filter params (interface=public, service_id=a8e0e714ab1c47f6b2e6a8abe422c611, region_id=RegionOne) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:08.684442 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14149767-7799-49bd-b7e4-51a44bfd425f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:08.690306 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14149767-7799-49bd-b7e4-51a44bfd425f None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:08.692400 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:08.696926 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fdcbc8-789a-44d9-a43f-fa1765575706 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:08.701729 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 455/901] 10.222.0.15 () {56 vars in 1251 bytes} [Fri Jun 3 11:46:08 2022] GET /identity/v3/endpoints?service_id=a8e0e714ab1c47f6b2e6a8abe422c611&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:46:08.702783 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14149767-7799-49bd-b7e4-51a44bfd425f None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:08.736594 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222911e-8c73-4966-8108-1be1f7b6880a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:08.737340 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222911e-8c73-4966-8108-1be1f7b6880a None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:08.737699 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222911e-8c73-4966-8108-1be1f7b6880a None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:08.738038 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222911e-8c73-4966-8108-1be1f7b6880a None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:08.738929 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4222911e-8c73-4966-8108-1be1f7b6880a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:08.739306 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4222911e-8c73-4966-8108-1be1f7b6880a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:08.740950 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4222911e-8c73-4966-8108-1be1f7b6880a None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:08.764555 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 447/902] 10.222.0.15 () {56 vars in 1149 bytes} [Fri Jun 3 11:46:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:08.765612 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222911e-8c73-4966-8108-1be1f7b6880a None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:08.781403 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:08.820034 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14149767-7799-49bd-b7e4-51a44bfd425f None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:08.865155 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70188d-e3af-4407-a914-7b49212a56b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:08.866350 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70188d-e3af-4407-a914-7b49212a56b5 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:08.866711 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70188d-e3af-4407-a914-7b49212a56b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:08.867065 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70188d-e3af-4407-a914-7b49212a56b5 None admin] PATH_INFO: `/v3/services` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:08.868139 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e70188d-e3af-4407-a914-7b49212a56b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:08.869734 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e70188d-e3af-4407-a914-7b49212a56b5 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:08.883538 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 456/903] 10.222.0.15 () {56 vars in 1087 bytes} [Fri Jun 3 11:46:08 2022] GET /identity/v3/services => generated 1268 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:46:08.883736 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222911e-8c73-4966-8108-1be1f7b6880a None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:08.925303 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf3cad3-f7ab-4ca6-a3d3-93e04de6acf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:08.926252 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3cad3-f7ab-4ca6-a3d3-93e04de6acf6 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:08.926541 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3cad3-f7ab-4ca6-a3d3-93e04de6acf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:08.926813 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3cad3-f7ab-4ca6-a3d3-93e04de6acf6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:09.014560 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf3cad3-f7ab-4ca6-a3d3-93e04de6acf6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:09.016115 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf3cad3-f7ab-4ca6-a3d3-93e04de6acf6 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:09.049641 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:09.135231 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 448/904] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:46:08 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 11:46:09.140929 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70188d-e3af-4407-a914-7b49212a56b5 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:09.206927 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:09.249249 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70188d-e3af-4407-a914-7b49212a56b5 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:09.286082 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554eca4-096f-4553-99e4-ebb9b9d87410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:09.286930 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554eca4-096f-4553-99e4-ebb9b9d87410 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:09.287266 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554eca4-096f-4553-99e4-ebb9b9d87410 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:09.287572 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554eca4-096f-4553-99e4-ebb9b9d87410 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:09.298514 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b554eca4-096f-4553-99e4-ebb9b9d87410 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:09.299999 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b554eca4-096f-4553-99e4-ebb9b9d87410 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:09.317687 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-b554eca4-096f-4553-99e4-ebb9b9d87410 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:46:09.317687 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:09.317687 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:09.317687 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:09.317687 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:09.317687 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:09.317687 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:09.317687 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:09.317687 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:09.317687 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:09.317687 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:09.317687 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:09.317687 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:46:09.317687 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:46:09.317687 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:46:09.318601 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:46:09.318601 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:09.318601 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:09.318601 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:09.318601 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:09.318601 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:09.318601 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:09.318601 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:09.318601 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:09.318601 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:09.318601 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:09.318601 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:09.318601 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:09.318601 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:09.318601 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:09.318601 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:09.318601 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:09.319488 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:46:09.319488 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:46:09.319488 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:46:09.319488 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:09.319488 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 457/905] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:46:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:46:09.324635 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf3cad3-f7ab-4ca6-a3d3-93e04de6acf6 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:09.428055 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf3cad3-f7ab-4ca6-a3d3-93e04de6acf6 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:09.442545 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:09.452614 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e38049-ee61-48f7-803a-e6a57054c84c None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:09.452614 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e38049-ee61-48f7-803a-e6a57054c84c None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:09.452614 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e38049-ee61-48f7-803a-e6a57054c84c None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:09.452614 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 458/906] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 11:46:09.456399 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d540e-9195-456f-9f29-37f0a537a2d0 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:09.456685 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d540e-9195-456f-9f29-37f0a537a2d0 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:09.457016 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d540e-9195-456f-9f29-37f0a537a2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:09.466809 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896baf0b-25d1-4f7e-b4a6-b49a44aa160e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:09.467482 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896baf0b-25d1-4f7e-b4a6-b49a44aa160e None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:09.467807 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896baf0b-25d1-4f7e-b4a6-b49a44aa160e None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:09.468091 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896baf0b-25d1-4f7e-b4a6-b49a44aa160e None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:09.468819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896baf0b-25d1-4f7e-b4a6-b49a44aa160e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:09.469132 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896baf0b-25d1-4f7e-b4a6-b49a44aa160e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:09.470864 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896baf0b-25d1-4f7e-b4a6-b49a44aa160e None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:09.474086 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-0c2d540e-9195-456f-9f29-37f0a537a2d0 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:46:09.475265 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-0c2d540e-9195-456f-9f29-37f0a537a2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:46:09.483460 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 449/907] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:46:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:09.488611 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896baf0b-25d1-4f7e-b4a6-b49a44aa160e None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:09.559840 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 459/908] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:46:09 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 11:46:09.575670 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d540e-9195-456f-9f29-37f0a537a2d0 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:09.597312 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896baf0b-25d1-4f7e-b4a6-b49a44aa160e None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:09.624594 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:09.633803 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07ce92-ddde-4b1c-90d0-4a8603340dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:09.634663 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07ce92-ddde-4b1c-90d0-4a8603340dfc None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:09.634882 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07ce92-ddde-4b1c-90d0-4a8603340dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:09.635162 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07ce92-ddde-4b1c-90d0-4a8603340dfc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:09.643161 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e07ce92-ddde-4b1c-90d0-4a8603340dfc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:09.644591 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e07ce92-ddde-4b1c-90d0-4a8603340dfc None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:09.659065 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-2e07ce92-ddde-4b1c-90d0-4a8603340dfc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:46:09.659065 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:09.659065 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:09.659065 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:09.659065 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:09.659065 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:09.659065 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:09.659065 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:09.659065 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:09.659065 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:09.659065 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:09.659065 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:09.659065 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 11:46:09.659065 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 11:46:09.659065 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 11:46:09.660041 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 11:46:09.660041 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:09.660041 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:09.660041 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:09.660041 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:09.660041 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:09.660041 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:09.660041 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:09.660041 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:09.660041 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:09.660041 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:09.660041 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:09.660041 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:09.660041 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:09.660041 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:09.660041 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:09.660041 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:09.666262 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 11:46:09.666262 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 11:46:09.666262 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 11:46:09.666262 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 11:46:09.666262 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 11:46:09.666262 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 11:46:09.666262 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:46:09.666262 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:09.666262 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 450/909] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:46:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:46:09.666262 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07ce92-ddde-4b1c-90d0-4a8603340dfc None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:09.698783 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d540e-9195-456f-9f29-37f0a537a2d0 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:09.710961 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:09.746864 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7fccaa-6e75-4544-a883-464cf461620c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:09.748119 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7fccaa-6e75-4544-a883-464cf461620c None admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:09.748641 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7fccaa-6e75-4544-a883-464cf461620c None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:09.749210 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7fccaa-6e75-4544-a883-464cf461620c None admin] PATH_INFO: `/v3/services` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:09.750245 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7fccaa-6e75-4544-a883-464cf461620c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:09.752554 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7fccaa-6e75-4544-a883-464cf461620c None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:09.774172 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 460/910] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Jun 3 11:46:09 2022] POST /identity/v3/services => generated 241 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 11:46:09.807288 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07ce92-ddde-4b1c-90d0-4a8603340dfc None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:09.853183 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a77fd-ea44-4975-a2d0-be0c9f8f88ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:09.854123 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a77fd-ea44-4975-a2d0-be0c9f8f88ae None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:09.854618 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a77fd-ea44-4975-a2d0-be0c9f8f88ae None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:09.855044 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a77fd-ea44-4975-a2d0-be0c9f8f88ae None admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:09.856097 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a77fd-ea44-4975-a2d0-be0c9f8f88ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:09.856586 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a77fd-ea44-4975-a2d0-be0c9f8f88ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:09.858239 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a77fd-ea44-4975-a2d0-be0c9f8f88ae None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:09.879295 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 451/911] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 3 11:46:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:09.885739 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7fccaa-6e75-4544-a883-464cf461620c None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:09.998802 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7fccaa-6e75-4544-a883-464cf461620c None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:10.002584 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:10.038755 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531c1da-bcd7-4a53-8501-dbe46e411514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:10.039416 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531c1da-bcd7-4a53-8501-dbe46e411514 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:10.039725 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531c1da-bcd7-4a53-8501-dbe46e411514 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:10.040002 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531c1da-bcd7-4a53-8501-dbe46e411514 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:10.040829 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4531c1da-bcd7-4a53-8501-dbe46e411514 None admin] RBAC: Adding query filter params (role.id=4e916858113d4ed5bf93f9e457387f15, scope.project.id=cff223ee05524cf4bf3591fc5a39559e, user.id=a55cbe88e78e4f3a82b8703a3b1804e5) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:10.041139 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4531c1da-bcd7-4a53-8501-dbe46e411514 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:10.042693 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4531c1da-bcd7-4a53-8501-dbe46e411514 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:10.049192 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 461/912] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:46:09 2022] GET /identity/v3/role_assignments?user.id=a55cbe88e78e4f3a82b8703a3b1804e5&scope.project.id=cff223ee05524cf4bf3591fc5a39559e&role.id=4e916858113d4ed5bf93f9e457387f15 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:10.154523 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3f868-267a-425c-9bbf-945448e1b655 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:10.154882 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3f868-267a-425c-9bbf-945448e1b655 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:10.155069 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3f868-267a-425c-9bbf-945448e1b655 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:10.156758 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 452/913] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:46:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:46:10.164268 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8281c-b159-4df0-8319-ebf4e91507a6 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:10.164703 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8281c-b159-4df0-8319-ebf4e91507a6 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:10.165077 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8281c-b159-4df0-8319-ebf4e91507a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:10.184024 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-c0c8281c-b159-4df0-8319-ebf4e91507a6 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:46:10.185338 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-c0c8281c-b159-4df0-8319-ebf4e91507a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:46:10.267195 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 462/914] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:46:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:46:10.290161 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3f868-267a-425c-9bbf-945448e1b655 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:10.392718 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:10.406695 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3f868-267a-425c-9bbf-945448e1b655 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:10.443273 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cec7cd-d073-4815-adf0-8c9e085bd4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:10.444104 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cec7cd-d073-4815-adf0-8c9e085bd4ee None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:10.444390 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cec7cd-d073-4815-adf0-8c9e085bd4ee None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:10.444670 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cec7cd-d073-4815-adf0-8c9e085bd4ee None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:10.445321 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cec7cd-d073-4815-adf0-8c9e085bd4ee None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:10.446753 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cec7cd-d073-4815-adf0-8c9e085bd4ee None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:10.459194 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-a1cec7cd-d073-4815-adf0-8c9e085bd4ee None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 11:46:10.459194 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:10.459194 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 11:46:10.459194 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 11:46:10.459194 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 11:46:10.459194 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 11:46:10.459194 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 11:46:10.459194 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:46:10.459194 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 11:46:10.459194 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:10.459194 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 11:46:10.459194 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:10.459194 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:10.459194 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:10.459194 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:10.459194 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:10.459194 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:10.460241 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:10.460241 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:10.460241 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:10.460241 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:10.460241 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:10.460241 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:10.460241 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 11:46:10.460241 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 11:46:10.460241 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 11:46:10.460241 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 11:46:10.460241 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:10.460241 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:10.460241 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:10.460241 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:10.460241 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:10.460241 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:10.461797 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:10.461797 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:10.461797 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:10.461797 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:10.461797 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:10.461797 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:10.461797 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:10.461797 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:10.461797 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:10.461797 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:10.461797 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 11:46:10.461797 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:46:10.461797 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 03 11:46:10.461797 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:10.461797 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 453/915] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Jun 3 11:46:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:46:10.468590 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8281c-b159-4df0-8319-ebf4e91507a6 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:10.573622 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:10.577620 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8281c-b159-4df0-8319-ebf4e91507a6 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:10.618121 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284148de-2dc5-4e3b-a758-54d17aaf04f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:10.618796 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284148de-2dc5-4e3b-a758-54d17aaf04f2 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:10.619080 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284148de-2dc5-4e3b-a758-54d17aaf04f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:10.619361 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284148de-2dc5-4e3b-a758-54d17aaf04f2 None admin] PATH_INFO: `/v3/services` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:10.620108 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284148de-2dc5-4e3b-a758-54d17aaf04f2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:10.620417 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284148de-2dc5-4e3b-a758-54d17aaf04f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:10.621795 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284148de-2dc5-4e3b-a758-54d17aaf04f2 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:10.627257 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 463/916] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Jun 3 11:46:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:10.633043 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cec7cd-d073-4815-adf0-8c9e085bd4ee None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:10.746626 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cec7cd-d073-4815-adf0-8c9e085bd4ee None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:10.783416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d63690-2e85-4558-8d34-337f38181bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:10.784112 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d63690-2e85-4558-8d34-337f38181bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:10.784406 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d63690-2e85-4558-8d34-337f38181bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:10.784684 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d63690-2e85-4558-8d34-337f38181bd5 None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:10.785392 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d63690-2e85-4558-8d34-337f38181bd5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:10.785700 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d63690-2e85-4558-8d34-337f38181bd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:10.787081 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d63690-2e85-4558-8d34-337f38181bd5 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:10.792595 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 454/917] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Jun 3 11:46:10 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:10.797885 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284148de-2dc5-4e3b-a758-54d17aaf04f2 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:10.911864 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284148de-2dc5-4e3b-a758-54d17aaf04f2 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:10.952117 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64574d71-63ce-45e7-a26a-fbe3533ff370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:10.952785 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64574d71-63ce-45e7-a26a-fbe3533ff370 None admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:10.953072 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64574d71-63ce-45e7-a26a-fbe3533ff370 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:10.953351 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64574d71-63ce-45e7-a26a-fbe3533ff370 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:10.954149 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64574d71-63ce-45e7-a26a-fbe3533ff370 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:10.955563 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64574d71-63ce-45e7-a26a-fbe3533ff370 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:10.980188 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 464/918] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Jun 3 11:46:10 2022] POST /identity/v3/endpoints => generated 346 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:46:11.261790 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e3851-24c0-4e87-9e30-557336730156 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:11.261985 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e3851-24c0-4e87-9e30-557336730156 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:11.262257 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e3851-24c0-4e87-9e30-557336730156 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:11.263889 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 455/919] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:46:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:46:11.269938 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36785f-5ee6-4068-8ebc-6bd406435a3d None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:11.270247 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36785f-5ee6-4068-8ebc-6bd406435a3d None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:11.270535 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36785f-5ee6-4068-8ebc-6bd406435a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:11.288732 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-9e36785f-5ee6-4068-8ebc-6bd406435a3d None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:46:11.289926 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-9e36785f-5ee6-4068-8ebc-6bd406435a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:46:11.304146 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:11.368940 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 465/920] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:46:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:46:11.391331 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e3851-24c0-4e87-9e30-557336730156 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:11.412670 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:11.500542 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e3851-24c0-4e87-9e30-557336730156 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:11.541539 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b110e9-87df-4db5-95de-4629ea86f983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:11.542275 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b110e9-87df-4db5-95de-4629ea86f983 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:11.542561 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b110e9-87df-4db5-95de-4629ea86f983 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:11.542838 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b110e9-87df-4db5-95de-4629ea86f983 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:11.543486 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b110e9-87df-4db5-95de-4629ea86f983 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:11.544880 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b110e9-87df-4db5-95de-4629ea86f983 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:11.557114 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-c8b110e9-87df-4db5-95de-4629ea86f983 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 11:46:11.557114 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:11.557114 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 11:46:11.557114 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 11:46:11.557114 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 11:46:11.557114 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 11:46:11.557114 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 11:46:11.557114 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:46:11.557114 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 11:46:11.557114 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:11.557114 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 11:46:11.557114 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:11.557114 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:11.557114 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:11.557114 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:11.557114 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:11.558054 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:11.558054 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:11.558054 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:11.558054 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:11.558054 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:11.558054 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:11.558054 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:11.558054 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 11:46:11.558054 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 11:46:11.558054 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 11:46:11.558054 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 11:46:11.558054 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:11.558054 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:11.558054 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:11.558054 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:11.558054 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:11.558881 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:11.558881 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:11.558881 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:11.558881 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:11.558881 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:11.558881 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:11.558881 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:11.558881 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:11.558881 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:11.558881 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:11.558881 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:11.558881 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 11:46:11.558881 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:46:11.558881 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 03 11:46:11.558881 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:11.558881 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 456/921] 10.222.0.15 () {56 vars in 1132 bytes} [Fri Jun 3 11:46:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:46:11.566305 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36785f-5ee6-4068-8ebc-6bd406435a3d None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:11.672406 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36785f-5ee6-4068-8ebc-6bd406435a3d None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:11.708947 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32bf8c-75fe-4e8c-8b59-b20733547172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:11.709625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32bf8c-75fe-4e8c-8b59-b20733547172 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:11.709911 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32bf8c-75fe-4e8c-8b59-b20733547172 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:11.710242 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32bf8c-75fe-4e8c-8b59-b20733547172 None admin] PATH_INFO: `/v3/services` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:11.710964 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a32bf8c-75fe-4e8c-8b59-b20733547172 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:11.711276 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a32bf8c-75fe-4e8c-8b59-b20733547172 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:11.712710 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a32bf8c-75fe-4e8c-8b59-b20733547172 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:11.718124 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 466/922] 10.222.0.15 () {56 vars in 1126 bytes} [Fri Jun 3 11:46:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:11.723680 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b110e9-87df-4db5-95de-4629ea86f983 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:11.814795 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:11.834804 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b110e9-87df-4db5-95de-4629ea86f983 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:11.869791 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b2434-e0ba-4e74-a272-9a1543f74490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:11.870571 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b2434-e0ba-4e74-a272-9a1543f74490 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:11.870856 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b2434-e0ba-4e74-a272-9a1543f74490 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:11.871135 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b2434-e0ba-4e74-a272-9a1543f74490 None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:11.871877 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9b2434-e0ba-4e74-a272-9a1543f74490 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:11.872190 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9b2434-e0ba-4e74-a272-9a1543f74490 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:11.873628 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9b2434-e0ba-4e74-a272-9a1543f74490 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:11.879790 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 457/923] 10.222.0.15 () {56 vars in 1126 bytes} [Fri Jun 3 11:46:11 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:11.888621 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32bf8c-75fe-4e8c-8b59-b20733547172 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:11.901734 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:12.001648 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32bf8c-75fe-4e8c-8b59-b20733547172 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:12.040693 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14167245-7099-4405-ba16-b40bf4339ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:12.041703 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14167245-7099-4405-ba16-b40bf4339ad8 None admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:12.042216 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14167245-7099-4405-ba16-b40bf4339ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:12.042697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14167245-7099-4405-ba16-b40bf4339ad8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:12.043678 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14167245-7099-4405-ba16-b40bf4339ad8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:12.045275 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14167245-7099-4405-ba16-b40bf4339ad8 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:12.070162 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 467/924] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Jun 3 11:46:11 2022] POST /identity/v3/endpoints => generated 347 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:46:12.251764 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935807c-7ac6-4889-a11d-b3195291d96a None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:12.252114 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935807c-7ac6-4889-a11d-b3195291d96a None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:12.252339 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935807c-7ac6-4889-a11d-b3195291d96a None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:12.253986 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 458/925] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:46:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:46:12.260134 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d5e66-b04b-4d6b-8ab4-518060bb4445 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:12.260430 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d5e66-b04b-4d6b-8ab4-518060bb4445 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:12.260718 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d5e66-b04b-4d6b-8ab4-518060bb4445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:12.277991 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-659d5e66-b04b-4d6b-8ab4-518060bb4445 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:46:12.279181 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-659d5e66-b04b-4d6b-8ab4-518060bb4445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:46:12.343378 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:12.359535 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 468/926] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:46:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:46:12.382607 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935807c-7ac6-4889-a11d-b3195291d96a None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:12.413632 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccfd3d9-4a93-413b-b3b6-ce69a95c9dfa None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:12.413969 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccfd3d9-4a93-413b-b3b6-ce69a95c9dfa None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:12.414463 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccfd3d9-4a93-413b-b3b6-ce69a95c9dfa None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:12.416282 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 469/927] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:46:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:46:12.421549 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c74bd4-1c16-4938-af80-7f53ff7b89d5 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:12.421838 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c74bd4-1c16-4938-af80-7f53ff7b89d5 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:12.422120 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c74bd4-1c16-4938-af80-7f53ff7b89d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:12.438906 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-21c74bd4-1c16-4938-af80-7f53ff7b89d5 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:46:12.440101 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-21c74bd4-1c16-4938-af80-7f53ff7b89d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:46:12.510127 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 470/928] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:46:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:46:12.513149 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935807c-7ac6-4889-a11d-b3195291d96a None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:12.536697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c74bd4-1c16-4938-af80-7f53ff7b89d5 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:12.557972 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d0877-c4c6-48bd-afd8-c4700f00ceed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:12.559117 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d0877-c4c6-48bd-afd8-c4700f00ceed None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:12.559878 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d0877-c4c6-48bd-afd8-c4700f00ceed None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:12.560155 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d0877-c4c6-48bd-afd8-c4700f00ceed None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:12.560808 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d0877-c4c6-48bd-afd8-c4700f00ceed None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:12.562167 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d0877-c4c6-48bd-afd8-c4700f00ceed None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:12.578724 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-fe0d0877-c4c6-48bd-afd8-c4700f00ceed None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 11:46:12.578724 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:12.578724 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 11:46:12.578724 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 11:46:12.578724 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 11:46:12.578724 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 11:46:12.578724 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 11:46:12.578724 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:46:12.578724 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 11:46:12.578724 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:12.578724 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 11:46:12.578724 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:12.578724 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:12.578724 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:12.578724 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:12.578724 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:12.578724 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:12.579819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:12.579819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:12.579819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:12.579819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:12.579819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:12.579819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:12.579819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 11:46:12.579819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 11:46:12.579819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 11:46:12.579819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 11:46:12.579819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:12.579819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:12.579819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:12.579819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:12.579819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:12.579819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:12.580658 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:12.580658 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:12.580658 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:12.580658 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:12.580658 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:12.580658 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:12.580658 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:12.580658 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:12.580658 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:12.580658 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:12.580658 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 11:46:12.580658 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:46:12.580658 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 11:46:12.580658 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:12.583561 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 459/929] 10.222.0.15 () {56 vars in 1126 bytes} [Fri Jun 3 11:46:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:46:12.589014 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d0877-c4c6-48bd-afd8-c4700f00ceed None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:12.606208 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:12.653185 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c74bd4-1c16-4938-af80-7f53ff7b89d5 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:12.676583 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:12.697292 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811cc58-7386-4d03-a164-bc1cd46e3203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:12.698425 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811cc58-7386-4d03-a164-bc1cd46e3203 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:12.698812 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811cc58-7386-4d03-a164-bc1cd46e3203 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:12.699579 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811cc58-7386-4d03-a164-bc1cd46e3203 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:12.713607 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1811cc58-7386-4d03-a164-bc1cd46e3203 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:46:12.717739 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d0877-c4c6-48bd-afd8-c4700f00ceed None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:12.724340 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-1811cc58-7386-4d03-a164-bc1cd46e3203 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 11:46:12.724340 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:12.724340 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:12.724340 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:12.724340 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:12.724340 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:12.724340 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:12.724340 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:12.724340 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:12.724340 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:12.724340 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:12.724340 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:12.724340 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:46:12.724340 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:46:12.724340 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:46:12.724340 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:46:12.725304 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:46:12.725304 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:46:12.725304 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:46:12.725304 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:46:12.725304 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:12.725304 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:12.725304 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:12.725304 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:12.725304 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:12.725304 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:12.725304 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:12.725304 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:12.725304 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:12.725304 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:12.725304 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:12.725304 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:12.726129 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:12.726129 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:12.726129 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:12.726129 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:12.726129 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:46:12.726129 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:46:12.726129 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:46:12.726129 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:46:12.726129 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:46:12.726129 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:46:12.726129 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 11:46:12.726129 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:12.726129 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 471/930] 10.222.0.15 () {56 vars in 1120 bytes} [Fri Jun 3 11:46:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:46:12.731820 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811cc58-7386-4d03-a164-bc1cd46e3203 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:12.763199 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a91153-3521-422c-83ec-49fa582266e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:12.763990 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a91153-3521-422c-83ec-49fa582266e2 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:12.764349 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a91153-3521-422c-83ec-49fa582266e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:12.764702 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a91153-3521-422c-83ec-49fa582266e2 None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:12.765765 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a91153-3521-422c-83ec-49fa582266e2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:12.766151 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a91153-3521-422c-83ec-49fa582266e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:12.768845 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a91153-3521-422c-83ec-49fa582266e2 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:12.779583 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 460/931] 10.222.0.15 () {56 vars in 1122 bytes} [Fri Jun 3 11:46:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:46:12.782055 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a91153-3521-422c-83ec-49fa582266e2 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:12.859013 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811cc58-7386-4d03-a164-bc1cd46e3203 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:12.879352 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:12.908505 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d220e9-6593-4698-b063-537426569701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:12.909222 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d220e9-6593-4698-b063-537426569701 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:12.909509 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d220e9-6593-4698-b063-537426569701 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:12.909784 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d220e9-6593-4698-b063-537426569701 None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:12.910544 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d220e9-6593-4698-b063-537426569701 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:12.910854 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d220e9-6593-4698-b063-537426569701 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:12.912272 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d220e9-6593-4698-b063-537426569701 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:12.921412 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 472/932] 10.222.0.15 () {56 vars in 1115 bytes} [Fri Jun 3 11:46:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:12.926849 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d220e9-6593-4698-b063-537426569701 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:12.931119 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a91153-3521-422c-83ec-49fa582266e2 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:12.968516 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9af4d3-e0ab-41d8-beb1-3435ce8d10bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:12.969529 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9af4d3-e0ab-41d8-beb1-3435ce8d10bb None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:12.970905 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9af4d3-e0ab-41d8-beb1-3435ce8d10bb None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:12.971386 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9af4d3-e0ab-41d8-beb1-3435ce8d10bb None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:12.972382 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9af4d3-e0ab-41d8-beb1-3435ce8d10bb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:12.972936 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9af4d3-e0ab-41d8-beb1-3435ce8d10bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:12.974517 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9af4d3-e0ab-41d8-beb1-3435ce8d10bb None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:12.980383 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 461/933] 10.222.0.15 () {56 vars in 1122 bytes} [Fri Jun 3 11:46:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:46:12.980916 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:12.985746 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9af4d3-e0ab-41d8-beb1-3435ce8d10bb None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:13.057869 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d220e9-6593-4698-b063-537426569701 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:13.108681 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd37ab-da83-433b-9900-606e73d670d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:13.110122 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd37ab-da83-433b-9900-606e73d670d2 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:13.110840 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd37ab-da83-433b-9900-606e73d670d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:13.111712 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd37ab-da83-433b-9900-606e73d670d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:13.120387 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9af4d3-e0ab-41d8-beb1-3435ce8d10bb None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:13.126892 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd37ab-da83-433b-9900-606e73d670d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:13.129066 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd37ab-da83-433b-9900-606e73d670d2 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:13.153828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-dadd37ab-da83-433b-9900-606e73d670d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:46:13.153828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:13.153828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:13.153828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:13.153828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:13.153828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:13.153828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:13.153828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:13.153828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:13.153828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:13.153828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:13.153828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:13.153828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:46:13.153828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:46:13.153828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:46:13.154739 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:46:13.154739 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:13.154739 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:13.154739 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:13.154739 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:13.154739 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:13.154739 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:13.154739 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:13.154739 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:13.154739 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:13.154739 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:13.154739 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:13.154739 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:13.154739 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:13.154739 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:13.154739 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:13.154739 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:13.155655 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:46:13.155655 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:46:13.155655 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:46:13.155655 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:13.161559 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 473/934] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:46:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:46:13.162901 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd37ab-da83-433b-9900-606e73d670d2 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:13.165708 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf8467-6280-465e-aa90-0078191d6c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:13.166537 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf8467-6280-465e-aa90-0078191d6c7e None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:13.166717 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf8467-6280-465e-aa90-0078191d6c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:13.166975 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf8467-6280-465e-aa90-0078191d6c7e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:13.167869 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adf8467-6280-465e-aa90-0078191d6c7e None admin] RBAC: Adding query filter params (interface=public, service_id=3cfdfbba86fc4bffa8c6e0ff4b06bb75, region_id=RegionOne) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:13.168991 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adf8467-6280-465e-aa90-0078191d6c7e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:13.169624 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adf8467-6280-465e-aa90-0078191d6c7e None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:13.172920 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:13.182292 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 462/935] 10.222.0.15 () {56 vars in 1251 bytes} [Fri Jun 3 11:46:12 2022] GET /identity/v3/endpoints?service_id=3cfdfbba86fc4bffa8c6e0ff4b06bb75&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:13.183159 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf8467-6280-465e-aa90-0078191d6c7e None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:13.289855 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:13.292385 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf8467-6280-465e-aa90-0078191d6c7e None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:13.303078 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd37ab-da83-433b-9900-606e73d670d2 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:13.330475 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444847dd-0a10-479e-96dd-4e0723635050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:13.331276 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444847dd-0a10-479e-96dd-4e0723635050 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:13.331404 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444847dd-0a10-479e-96dd-4e0723635050 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:13.331730 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444847dd-0a10-479e-96dd-4e0723635050 None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:13.332425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444847dd-0a10-479e-96dd-4e0723635050 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:13.333802 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444847dd-0a10-479e-96dd-4e0723635050 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:13.347321 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c9901-d82d-45d9-b9ea-2976835ff16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:13.347821 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 463/936] 10.222.0.15 () {56 vars in 1087 bytes} [Fri Jun 3 11:46:13 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:46:13.348757 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c9901-d82d-45d9-b9ea-2976835ff16a None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:13.349250 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c9901-d82d-45d9-b9ea-2976835ff16a None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:13.349726 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c9901-d82d-45d9-b9ea-2976835ff16a None admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:13.350681 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99c9901-d82d-45d9-b9ea-2976835ff16a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:13.351216 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99c9901-d82d-45d9-b9ea-2976835ff16a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:13.352885 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99c9901-d82d-45d9-b9ea-2976835ff16a None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:13.372493 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 474/937] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:13.373426 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444847dd-0a10-479e-96dd-4e0723635050 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:13.407034 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c46fe-6a03-4519-8611-dd8560bf93ff None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:13.407409 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c46fe-6a03-4519-8611-dd8560bf93ff None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:13.407682 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c46fe-6a03-4519-8611-dd8560bf93ff None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:13.409031 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 475/938] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:46:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 11:46:13.415731 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250a782-8992-40ed-9edd-96838d6865d2 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:13.416048 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250a782-8992-40ed-9edd-96838d6865d2 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:13.416285 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250a782-8992-40ed-9edd-96838d6865d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:13.440269 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-f250a782-8992-40ed-9edd-96838d6865d2 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:46:13.442191 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-f250a782-8992-40ed-9edd-96838d6865d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:46:13.455884 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:13.503266 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444847dd-0a10-479e-96dd-4e0723635050 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:13.544352 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 476/939] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:46:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 11:46:13.562269 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4124e-eb96-4a0d-8d22-27173ba8c01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:13.563097 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4124e-eb96-4a0d-8d22-27173ba8c01d None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:13.563402 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4124e-eb96-4a0d-8d22-27173ba8c01d None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:13.564862 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4124e-eb96-4a0d-8d22-27173ba8c01d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:13.566128 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f250a782-8992-40ed-9edd-96838d6865d2 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:13.578068 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d4124e-eb96-4a0d-8d22-27173ba8c01d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:13.580158 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d4124e-eb96-4a0d-8d22-27173ba8c01d None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:13.596552 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-b0d4124e-eb96-4a0d-8d22-27173ba8c01d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 11:46:13.596552 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:13.596552 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:13.596552 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:13.596552 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:13.596552 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:13.596552 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:13.596552 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:13.596552 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:13.596552 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:13.596552 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:13.596552 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:13.596552 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 11:46:13.596552 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 11:46:13.596552 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 11:46:13.596552 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 11:46:13.597522 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:13.597522 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:13.597522 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 11:46:13.597522 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:46:13.597522 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 11:46:13.597522 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:46:13.597522 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:13.597522 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:13.597522 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:13.597522 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:13.597522 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:13.597522 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:13.597522 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:13.597522 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:13.597522 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:13.597522 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:13.597522 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:13.597522 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:13.598444 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:13.598444 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:13.598444 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 11:46:13.598444 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 11:46:13.598444 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 11:46:13.598444 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 11:46:13.598444 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 11:46:13.598444 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 11:46:13.598444 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 11:46:13.598444 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:13.601081 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 464/940] 10.222.0.15 () {56 vars in 1117 bytes} [Fri Jun 3 11:46:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:46:13.606660 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4124e-eb96-4a0d-8d22-27173ba8c01d None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:13.675372 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:13.696819 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f250a782-8992-40ed-9edd-96838d6865d2 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:13.717338 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4124e-eb96-4a0d-8d22-27173ba8c01d None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:13.741530 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043a73b-ee55-4349-991e-9bbfc853a090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:13.742204 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043a73b-ee55-4349-991e-9bbfc853a090 None admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:13.742491 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043a73b-ee55-4349-991e-9bbfc853a090 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:13.742768 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043a73b-ee55-4349-991e-9bbfc853a090 None admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:13.743654 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043a73b-ee55-4349-991e-9bbfc853a090 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:13.744640 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:13.745402 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043a73b-ee55-4349-991e-9bbfc853a090 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:13.746838 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: WARNING keystone.server.flask.common [None req-1043a73b-ee55-4349-991e-9bbfc853a090 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 03 11:46:13.758928 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b43d1b-ac02-421c-9ef9-99aa156476f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:13.759950 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b43d1b-ac02-421c-9ef9-99aa156476f0 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:13.760483 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b43d1b-ac02-421c-9ef9-99aa156476f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:13.760975 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b43d1b-ac02-421c-9ef9-99aa156476f0 None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:13.762006 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b43d1b-ac02-421c-9ef9-99aa156476f0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:13.762510 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b43d1b-ac02-421c-9ef9-99aa156476f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:13.764213 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b43d1b-ac02-421c-9ef9-99aa156476f0 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:13.769104 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.sql.core [None req-1043a73b-ee55-4349-991e-9bbfc853a090 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 03 11:46:13.769104 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 03 11:46:13.769104 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [parameters: {'id': '67f31ff6787342338dca385e2bcb0feb', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 03 11:46:13.769104 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80111) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 03 11:46:13.790084 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 465/941] 10.222.0.15 () {56 vars in 1149 bytes} [Fri Jun 3 11:46:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:46:13.790267 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-1043a73b-ee55-4349-991e-9bbfc853a090 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 67f31ff6787342338dca385e2bcb0feb.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 67f31ff6787342338dca385e2bcb0feb. Jun 03 11:46:13.790267 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:13.790267 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 03 11:46:13.790267 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 03 11:46:13.790267 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 03 11:46:13.790267 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 03 11:46:13.790267 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 03 11:46:13.790267 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application result = self._query(query) Jun 03 11:46:13.790267 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 03 11:46:13.790267 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application conn.query(q) Jun 03 11:46:13.790267 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 03 11:46:13.790267 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 03 11:46:13.790267 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 03 11:46:13.791029 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application result.read() Jun 03 11:46:13.791029 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 03 11:46:13.791029 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 03 11:46:13.791029 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 03 11:46:13.791029 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 03 11:46:13.791029 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 03 11:46:13.791029 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 03 11:46:13.791029 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 03 11:46:13.791029 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 03 11:46:13.791029 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 03 11:46:13.791029 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:13.791029 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 03 11:46:13.791029 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:13.791029 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:13.791029 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 03 11:46:13.791029 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 03 11:46:13.791029 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 03 11:46:13.791029 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 03 11:46:13.792016 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 03 11:46:13.792016 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application next(self.gen) Jun 03 11:46:13.792016 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 03 11:46:13.792016 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application yield resource Jun 03 11:46:13.792016 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 03 11:46:13.792016 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application next(self.gen) Jun 03 11:46:13.792016 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 03 11:46:13.792016 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application self.session.rollback() Jun 03 11:46:13.792016 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 03 11:46:13.792016 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application self.force_reraise() Jun 03 11:46:13.792016 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 03 11:46:13.792016 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise self.value Jun 03 11:46:13.792016 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 03 11:46:13.792016 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 03 11:46:13.792016 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 03 11:46:13.792016 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application session.commit() Jun 03 11:46:13.792016 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 03 11:46:13.792951 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 03 11:46:13.792951 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 03 11:46:13.792951 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application self._prepare_impl() Jun 03 11:46:13.792951 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 03 11:46:13.792951 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application self.session.flush() Jun 03 11:46:13.792951 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 03 11:46:13.792951 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application self._flush(objects) Jun 03 11:46:13.792951 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 03 11:46:13.792951 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 03 11:46:13.792951 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 03 11:46:13.792951 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application compat.raise_( Jun 03 11:46:13.792951 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 03 11:46:13.792951 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception Jun 03 11:46:13.792951 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 03 11:46:13.792951 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application flush_context.execute() Jun 03 11:46:13.792951 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 03 11:46:13.792951 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rec.execute(self) Jun 03 11:46:13.794692 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 03 11:46:13.794692 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 03 11:46:13.794692 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 03 11:46:13.794692 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 03 11:46:13.794692 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 03 11:46:13.794692 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 03 11:46:13.794692 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 03 11:46:13.794692 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 03 11:46:13.794692 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 03 11:46:13.794692 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 03 11:46:13.794692 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 03 11:46:13.794692 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 03 11:46:13.794692 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 03 11:46:13.794692 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 03 11:46:13.794692 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 03 11:46:13.795794 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 03 11:46:13.795794 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 03 11:46:13.795794 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception Jun 03 11:46:13.795794 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 03 11:46:13.795794 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 03 11:46:13.795794 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 03 11:46:13.795794 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 03 11:46:13.795794 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 03 11:46:13.795794 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application result = self._query(query) Jun 03 11:46:13.795794 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 03 11:46:13.795794 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application conn.query(q) Jun 03 11:46:13.795794 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 03 11:46:13.795794 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 03 11:46:13.795794 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 03 11:46:13.795794 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application result.read() Jun 03 11:46:13.795794 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 03 11:46:13.795794 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 03 11:46:13.798962 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 03 11:46:13.798962 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 03 11:46:13.798962 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 03 11:46:13.798962 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 03 11:46:13.798962 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 03 11:46:13.798962 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 03 11:46:13.798962 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 03 11:46:13.798962 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 03 11:46:13.798962 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [parameters: {'id': '67f31ff6787342338dca385e2bcb0feb', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 03 11:46:13.798962 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 03 11:46:13.798962 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:13.798962 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 11:46:13.798962 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:13.798962 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:13.798962 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 03 11:46:13.801015 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 03 11:46:13.801015 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 03 11:46:13.801015 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 03 11:46:13.801015 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 03 11:46:13.801015 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:13.801015 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 11:46:13.801015 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:13.801015 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:13.801015 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:13.801015 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:13.801015 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:13.801015 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:13.801015 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:13.801015 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:13.801015 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:13.801015 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:13.801015 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:13.803785 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:13.803785 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 03 11:46:13.803785 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 03 11:46:13.803785 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:13.803785 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:13.803785 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 03 11:46:13.803785 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 03 11:46:13.803785 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 67f31ff6787342338dca385e2bcb0feb. Jun 03 11:46:13.803785 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:13.803785 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 477/942] 10.222.0.15 () {60 vars in 1140 bytes} [Fri Jun 3 11:46:13 2022] POST /identity/v3/projects => generated 262 bytes in 226 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:46:13.803785 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043a73b-ee55-4349-991e-9bbfc853a090 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:13.806352 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b43d1b-ac02-421c-9ef9-99aa156476f0 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:13.912036 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043a73b-ee55-4349-991e-9bbfc853a090 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:13.927922 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b43d1b-ac02-421c-9ef9-99aa156476f0 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:13.948643 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0cbb17-33dd-4669-aafe-7ef82127f8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:13.949452 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0cbb17-33dd-4669-aafe-7ef82127f8fa None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:13.949738 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0cbb17-33dd-4669-aafe-7ef82127f8fa None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:13.950018 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0cbb17-33dd-4669-aafe-7ef82127f8fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:13.962467 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:13.965658 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0cbb17-33dd-4669-aafe-7ef82127f8fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:13.966986 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858e7b9-6f91-45ff-a307-c1c07ad85b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:13.967758 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0cbb17-33dd-4669-aafe-7ef82127f8fa None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:13.968940 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858e7b9-6f91-45ff-a307-c1c07ad85b97 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:13.970172 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858e7b9-6f91-45ff-a307-c1c07ad85b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:13.971031 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858e7b9-6f91-45ff-a307-c1c07ad85b97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:13.979539 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858e7b9-6f91-45ff-a307-c1c07ad85b97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:13.981275 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858e7b9-6f91-45ff-a307-c1c07ad85b97 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:13.989366 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-fe0cbb17-33dd-4669-aafe-7ef82127f8fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:46:13.989366 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:13.989366 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:13.989366 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:13.989366 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:13.989366 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:13.989366 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:13.989366 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:13.989366 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:13.989366 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:13.989366 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:13.989366 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:13.989366 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:46:13.989366 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:46:13.989366 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:46:13.990257 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:46:13.990257 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:13.990257 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:13.990257 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:13.990257 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:13.990257 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:13.990257 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:13.990257 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:13.990257 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:13.990257 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:13.990257 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:13.990257 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:13.990257 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:13.990257 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:13.990257 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:13.990257 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:13.990257 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:13.991156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:46:13.991156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:46:13.991156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:46:13.991156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:13.995240 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 478/943] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:46:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:46:13.996112 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0cbb17-33dd-4669-aafe-7ef82127f8fa None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:13.999699 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-f858e7b9-6f91-45ff-a307-c1c07ad85b97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:46:13.999699 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:13.999699 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:13.999699 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:13.999699 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:13.999699 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:13.999699 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:13.999699 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:13.999699 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:13.999699 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:13.999699 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:13.999699 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:13.999699 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 11:46:13.999699 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 11:46:13.999699 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 11:46:14.000553 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 11:46:14.000553 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:14.000553 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:14.000553 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:14.000553 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:14.000553 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:14.000553 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:14.000553 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:14.000553 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:14.000553 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:14.000553 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:14.000553 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:14.000553 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:14.000553 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:14.000553 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:14.000553 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:14.000553 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:14.001461 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 11:46:14.001461 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 11:46:14.001461 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 11:46:14.001461 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 11:46:14.001461 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 11:46:14.001461 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 11:46:14.001461 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:46:14.001461 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:14.003818 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 466/944] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:46:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:46:14.012546 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858e7b9-6f91-45ff-a307-c1c07ad85b97 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:14.072281 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:14.117695 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0cbb17-33dd-4669-aafe-7ef82127f8fa None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:14.146275 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858e7b9-6f91-45ff-a307-c1c07ad85b97 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:14.154857 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3211c96-5e23-447e-abfd-6ae0cb93b6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:14.155936 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3211c96-5e23-447e-abfd-6ae0cb93b6cc None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:14.156472 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3211c96-5e23-447e-abfd-6ae0cb93b6cc None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:14.157040 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3211c96-5e23-447e-abfd-6ae0cb93b6cc None admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:14.158521 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3211c96-5e23-447e-abfd-6ae0cb93b6cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:14.159124 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3211c96-5e23-447e-abfd-6ae0cb93b6cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:14.160712 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3211c96-5e23-447e-abfd-6ae0cb93b6cc None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:14.178148 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 479/945] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:14.183208 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3211c96-5e23-447e-abfd-6ae0cb93b6cc None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:14.191866 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f94f191-de46-4de0-9dfb-246c251641cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:14.192907 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94f191-de46-4de0-9dfb-246c251641cb None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:14.193390 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94f191-de46-4de0-9dfb-246c251641cb None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:14.194004 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94f191-de46-4de0-9dfb-246c251641cb None admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:14.195072 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f94f191-de46-4de0-9dfb-246c251641cb None admin] RBAC: Adding query filter params (name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:14.195624 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f94f191-de46-4de0-9dfb-246c251641cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:14.197488 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f94f191-de46-4de0-9dfb-246c251641cb None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:14.216998 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 467/946] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Jun 3 11:46:14 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:46:14.252106 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:14.306917 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3211c96-5e23-447e-abfd-6ae0cb93b6cc None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:14.345761 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e5b1a-ddb3-4040-8bf7-5f28578c9923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:14.347005 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e5b1a-ddb3-4040-8bf7-5f28578c9923 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:14.347553 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e5b1a-ddb3-4040-8bf7-5f28578c9923 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:14.348204 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e5b1a-ddb3-4040-8bf7-5f28578c9923 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:14.356265 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e5b1a-ddb3-4040-8bf7-5f28578c9923 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:14.358091 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e5b1a-ddb3-4040-8bf7-5f28578c9923 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:14.373588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-c31e5b1a-ddb3-4040-8bf7-5f28578c9923 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:46:14.373588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:14.373588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:14.373588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:14.373588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:14.373588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:14.373588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:14.373588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:14.373588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:14.373588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:14.373588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:14.373588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:14.373588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 11:46:14.373588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 11:46:14.373588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 11:46:14.374536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 11:46:14.374536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:14.374536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:14.374536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:14.374536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:14.374536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:14.374536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:14.374536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:14.374536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:14.374536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:14.374536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:14.374536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:14.374536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:14.374536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:14.374536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:14.374536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:14.374536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:14.375421 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 11:46:14.375421 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 11:46:14.375421 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 11:46:14.375421 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 11:46:14.375421 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 11:46:14.375421 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 11:46:14.375421 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:46:14.375421 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:14.378135 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 480/947] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:46:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:46:14.384697 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f94f191-de46-4de0-9dfb-246c251641cb None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:14.398857 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d626e-282f-4d81-899d-fb3b67d64c7d None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:14.399174 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d626e-282f-4d81-899d-fb3b67d64c7d None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:14.399413 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d626e-282f-4d81-899d-fb3b67d64c7d None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:14.400982 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 481/948] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:46:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 11:46:14.407092 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3bc9c-277d-4e23-b8fa-b14a10e2b9bc None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:14.408354 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3bc9c-277d-4e23-b8fa-b14a10e2b9bc None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:14.408871 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3bc9c-277d-4e23-b8fa-b14a10e2b9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:14.429023 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-d7c3bc9c-277d-4e23-b8fa-b14a10e2b9bc None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:46:14.430954 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-d7c3bc9c-277d-4e23-b8fa-b14a10e2b9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:46:14.507149 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f94f191-de46-4de0-9dfb-246c251641cb None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:14.508892 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:14.528263 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 482/949] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:46:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 11:46:14.550923 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3bc9c-277d-4e23-b8fa-b14a10e2b9bc None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:14.555265 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a75f4-23d2-4371-9664-851b1ee72286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:14.555998 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a75f4-23d2-4371-9664-851b1ee72286 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:14.556284 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a75f4-23d2-4371-9664-851b1ee72286 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:14.556563 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a75f4-23d2-4371-9664-851b1ee72286 None admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:14.557355 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2a75f4-23d2-4371-9664-851b1ee72286 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:14.557669 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2a75f4-23d2-4371-9664-851b1ee72286 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:14.559110 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2a75f4-23d2-4371-9664-851b1ee72286 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:14.573287 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 468/950] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 3 11:46:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:14.579589 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a75f4-23d2-4371-9664-851b1ee72286 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:14.604000 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:14.670019 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3bc9c-277d-4e23-b8fa-b14a10e2b9bc None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:14.707028 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a75f4-23d2-4371-9664-851b1ee72286 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:14.707391 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63894be2-9245-4c93-8c4d-88b443c72611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:14.708266 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63894be2-9245-4c93-8c4d-88b443c72611 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:14.708583 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63894be2-9245-4c93-8c4d-88b443c72611 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:14.712775 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63894be2-9245-4c93-8c4d-88b443c72611 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:14.713488 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63894be2-9245-4c93-8c4d-88b443c72611 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:14.714938 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63894be2-9245-4c93-8c4d-88b443c72611 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:14.727996 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-63894be2-9245-4c93-8c4d-88b443c72611 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 11:46:14.727996 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:14.727996 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 11:46:14.727996 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 11:46:14.727996 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 11:46:14.727996 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 11:46:14.727996 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 11:46:14.727996 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:46:14.727996 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 11:46:14.727996 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:14.727996 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 11:46:14.727996 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:14.727996 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:14.727996 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:14.727996 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:14.727996 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:14.727996 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:14.729008 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:14.729008 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:14.729008 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:14.729008 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:14.729008 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:14.729008 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:14.729008 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 11:46:14.729008 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 11:46:14.729008 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 11:46:14.729008 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 11:46:14.729008 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:14.729008 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:14.729008 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:14.729008 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:14.729008 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:14.729008 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:14.730054 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:14.730054 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:14.730054 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:14.730054 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:14.730054 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:14.730054 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:14.730054 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:14.730054 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:14.730054 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:14.730054 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:14.730054 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 11:46:14.730054 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:46:14.730054 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 11:46:14.730054 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:14.730054 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 483/951] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:46:14 2022] GET /identity/v3/services/compute => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:46:14.737266 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63894be2-9245-4c93-8c4d-88b443c72611 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:14.750685 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186bf10b-6670-4fed-99bf-60de181d46ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:14.751867 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186bf10b-6670-4fed-99bf-60de181d46ee None admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:14.752282 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186bf10b-6670-4fed-99bf-60de181d46ee None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:14.752758 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186bf10b-6670-4fed-99bf-60de181d46ee None admin] PATH_INFO: `/v3/projects/cff223ee05524cf4bf3591fc5a39559e/users/a55cbe88e78e4f3a82b8703a3b1804e5/roles/4e916858113d4ed5bf93f9e457387f15` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:14.755234 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186bf10b-6670-4fed-99bf-60de181d46ee None admin] RBAC: Authorizing `identity:create_grant(project_id=cff223ee05524cf4bf3591fc5a39559e, user_id=a55cbe88e78e4f3a82b8703a3b1804e5, role_id=4e916858113d4ed5bf93f9e457387f15)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:14.757028 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186bf10b-6670-4fed-99bf-60de181d46ee None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:14.775574 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 469/952] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Jun 3 11:46:14 2022] PUT /identity/v3/projects/cff223ee05524cf4bf3591fc5a39559e/users/a55cbe88e78e4f3a82b8703a3b1804e5/roles/4e916858113d4ed5bf93f9e457387f15 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:46:14.868557 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63894be2-9245-4c93-8c4d-88b443c72611 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:14.876829 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:14.915534 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e9ff1-876a-4919-9d83-b5f3a37128ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:14.916235 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e9ff1-876a-4919-9d83-b5f3a37128ef None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:14.916523 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e9ff1-876a-4919-9d83-b5f3a37128ef None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:14.916806 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e9ff1-876a-4919-9d83-b5f3a37128ef None admin] PATH_INFO: `/v3/services` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:14.917540 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e9ff1-876a-4919-9d83-b5f3a37128ef None admin] RBAC: Adding query filter params (name=compute) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:14.917855 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e9ff1-876a-4919-9d83-b5f3a37128ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:14.919344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e9ff1-876a-4919-9d83-b5f3a37128ef None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:14.929748 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 484/953] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Jun 3 11:46:14 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:14.932332 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186bf10b-6670-4fed-99bf-60de181d46ee None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:14.962197 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:15.047566 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186bf10b-6670-4fed-99bf-60de181d46ee None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:15.083440 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c312f7-a3c7-43b7-a3a3-52945982f8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:15.084140 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c312f7-a3c7-43b7-a3a3-52945982f8ae None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:15.084425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c312f7-a3c7-43b7-a3a3-52945982f8ae None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:15.084706 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c312f7-a3c7-43b7-a3a3-52945982f8ae None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:15.085416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c312f7-a3c7-43b7-a3a3-52945982f8ae None admin] RBAC: Adding query filter params (type=compute) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:15.085723 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c312f7-a3c7-43b7-a3a3-52945982f8ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:15.087121 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c312f7-a3c7-43b7-a3a3-52945982f8ae None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:15.099177 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 470/954] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Jun 3 11:46:14 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:15.656108 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd6d8f-b7a0-4ea8-a3c5-3fad9c559b01 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:15.656510 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd6d8f-b7a0-4ea8-a3c5-3fad9c559b01 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:15.656681 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd6d8f-b7a0-4ea8-a3c5-3fad9c559b01 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:15.658810 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 485/955] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:46:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:46:15.664321 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c669c-addc-4a3d-9f88-01b8516003f8 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:15.664613 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c669c-addc-4a3d-9f88-01b8516003f8 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:15.664889 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5c669c-addc-4a3d-9f88-01b8516003f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:15.683828 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-fb5c669c-addc-4a3d-9f88-01b8516003f8 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:46:15.685028 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-fb5c669c-addc-4a3d-9f88-01b8516003f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:46:15.754518 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 471/956] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:46:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:46:15.777411 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd6d8f-b7a0-4ea8-a3c5-3fad9c559b01 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:15.884191 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd6d8f-b7a0-4ea8-a3c5-3fad9c559b01 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:15.920120 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089753a8-29d6-4c8a-8df5-2553b9841178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:15.920936 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089753a8-29d6-4c8a-8df5-2553b9841178 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:15.921226 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089753a8-29d6-4c8a-8df5-2553b9841178 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:15.921558 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089753a8-29d6-4c8a-8df5-2553b9841178 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:15.922219 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089753a8-29d6-4c8a-8df5-2553b9841178 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:15.923641 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089753a8-29d6-4c8a-8df5-2553b9841178 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:15.935812 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-089753a8-29d6-4c8a-8df5-2553b9841178 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 11:46:15.935812 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:15.935812 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 11:46:15.935812 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 11:46:15.935812 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 11:46:15.935812 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 11:46:15.935812 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 11:46:15.935812 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:46:15.935812 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 11:46:15.935812 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:15.935812 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 11:46:15.935812 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:15.935812 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:15.935812 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:15.935812 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:15.935812 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:15.935812 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:15.936864 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:15.936864 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:15.936864 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:15.936864 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:15.936864 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:15.936864 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:15.936864 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 11:46:15.936864 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 11:46:15.936864 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 11:46:15.936864 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 11:46:15.936864 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:15.936864 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:15.936864 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:15.936864 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:15.936864 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:15.936864 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:15.937708 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:15.937708 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:15.937708 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:15.937708 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:15.937708 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:15.937708 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:15.937708 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:15.937708 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:15.937708 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:15.937708 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:15.937708 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 11:46:15.937708 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:46:15.937708 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 11:46:15.937708 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:15.937708 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 486/957] 10.222.0.15 () {56 vars in 1126 bytes} [Fri Jun 3 11:46:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:46:15.943097 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c669c-addc-4a3d-9f88-01b8516003f8 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:15.962407 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:16.053582 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5c669c-addc-4a3d-9f88-01b8516003f8 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:16.088753 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f37705-1548-48e4-8860-4e0e18c190ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:16.089422 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f37705-1548-48e4-8860-4e0e18c190ee None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:16.089705 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f37705-1548-48e4-8860-4e0e18c190ee None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:16.089983 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f37705-1548-48e4-8860-4e0e18c190ee None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:16.090689 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f37705-1548-48e4-8860-4e0e18c190ee None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:16.090994 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f37705-1548-48e4-8860-4e0e18c190ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:16.092391 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f37705-1548-48e4-8860-4e0e18c190ee None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:16.098349 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 472/958] 10.222.0.15 () {56 vars in 1122 bytes} [Fri Jun 3 11:46:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:16.103741 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089753a8-29d6-4c8a-8df5-2553b9841178 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:16.138524 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:16.207456 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089753a8-29d6-4c8a-8df5-2553b9841178 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:16.242214 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da5e6f-fec0-4440-a81a-b8e201c57373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:16.242901 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da5e6f-fec0-4440-a81a-b8e201c57373 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:16.243185 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da5e6f-fec0-4440-a81a-b8e201c57373 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:16.243459 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da5e6f-fec0-4440-a81a-b8e201c57373 None admin] PATH_INFO: `/v3/services` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:16.244223 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65da5e6f-fec0-4440-a81a-b8e201c57373 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:16.244532 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65da5e6f-fec0-4440-a81a-b8e201c57373 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:16.245952 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65da5e6f-fec0-4440-a81a-b8e201c57373 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:16.252673 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 487/959] 10.222.0.15 () {56 vars in 1122 bytes} [Fri Jun 3 11:46:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:16.258257 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f37705-1548-48e4-8860-4e0e18c190ee None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:16.347401 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:16.367479 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f37705-1548-48e4-8860-4e0e18c190ee None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:16.403865 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d784b-abda-4aa8-b523-b4b754c97f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:16.404548 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d784b-abda-4aa8-b523-b4b754c97f65 None admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:16.404831 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d784b-abda-4aa8-b523-b4b754c97f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:16.405105 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d784b-abda-4aa8-b523-b4b754c97f65 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:16.405880 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d784b-abda-4aa8-b523-b4b754c97f65 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:16.407370 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d784b-abda-4aa8-b523-b4b754c97f65 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:16.432812 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 473/960] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Jun 3 11:46:16 2022] POST /identity/v3/endpoints => generated 349 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:46:16.756170 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9dcd1f-4f64-40dd-a139-577bd1b21a06 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:16.756549 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9dcd1f-4f64-40dd-a139-577bd1b21a06 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:16.756724 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9dcd1f-4f64-40dd-a139-577bd1b21a06 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:16.758378 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 488/961] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:46:16.763904 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfdd948-d391-46e1-9480-72979dd9c9ac None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:16.764202 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfdd948-d391-46e1-9480-72979dd9c9ac None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:16.764489 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfdd948-d391-46e1-9480-72979dd9c9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:16.782765 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-9cfdd948-d391-46e1-9480-72979dd9c9ac None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:46:16.783976 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-9cfdd948-d391-46e1-9480-72979dd9c9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:46:16.863794 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 474/962] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:46:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:46:16.888947 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9dcd1f-4f64-40dd-a139-577bd1b21a06 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:16.996018 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:17.002050 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9dcd1f-4f64-40dd-a139-577bd1b21a06 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:17.038131 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72efea0-3fca-4527-bac9-2fc6857bbb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:17.038727 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72efea0-3fca-4527-bac9-2fc6857bbb54 None admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:17.039007 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72efea0-3fca-4527-bac9-2fc6857bbb54 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:17.039279 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72efea0-3fca-4527-bac9-2fc6857bbb54 None admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:17.040020 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72efea0-3fca-4527-bac9-2fc6857bbb54 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:17.041444 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72efea0-3fca-4527-bac9-2fc6857bbb54 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:17.054534 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.sql.core [None req-d72efea0-3fca-4527-bac9-2fc6857bbb54 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 03 11:46:17.054534 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 03 11:46:17.054534 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [parameters: {'user_id': 'a474585925284126adf1ba447ad85a9e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 03 11:46:17.054534 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80111) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 03 11:46:17.062284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-d72efea0-3fca-4527-bac9-2fc6857bbb54 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 03 11:46:17.062284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:17.062284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 03 11:46:17.062284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 03 11:46:17.062284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 03 11:46:17.062284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 03 11:46:17.062284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 03 11:46:17.062284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application result = self._query(query) Jun 03 11:46:17.062284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 03 11:46:17.062284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application conn.query(q) Jun 03 11:46:17.062284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 03 11:46:17.062284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 03 11:46:17.062284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 03 11:46:17.062284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application result.read() Jun 03 11:46:17.062284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 03 11:46:17.063231 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 03 11:46:17.063231 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 03 11:46:17.063231 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 03 11:46:17.063231 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 03 11:46:17.063231 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 03 11:46:17.063231 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 03 11:46:17.063231 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 03 11:46:17.063231 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 03 11:46:17.063231 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:17.063231 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 03 11:46:17.063231 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:17.063231 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:17.063231 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 03 11:46:17.063231 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 03 11:46:17.063231 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 03 11:46:17.063231 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 03 11:46:17.063231 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 03 11:46:17.063231 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application next(self.gen) Jun 03 11:46:17.064845 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 03 11:46:17.064845 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application yield resource Jun 03 11:46:17.064845 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 03 11:46:17.064845 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application next(self.gen) Jun 03 11:46:17.064845 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 03 11:46:17.064845 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application self.session.rollback() Jun 03 11:46:17.064845 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 03 11:46:17.064845 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application self.force_reraise() Jun 03 11:46:17.064845 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 03 11:46:17.064845 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise self.value Jun 03 11:46:17.064845 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 03 11:46:17.064845 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 03 11:46:17.064845 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 03 11:46:17.064845 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application session.commit() Jun 03 11:46:17.064845 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 03 11:46:17.064845 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 03 11:46:17.064845 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 03 11:46:17.065769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application self._prepare_impl() Jun 03 11:46:17.065769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 03 11:46:17.065769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application self.session.flush() Jun 03 11:46:17.065769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 03 11:46:17.065769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application self._flush(objects) Jun 03 11:46:17.065769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 03 11:46:17.065769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 03 11:46:17.065769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 03 11:46:17.065769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application compat.raise_( Jun 03 11:46:17.065769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 03 11:46:17.065769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception Jun 03 11:46:17.065769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 03 11:46:17.065769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application flush_context.execute() Jun 03 11:46:17.065769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 03 11:46:17.065769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rec.execute(self) Jun 03 11:46:17.065769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 03 11:46:17.065769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 03 11:46:17.066683 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 03 11:46:17.066683 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 03 11:46:17.066683 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 03 11:46:17.066683 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 03 11:46:17.066683 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 03 11:46:17.066683 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 03 11:46:17.066683 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 03 11:46:17.066683 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 03 11:46:17.066683 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 03 11:46:17.066683 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 03 11:46:17.066683 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 03 11:46:17.066683 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 03 11:46:17.066683 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 03 11:46:17.066683 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 03 11:46:17.066683 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 03 11:46:17.066683 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception Jun 03 11:46:17.067612 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 03 11:46:17.067612 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 03 11:46:17.067612 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 03 11:46:17.067612 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 03 11:46:17.067612 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 03 11:46:17.067612 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application result = self._query(query) Jun 03 11:46:17.067612 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 03 11:46:17.067612 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application conn.query(q) Jun 03 11:46:17.067612 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 03 11:46:17.067612 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 03 11:46:17.067612 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 03 11:46:17.067612 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application result.read() Jun 03 11:46:17.067612 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 03 11:46:17.067612 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 03 11:46:17.067612 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 03 11:46:17.067612 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 03 11:46:17.068463 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 03 11:46:17.068463 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 03 11:46:17.068463 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 03 11:46:17.068463 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 03 11:46:17.068463 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 03 11:46:17.068463 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 03 11:46:17.068463 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [parameters: {'user_id': 'a474585925284126adf1ba447ad85a9e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 03 11:46:17.068463 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 03 11:46:17.068463 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:17.068463 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 11:46:17.068463 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:17.068463 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:17.068463 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:17.068463 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:17.068463 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:17.069259 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:17.069259 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:17.069259 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:17.069259 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:17.069259 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:17.069259 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:17.069259 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:17.069259 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 03 11:46:17.069259 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 03 11:46:17.069259 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:17.069259 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:17.069259 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 11:46:17.069259 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:46:17.069259 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 11:46:17.069259 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:46:17.069259 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 03 11:46:17.069259 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 03 11:46:17.070192 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 03 11:46:17.070192 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 03 11:46:17.070192 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 03 11:46:17.070192 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 03 11:46:17.070192 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 03 11:46:17.070192 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:17.070192 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 489/963] 10.222.0.15 () {60 vars in 1131 bytes} [Fri Jun 3 11:46:16 2022] POST /identity/v3/users => generated 160 bytes in 176 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:46:17.070600 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfdd948-d391-46e1-9480-72979dd9c9ac None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:17.138679 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:17.172400 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aea60c-ab5c-4d9c-b3f0-17a969b4c587 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:17.172596 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aea60c-ab5c-4d9c-b3f0-17a969b4c587 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:17.172851 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aea60c-ab5c-4d9c-b3f0-17a969b4c587 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:17.180921 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 490/964] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:46:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 11:46:17.182007 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfdd948-d391-46e1-9480-72979dd9c9ac None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:17.182152 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2998cb-f2d5-4115-879f-b4824735d5d7 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:17.182377 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2998cb-f2d5-4115-879f-b4824735d5d7 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:17.182654 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2998cb-f2d5-4115-879f-b4824735d5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:17.200865 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-cd2998cb-f2d5-4115-879f-b4824735d5d7 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:46:17.202468 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-cd2998cb-f2d5-4115-879f-b4824735d5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:46:17.221799 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c847438-4e80-42f4-9c47-412fc7d75dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:17.223336 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c847438-4e80-42f4-9c47-412fc7d75dbc None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:17.223854 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c847438-4e80-42f4-9c47-412fc7d75dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:17.224349 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c847438-4e80-42f4-9c47-412fc7d75dbc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:17.234704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c847438-4e80-42f4-9c47-412fc7d75dbc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:17.237122 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c847438-4e80-42f4-9c47-412fc7d75dbc None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:17.260781 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-8c847438-4e80-42f4-9c47-412fc7d75dbc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 03 11:46:17.260781 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:17.260781 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:17.260781 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:17.260781 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:17.260781 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:17.260781 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:17.260781 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:17.260781 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:17.260781 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:17.260781 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:17.260781 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:17.260781 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 11:46:17.260781 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 11:46:17.260781 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 11:46:17.260781 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 11:46:17.261771 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:17.261771 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:17.261771 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 11:46:17.261771 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:46:17.261771 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 11:46:17.261771 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:46:17.261771 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:17.261771 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:17.261771 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:17.261771 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:17.261771 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:17.261771 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:17.261771 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:17.261771 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:17.261771 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:17.261771 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:17.261771 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:17.261771 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:17.262784 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:17.262784 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:17.262784 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 11:46:17.262784 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 11:46:17.262784 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 11:46:17.262784 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 11:46:17.262784 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 11:46:17.262784 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 11:46:17.262784 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 03 11:46:17.262784 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:17.265916 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 475/965] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:46:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:46:17.272966 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c847438-4e80-42f4-9c47-412fc7d75dbc None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:17.291759 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 491/966] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:46:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:46:17.312372 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2998cb-f2d5-4115-879f-b4824735d5d7 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:17.398785 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c847438-4e80-42f4-9c47-412fc7d75dbc None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:17.414969 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:17.425608 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:17.428510 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2998cb-f2d5-4115-879f-b4824735d5d7 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:17.439088 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab5186-1682-4177-b5a6-055f48ab8cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:17.439792 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab5186-1682-4177-b5a6-055f48ab8cb6 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:17.440072 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab5186-1682-4177-b5a6-055f48ab8cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:17.440346 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab5186-1682-4177-b5a6-055f48ab8cb6 None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:17.441143 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab5186-1682-4177-b5a6-055f48ab8cb6 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:17.441445 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab5186-1682-4177-b5a6-055f48ab8cb6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:17.442867 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab5186-1682-4177-b5a6-055f48ab8cb6 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:17.464888 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898f000-2e29-4552-a781-ff3311b0d2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:17.465696 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898f000-2e29-4552-a781-ff3311b0d2a6 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:17.466725 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898f000-2e29-4552-a781-ff3311b0d2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:17.467007 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898f000-2e29-4552-a781-ff3311b0d2a6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:17.481023 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 476/967] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Jun 3 11:46:17 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:17.481023 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b422ac-1a97-4579-8c4d-811f79ee424a None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:17.481023 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b422ac-1a97-4579-8c4d-811f79ee424a None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:17.481023 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b422ac-1a97-4579-8c4d-811f79ee424a None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:17.481023 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 477/968] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:46:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:46:17.486135 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa30b31-cb53-41bc-89b0-f604080473e3 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:17.486421 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa30b31-cb53-41bc-89b0-f604080473e3 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:17.486698 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa30b31-cb53-41bc-89b0-f604080473e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:17.488738 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898f000-2e29-4552-a781-ff3311b0d2a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:46:17.497122 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-4898f000-2e29-4552-a781-ff3311b0d2a6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 11:46:17.497122 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:17.497122 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:17.497122 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:17.497122 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:17.497122 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:17.497122 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:17.497122 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:17.497122 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:17.497122 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:17.497122 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:17.497122 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:17.497122 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:46:17.497122 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:46:17.497122 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:46:17.497122 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:46:17.498143 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:46:17.498143 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:46:17.498143 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:46:17.498143 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:46:17.498143 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:17.498143 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:17.498143 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:17.498143 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:17.498143 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:17.498143 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:17.498143 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:17.498143 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:17.498143 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:17.498143 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:17.498143 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:17.498143 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:17.498986 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:17.498986 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:17.498986 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:17.498986 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:17.498986 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:46:17.498986 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:46:17.498986 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:46:17.498986 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:46:17.498986 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:46:17.498986 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:46:17.498986 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 11:46:17.498986 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:17.503974 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 492/969] 10.222.0.15 () {56 vars in 1120 bytes} [Fri Jun 3 11:46:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:46:17.505414 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898f000-2e29-4552-a781-ff3311b0d2a6 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:17.513374 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-1fa30b31-cb53-41bc-89b0-f604080473e3 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:46:17.514917 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-1fa30b31-cb53-41bc-89b0-f604080473e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:46:17.611560 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 478/970] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:46:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:46:17.634019 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa30b31-cb53-41bc-89b0-f604080473e3 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:17.646991 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898f000-2e29-4552-a781-ff3311b0d2a6 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:17.690845 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9d500-ca67-4faa-9cb3-28014feea236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:17.691072 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9d500-ca67-4faa-9cb3-28014feea236 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:17.691267 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9d500-ca67-4faa-9cb3-28014feea236 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:17.692601 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9d500-ca67-4faa-9cb3-28014feea236 None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:17.692601 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9d500-ca67-4faa-9cb3-28014feea236 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:17.692601 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9d500-ca67-4faa-9cb3-28014feea236 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:17.694073 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9d500-ca67-4faa-9cb3-28014feea236 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:17.704644 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 493/971] 10.222.0.15 () {56 vars in 1115 bytes} [Fri Jun 3 11:46:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:46:17.710754 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9d500-ca67-4faa-9cb3-28014feea236 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:17.728682 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:17.754522 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa30b31-cb53-41bc-89b0-f604080473e3 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:17.768538 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:17.807491 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105a6a9-41e8-45de-8940-7570813d0123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:17.808491 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105a6a9-41e8-45de-8940-7570813d0123 None admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:17.808966 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105a6a9-41e8-45de-8940-7570813d0123 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:17.809240 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105a6a9-41e8-45de-8940-7570813d0123 None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:17.809970 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c105a6a9-41e8-45de-8940-7570813d0123 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:17.811860 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c105a6a9-41e8-45de-8940-7570813d0123 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:17.826659 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 479/972] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Jun 3 11:46:17 2022] POST /identity/v3/services => generated 242 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:46:17.838756 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9d500-ca67-4faa-9cb3-28014feea236 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:17.885881 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258fd35f-128b-40fe-80c5-3aea8b0e9e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:17.886615 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258fd35f-128b-40fe-80c5-3aea8b0e9e0c None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:17.886897 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258fd35f-128b-40fe-80c5-3aea8b0e9e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:17.887170 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258fd35f-128b-40fe-80c5-3aea8b0e9e0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:17.904151 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258fd35f-128b-40fe-80c5-3aea8b0e9e0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:17.905721 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258fd35f-128b-40fe-80c5-3aea8b0e9e0c None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:17.926107 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-258fd35f-128b-40fe-80c5-3aea8b0e9e0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:46:17.926107 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:17.926107 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:17.926107 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:17.926107 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:17.926107 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:17.926107 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:17.926107 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:17.926107 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:17.926107 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:17.926107 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:17.926107 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:17.926107 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:46:17.926107 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:46:17.926107 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:46:17.927096 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:46:17.927096 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:17.927096 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:17.927096 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:17.927096 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:17.927096 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:17.927096 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:17.927096 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:17.927096 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:17.927096 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:17.927096 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:17.927096 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:17.927096 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:17.927096 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:17.927096 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:17.927096 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:17.927096 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:17.928655 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:46:17.928655 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:46:17.928655 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:46:17.928655 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:17.928655 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 494/973] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:46:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:46:17.933207 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105a6a9-41e8-45de-8940-7570813d0123 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:18.045650 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105a6a9-41e8-45de-8940-7570813d0123 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:18.080537 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4627a7-df6d-4493-8489-92c6d8951cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:18.081302 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4627a7-df6d-4493-8489-92c6d8951cce None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:18.081490 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4627a7-df6d-4493-8489-92c6d8951cce None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:18.081759 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4627a7-df6d-4493-8489-92c6d8951cce None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:18.082479 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4627a7-df6d-4493-8489-92c6d8951cce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:18.082787 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4627a7-df6d-4493-8489-92c6d8951cce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:18.084332 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4627a7-df6d-4493-8489-92c6d8951cce None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:18.096331 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 480/974] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:46:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:18.101930 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258fd35f-128b-40fe-80c5-3aea8b0e9e0c None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:18.162133 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:18.203020 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258fd35f-128b-40fe-80c5-3aea8b0e9e0c None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:18.237833 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff3bb8e-bea7-4bfd-b266-d4c979a4df76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:18.238651 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3bb8e-bea7-4bfd-b266-d4c979a4df76 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:18.238936 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3bb8e-bea7-4bfd-b266-d4c979a4df76 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:18.239208 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3bb8e-bea7-4bfd-b266-d4c979a4df76 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:18.246992 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff3bb8e-bea7-4bfd-b266-d4c979a4df76 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:18.248461 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff3bb8e-bea7-4bfd-b266-d4c979a4df76 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:18.263104 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-cff3bb8e-bea7-4bfd-b266-d4c979a4df76 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 11:46:18.263104 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:18.263104 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:18.263104 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:18.263104 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:18.263104 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:18.263104 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:18.263104 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:18.263104 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:18.263104 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:18.263104 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:18.263104 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:18.263104 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 11:46:18.263104 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 11:46:18.263104 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 11:46:18.263104 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 11:46:18.264310 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:18.264310 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:18.264310 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 11:46:18.264310 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:46:18.264310 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 11:46:18.264310 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:46:18.264310 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:18.264310 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:18.264310 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:18.264310 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:18.264310 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:18.264310 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:18.264310 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:18.264310 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:18.264310 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:18.264310 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:18.264310 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:18.264310 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:18.265271 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:18.265271 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:18.265271 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 11:46:18.265271 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 11:46:18.265271 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 11:46:18.265271 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 11:46:18.265271 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 11:46:18.265271 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 11:46:18.265271 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 03 11:46:18.265271 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:18.265271 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 495/975] 10.222.0.15 () {56 vars in 1117 bytes} [Fri Jun 3 11:46:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:46:18.272386 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4627a7-df6d-4493-8489-92c6d8951cce None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:18.304952 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:18.381025 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4627a7-df6d-4493-8489-92c6d8951cce None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:18.415229 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07415478-f854-4f92-8821-8a60fe59a58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:18.415842 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07415478-f854-4f92-8821-8a60fe59a58f None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:18.416128 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07415478-f854-4f92-8821-8a60fe59a58f None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:18.416403 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07415478-f854-4f92-8821-8a60fe59a58f None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:18.417231 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07415478-f854-4f92-8821-8a60fe59a58f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:18.417539 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07415478-f854-4f92-8821-8a60fe59a58f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:18.418951 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07415478-f854-4f92-8821-8a60fe59a58f None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:18.436215 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 481/976] 10.222.0.15 () {56 vars in 1149 bytes} [Fri Jun 3 11:46:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:18.442125 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff3bb8e-bea7-4bfd-b266-d4c979a4df76 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:18.546875 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff3bb8e-bea7-4bfd-b266-d4c979a4df76 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:18.566675 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:18.582576 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aef776-3045-424b-a8de-daf5b3e5abc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:18.583230 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aef776-3045-424b-a8de-daf5b3e5abc1 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:18.583540 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aef776-3045-424b-a8de-daf5b3e5abc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:18.583828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aef776-3045-424b-a8de-daf5b3e5abc1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:18.651516 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aef776-3045-424b-a8de-daf5b3e5abc1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:18.653038 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aef776-3045-424b-a8de-daf5b3e5abc1 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:18.752247 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 496/977] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:46:18 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 11:46:18.757536 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07415478-f854-4f92-8821-8a60fe59a58f None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:18.823696 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64d2a6-3669-4846-965a-5c7c5c0c4544 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:18.824010 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64d2a6-3669-4846-965a-5c7c5c0c4544 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:18.824268 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64d2a6-3669-4846-965a-5c7c5c0c4544 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:18.825763 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 497/978] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:46:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 11:46:18.830646 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb027e-fb21-4039-8dcd-4b969c016478 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:18.830936 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb027e-fb21-4039-8dcd-4b969c016478 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:18.831218 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb027e-fb21-4039-8dcd-4b969c016478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:18.844904 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:18.847423 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-e2eb027e-fb21-4039-8dcd-4b969c016478 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:46:18.848800 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-e2eb027e-fb21-4039-8dcd-4b969c016478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:46:18.858372 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07415478-f854-4f92-8821-8a60fe59a58f None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:18.863466 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:18.893093 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56845fdc-2ae5-4bb8-91e3-1cac2b589890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:18.893884 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56845fdc-2ae5-4bb8-91e3-1cac2b589890 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:18.894166 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56845fdc-2ae5-4bb8-91e3-1cac2b589890 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:18.894440 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56845fdc-2ae5-4bb8-91e3-1cac2b589890 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:18.912353 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56845fdc-2ae5-4bb8-91e3-1cac2b589890 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:18.914224 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56845fdc-2ae5-4bb8-91e3-1cac2b589890 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:18.930162 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 498/979] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:46:18 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 11:46:18.936096 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-56845fdc-2ae5-4bb8-91e3-1cac2b589890 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:46:18.936096 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:18.936096 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:18.936096 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:18.936096 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:18.936096 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:18.936096 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:18.936096 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:18.936096 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:18.936096 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:18.936096 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:18.936096 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:18.936096 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:46:18.936096 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:46:18.936096 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:46:18.936943 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:46:18.936943 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:18.936943 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:18.936943 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:18.936943 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:18.936943 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:18.936943 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:18.936943 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:18.936943 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:18.936943 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:18.936943 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:18.936943 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:18.936943 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:18.936943 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:18.936943 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:18.936943 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:18.936943 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:18.937836 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:46:18.937836 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:46:18.937836 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:46:18.937836 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:18.937836 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 482/980] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:46:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:46:18.944700 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb027e-fb21-4039-8dcd-4b969c016478 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:18.954788 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56845fdc-2ae5-4bb8-91e3-1cac2b589890 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:19.048234 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb027e-fb21-4039-8dcd-4b969c016478 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:19.074982 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56845fdc-2ae5-4bb8-91e3-1cac2b589890 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:19.083427 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29912e03-6313-463f-8fef-5b1f3a097e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:19.084126 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29912e03-6313-463f-8fef-5b1f3a097e62 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:19.084408 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29912e03-6313-463f-8fef-5b1f3a097e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:19.084682 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29912e03-6313-463f-8fef-5b1f3a097e62 None admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:19.085408 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29912e03-6313-463f-8fef-5b1f3a097e62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:19.085715 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29912e03-6313-463f-8fef-5b1f3a097e62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:19.087088 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29912e03-6313-463f-8fef-5b1f3a097e62 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:19.107634 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 499/981] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:46:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:19.113540 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29912e03-6313-463f-8fef-5b1f3a097e62 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:19.118648 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac180bc4-d179-4827-a081-50a6924687ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:19.119453 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac180bc4-d179-4827-a081-50a6924687ba None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:19.119762 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac180bc4-d179-4827-a081-50a6924687ba None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:19.120040 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac180bc4-d179-4827-a081-50a6924687ba None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:19.120695 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac180bc4-d179-4827-a081-50a6924687ba None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:19.122119 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac180bc4-d179-4827-a081-50a6924687ba None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:19.126254 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:19.135416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-ac180bc4-d179-4827-a081-50a6924687ba None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 11:46:19.135416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:19.135416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 11:46:19.135416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 11:46:19.135416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 11:46:19.135416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 11:46:19.135416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 11:46:19.135416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:46:19.135416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 11:46:19.135416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:19.135416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 11:46:19.135416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:19.135416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:19.135416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:19.135416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:19.135416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:19.135416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:19.136679 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:19.136679 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:19.136679 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:19.136679 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:19.136679 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:19.136679 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:19.136679 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 11:46:19.136679 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 11:46:19.136679 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 11:46:19.136679 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 11:46:19.136679 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:19.136679 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:19.136679 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:19.136679 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:19.136679 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:19.136679 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:19.137550 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:19.137550 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:19.137550 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:19.137550 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:19.137550 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:19.137550 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:19.137550 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:19.137550 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:19.137550 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:19.137550 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:19.137550 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 11:46:19.137550 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:46:19.137550 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 11:46:19.137550 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:19.137550 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 483/982] 10.222.0.15 () {56 vars in 1126 bytes} [Fri Jun 3 11:46:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:46:19.142406 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac180bc4-d179-4827-a081-50a6924687ba None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:19.146299 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:19.222894 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29912e03-6313-463f-8fef-5b1f3a097e62 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:19.248425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac180bc4-d179-4827-a081-50a6924687ba None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:19.257614 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3b573-31ca-4aaf-b5db-a0696bca927d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:19.258510 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3b573-31ca-4aaf-b5db-a0696bca927d None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:19.258964 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3b573-31ca-4aaf-b5db-a0696bca927d None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:19.259441 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3b573-31ca-4aaf-b5db-a0696bca927d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:19.267730 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3b573-31ca-4aaf-b5db-a0696bca927d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:19.270071 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3b573-31ca-4aaf-b5db-a0696bca927d None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:19.285820 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9fdd75-39d7-490f-befa-fd1b65eaf9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:19.286469 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fdd75-39d7-490f-befa-fd1b65eaf9cd None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:19.286752 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fdd75-39d7-490f-befa-fd1b65eaf9cd None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:19.287031 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fdd75-39d7-490f-befa-fd1b65eaf9cd None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:19.287766 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9fdd75-39d7-490f-befa-fd1b65eaf9cd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:19.288073 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9fdd75-39d7-490f-befa-fd1b65eaf9cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:19.288721 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-19b3b573-31ca-4aaf-b5db-a0696bca927d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:46:19.288721 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:19.288721 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:19.288721 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:19.288721 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:19.288721 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:19.288721 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:19.288721 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:19.288721 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:19.288721 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:19.288721 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:19.288721 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:19.288721 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 11:46:19.288721 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 11:46:19.288721 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 11:46:19.290522 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 11:46:19.290522 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:19.290522 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:19.290522 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:19.290522 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:19.290522 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:19.290522 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:19.290522 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:19.290522 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:19.290522 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:19.290522 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:19.290522 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:19.290522 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:19.290522 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:19.290522 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:19.290522 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:19.290522 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:19.292351 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 11:46:19.292351 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 11:46:19.292351 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 11:46:19.292351 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 11:46:19.292351 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 11:46:19.292351 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 11:46:19.292351 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:46:19.292351 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:19.293192 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9fdd75-39d7-490f-befa-fd1b65eaf9cd None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:19.297359 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 500/983] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:46:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:46:19.299004 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3b573-31ca-4aaf-b5db-a0696bca927d None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:19.299360 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 484/984] 10.222.0.15 () {56 vars in 1122 bytes} [Fri Jun 3 11:46:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:19.306594 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9fdd75-39d7-490f-befa-fd1b65eaf9cd None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:19.378281 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:19.378678 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:19.412612 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3b573-31ca-4aaf-b5db-a0696bca927d None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:19.413988 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9fdd75-39d7-490f-befa-fd1b65eaf9cd None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:19.448383 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b18bc-0bf9-45c1-b7d8-931a3c470f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:19.449045 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b18bc-0bf9-45c1-b7d8-931a3c470f98 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:19.449328 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b18bc-0bf9-45c1-b7d8-931a3c470f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:19.449607 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b18bc-0bf9-45c1-b7d8-931a3c470f98 None admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:19.450243 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e9273-65a7-40db-b732-a388e492cf1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:19.450376 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b18bc-0bf9-45c1-b7d8-931a3c470f98 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:19.450692 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b18bc-0bf9-45c1-b7d8-931a3c470f98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:19.451320 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e9273-65a7-40db-b732-a388e492cf1b None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:19.451779 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e9273-65a7-40db-b732-a388e492cf1b None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:19.452157 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b18bc-0bf9-45c1-b7d8-931a3c470f98 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:19.452339 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e9273-65a7-40db-b732-a388e492cf1b None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:19.453190 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6e9273-65a7-40db-b732-a388e492cf1b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:19.453725 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6e9273-65a7-40db-b732-a388e492cf1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:19.455247 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6e9273-65a7-40db-b732-a388e492cf1b None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:19.465018 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 501/985] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 3 11:46:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:19.465315 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 485/986] 10.222.0.15 () {56 vars in 1122 bytes} [Fri Jun 3 11:46:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:46:19.466518 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b18bc-0bf9-45c1-b7d8-931a3c470f98 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:19.470671 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e9273-65a7-40db-b732-a388e492cf1b None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:19.573712 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b18bc-0bf9-45c1-b7d8-931a3c470f98 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:19.580796 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e9273-65a7-40db-b732-a388e492cf1b None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:19.604748 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:19.610864 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062aa311-8124-4b9b-999d-3a827d0d4ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:19.611584 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062aa311-8124-4b9b-999d-3a827d0d4ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:19.611874 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062aa311-8124-4b9b-999d-3a827d0d4ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:19.612152 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062aa311-8124-4b9b-999d-3a827d0d4ad4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:19.612961 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062aa311-8124-4b9b-999d-3a827d0d4ad4 None admin] RBAC: Adding query filter params (interface=admin, service_id=3cfdfbba86fc4bffa8c6e0ff4b06bb75, region_id=RegionOne) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:19.613279 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062aa311-8124-4b9b-999d-3a827d0d4ad4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:19.613990 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:19.615054 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062aa311-8124-4b9b-999d-3a827d0d4ad4 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:19.620170 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ea43d-f3fb-42da-8ec4-957a0985dad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:19.625392 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ea43d-f3fb-42da-8ec4-957a0985dad9 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:19.625553 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 502/987] 10.222.0.15 () {56 vars in 1249 bytes} [Fri Jun 3 11:46:19 2022] GET /identity/v3/endpoints?service_id=3cfdfbba86fc4bffa8c6e0ff4b06bb75&interface=admin®ion_id=RegionOne => generated 193 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:19.625651 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ea43d-f3fb-42da-8ec4-957a0985dad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:19.625651 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ea43d-f3fb-42da-8ec4-957a0985dad9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:19.625651 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ea43d-f3fb-42da-8ec4-957a0985dad9 None admin] RBAC: Adding query filter params (role.id=4e916858113d4ed5bf93f9e457387f15, scope.project.id=cff223ee05524cf4bf3591fc5a39559e, user.id=a55cbe88e78e4f3a82b8703a3b1804e5) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:19.625651 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ea43d-f3fb-42da-8ec4-957a0985dad9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:19.625651 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ea43d-f3fb-42da-8ec4-957a0985dad9 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:19.626494 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062aa311-8124-4b9b-999d-3a827d0d4ad4 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:19.639532 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 486/988] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:46:19 2022] GET /identity/v3/role_assignments?user.id=a55cbe88e78e4f3a82b8703a3b1804e5&scope.project.id=cff223ee05524cf4bf3591fc5a39559e&role.id=4e916858113d4ed5bf93f9e457387f15 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:46:19.743872 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062aa311-8124-4b9b-999d-3a827d0d4ad4 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:19.783988 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ecefb-e71a-4a75-a9f4-df2da8b04954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:19.784700 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ecefb-e71a-4a75-a9f4-df2da8b04954 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:19.784987 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ecefb-e71a-4a75-a9f4-df2da8b04954 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:19.785263 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ecefb-e71a-4a75-a9f4-df2da8b04954 None admin] PATH_INFO: `/v3/services` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:19.785969 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ecefb-e71a-4a75-a9f4-df2da8b04954 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:19.787412 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ecefb-e71a-4a75-a9f4-df2da8b04954 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:19.803808 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 503/989] 10.222.0.15 () {56 vars in 1087 bytes} [Fri Jun 3 11:46:19 2022] GET /identity/v3/services => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:46:20.105324 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98927162-9cf2-4664-b70b-d08fcc0ccb7a None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:20.105694 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98927162-9cf2-4664-b70b-d08fcc0ccb7a None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:20.105889 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98927162-9cf2-4664-b70b-d08fcc0ccb7a None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:20.107377 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 487/990] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:46:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:46:20.112873 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a552c-3410-4eb3-a0bb-01243ad345d8 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:20.113307 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a552c-3410-4eb3-a0bb-01243ad345d8 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:20.113489 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a552c-3410-4eb3-a0bb-01243ad345d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:20.130666 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-b63a552c-3410-4eb3-a0bb-01243ad345d8 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:46:20.131861 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-b63a552c-3410-4eb3-a0bb-01243ad345d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:46:20.185392 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:20.201395 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 504/991] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:46:20 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:46:20.223786 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98927162-9cf2-4664-b70b-d08fcc0ccb7a None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:20.327444 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98927162-9cf2-4664-b70b-d08fcc0ccb7a None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:20.361273 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81828e9f-df3d-44ea-ac67-b8570112e9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:20.362057 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81828e9f-df3d-44ea-ac67-b8570112e9d9 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:20.362339 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81828e9f-df3d-44ea-ac67-b8570112e9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:20.362612 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81828e9f-df3d-44ea-ac67-b8570112e9d9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:20.363252 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81828e9f-df3d-44ea-ac67-b8570112e9d9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:20.364624 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81828e9f-df3d-44ea-ac67-b8570112e9d9 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:20.376982 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-81828e9f-df3d-44ea-ac67-b8570112e9d9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 11:46:20.376982 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:20.376982 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 11:46:20.376982 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 11:46:20.376982 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 11:46:20.376982 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 11:46:20.376982 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 11:46:20.376982 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:46:20.376982 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 11:46:20.376982 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:20.376982 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 11:46:20.376982 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:20.376982 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:20.376982 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:20.376982 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:20.376982 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:20.376982 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:20.377972 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:20.377972 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:20.377972 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:20.377972 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:20.377972 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:20.377972 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:20.377972 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 11:46:20.377972 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 11:46:20.377972 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 11:46:20.377972 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 11:46:20.377972 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:20.377972 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:20.377972 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:20.377972 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:20.377972 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:20.377972 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:20.378824 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:20.378824 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:20.378824 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:20.378824 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:20.378824 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:20.378824 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:20.378824 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:20.378824 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:20.378824 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:20.378824 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:20.378824 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 11:46:20.378824 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:46:20.378824 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 11:46:20.378824 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:20.383176 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 488/992] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:46:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:46:20.384034 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a552c-3410-4eb3-a0bb-01243ad345d8 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:20.481425 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a552c-3410-4eb3-a0bb-01243ad345d8 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:20.515598 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a334a-6444-401e-bb11-ccb588918e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:20.516261 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a334a-6444-401e-bb11-ccb588918e68 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:20.516567 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a334a-6444-401e-bb11-ccb588918e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:20.516837 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a334a-6444-401e-bb11-ccb588918e68 None admin] PATH_INFO: `/v3/services` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:20.517532 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a334a-6444-401e-bb11-ccb588918e68 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:20.517834 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a334a-6444-401e-bb11-ccb588918e68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:20.519196 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a334a-6444-401e-bb11-ccb588918e68 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:20.529054 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 505/993] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Jun 3 11:46:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:20.530330 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81828e9f-df3d-44ea-ac67-b8570112e9d9 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:20.591460 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:20.635157 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81828e9f-df3d-44ea-ac67-b8570112e9d9 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:20.668622 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e729851-5caa-4ecb-b610-96c2f8d1b31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:20.669271 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e729851-5caa-4ecb-b610-96c2f8d1b31c None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:20.669553 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e729851-5caa-4ecb-b610-96c2f8d1b31c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:20.669826 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e729851-5caa-4ecb-b610-96c2f8d1b31c None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:20.670518 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e729851-5caa-4ecb-b610-96c2f8d1b31c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:20.670821 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e729851-5caa-4ecb-b610-96c2f8d1b31c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:20.672201 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e729851-5caa-4ecb-b610-96c2f8d1b31c None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:20.677662 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 489/994] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Jun 3 11:46:20 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:20.683139 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a334a-6444-401e-bb11-ccb588918e68 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:20.739055 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:20.787608 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a334a-6444-401e-bb11-ccb588918e68 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:20.828059 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30717365-6b12-4af7-9120-953ecb0086b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:20.829101 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30717365-6b12-4af7-9120-953ecb0086b9 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:20.829731 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30717365-6b12-4af7-9120-953ecb0086b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:20.830233 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30717365-6b12-4af7-9120-953ecb0086b9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:20.831042 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30717365-6b12-4af7-9120-953ecb0086b9 None admin] RBAC: Adding query filter params (interface=public, service_id=9ed9bbf69f0441db808c35cb2daf85f0, region_id=RegionOne) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:20.831358 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30717365-6b12-4af7-9120-953ecb0086b9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:20.832803 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30717365-6b12-4af7-9120-953ecb0086b9 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:20.840138 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 506/995] 10.222.0.15 () {56 vars in 1251 bytes} [Fri Jun 3 11:46:20 2022] GET /identity/v3/endpoints?service_id=9ed9bbf69f0441db808c35cb2daf85f0&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:20.845903 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e729851-5caa-4ecb-b610-96c2f8d1b31c None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:20.966565 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e729851-5caa-4ecb-b610-96c2f8d1b31c None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:20.992881 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:21.009232 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3a168-951f-4362-b23a-d174a9c552fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:21.010240 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3a168-951f-4362-b23a-d174a9c552fb None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:21.010742 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3a168-951f-4362-b23a-d174a9c552fb None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:21.011226 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3a168-951f-4362-b23a-d174a9c552fb None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:21.012131 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a3a168-951f-4362-b23a-d174a9c552fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:21.013677 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a3a168-951f-4362-b23a-d174a9c552fb None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:21.021194 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 490/996] 10.222.0.15 () {56 vars in 1087 bytes} [Fri Jun 3 11:46:20 2022] GET /identity/v3/services => generated 1727 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 11:46:21.944919 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740dbf17-028f-45df-b95d-3972a78217ef None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:21.945402 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740dbf17-028f-45df-b95d-3972a78217ef None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:21.945478 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740dbf17-028f-45df-b95d-3972a78217ef None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:21.946987 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 507/997] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:46:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:46:21.952151 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa0ab1-e6fa-4c93-93ac-4de6971a56f0 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:21.952547 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa0ab1-e6fa-4c93-93ac-4de6971a56f0 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:21.952710 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa0ab1-e6fa-4c93-93ac-4de6971a56f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:21.969504 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-dbaa0ab1-e6fa-4c93-93ac-4de6971a56f0 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:46:21.970682 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-dbaa0ab1-e6fa-4c93-93ac-4de6971a56f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:46:22.038918 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 491/998] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:46:21 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:46:22.039162 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ef72c-61c6-4b80-b1b7-513d5674ee77 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:22.039263 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ef72c-61c6-4b80-b1b7-513d5674ee77 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:22.039462 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ef72c-61c6-4b80-b1b7-513d5674ee77 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:22.040983 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 508/999] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 11:46:22.049225 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161c7a7-91dd-41af-b909-78c8af8c4ef8 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:22.049521 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161c7a7-91dd-41af-b909-78c8af8c4ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:22.049799 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161c7a7-91dd-41af-b909-78c8af8c4ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:22.062494 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ef72c-61c6-4b80-b1b7-513d5674ee77 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:22.067216 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-8161c7a7-91dd-41af-b909-78c8af8c4ef8 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:46:22.068431 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-8161c7a7-91dd-41af-b909-78c8af8c4ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:46:22.138029 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 492/1000] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:46:22 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:46:22.162031 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8161c7a7-91dd-41af-b909-78c8af8c4ef8 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:22.174009 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ef72c-61c6-4b80-b1b7-513d5674ee77 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:22.191857 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:22.211943 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53c9d3-87d7-459b-bd83-d2637e842a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:22.212296 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:22.212730 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53c9d3-87d7-459b-bd83-d2637e842a48 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:22.213010 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53c9d3-87d7-459b-bd83-d2637e842a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:22.213558 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53c9d3-87d7-459b-bd83-d2637e842a48 None admin] PATH_INFO: `/v3/services/image` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:22.214261 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b53c9d3-87d7-459b-bd83-d2637e842a48 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:22.215711 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b53c9d3-87d7-459b-bd83-d2637e842a48 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:22.228353 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-5b53c9d3-87d7-459b-bd83-d2637e842a48 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 11:46:22.228353 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:22.228353 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 11:46:22.228353 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 11:46:22.228353 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 11:46:22.228353 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 11:46:22.228353 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 11:46:22.228353 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:46:22.228353 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 11:46:22.228353 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:22.228353 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 11:46:22.228353 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:22.228353 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:22.228353 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:22.228353 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:22.228353 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:22.228353 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:22.229388 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:22.229388 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:22.229388 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:22.229388 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:22.229388 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:22.229388 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:22.229388 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 11:46:22.229388 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 11:46:22.229388 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 11:46:22.229388 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 11:46:22.229388 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:22.229388 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:22.229388 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:22.229388 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:22.229388 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:22.229388 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:22.236283 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:22.236283 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:22.236283 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:22.236283 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:22.236283 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:22.236283 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:22.236283 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:22.236283 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:22.236283 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:22.236283 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:22.236283 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 11:46:22.236283 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:46:22.236283 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 11:46:22.236283 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:22.236283 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 509/1001] 10.222.0.15 () {56 vars in 1105 bytes} [Fri Jun 3 11:46:22 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:46:22.238671 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53c9d3-87d7-459b-bd83-d2637e842a48 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:22.272773 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8161c7a7-91dd-41af-b909-78c8af8c4ef8 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:22.308059 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33081667-31db-4d03-8469-43176608d514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:22.308859 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33081667-31db-4d03-8469-43176608d514 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:22.309195 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33081667-31db-4d03-8469-43176608d514 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:22.309419 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33081667-31db-4d03-8469-43176608d514 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:22.310067 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33081667-31db-4d03-8469-43176608d514 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:22.311439 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33081667-31db-4d03-8469-43176608d514 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:22.323594 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-33081667-31db-4d03-8469-43176608d514 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 11:46:22.323594 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:22.323594 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 11:46:22.323594 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 11:46:22.323594 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 11:46:22.323594 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 11:46:22.323594 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 11:46:22.323594 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:46:22.323594 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 11:46:22.323594 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:22.323594 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 11:46:22.323594 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:22.323594 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:22.323594 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:22.323594 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:22.323594 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:22.323594 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:22.324606 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:22.324606 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:22.324606 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:22.324606 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:22.324606 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:22.324606 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:22.324606 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 11:46:22.324606 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 11:46:22.324606 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 11:46:22.324606 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 11:46:22.324606 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:22.324606 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:22.324606 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:22.324606 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:22.324606 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:22.324606 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:22.325437 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:22.325437 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:22.325437 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:22.325437 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:22.325437 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:22.325437 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:22.325437 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:22.325437 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:22.325437 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:22.325437 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:22.325437 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 11:46:22.325437 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:46:22.325437 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 03 11:46:22.325437 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:22.325437 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 493/1002] 10.222.0.15 () {56 vars in 1126 bytes} [Fri Jun 3 11:46:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:46:22.330659 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33081667-31db-4d03-8469-43176608d514 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:22.345174 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53c9d3-87d7-459b-bd83-d2637e842a48 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:22.381232 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e48d2-d842-4eae-8c45-123fb6799ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:22.381897 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e48d2-d842-4eae-8c45-123fb6799ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:22.382182 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e48d2-d842-4eae-8c45-123fb6799ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:22.382458 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e48d2-d842-4eae-8c45-123fb6799ea2 None admin] PATH_INFO: `/v3/services` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:22.383164 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e48d2-d842-4eae-8c45-123fb6799ea2 None admin] RBAC: Adding query filter params (name=image) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:22.383466 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e48d2-d842-4eae-8c45-123fb6799ea2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:22.384869 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e48d2-d842-4eae-8c45-123fb6799ea2 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:22.390687 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 510/1003] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:46:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:46:22.396122 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e48d2-d842-4eae-8c45-123fb6799ea2 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:22.442360 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33081667-31db-4d03-8469-43176608d514 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:22.443013 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:22.456756 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:22.480693 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2ce2f-c650-4464-a2ed-0abdf2acc1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:22.481460 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2ce2f-c650-4464-a2ed-0abdf2acc1e9 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:22.481739 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2ce2f-c650-4464-a2ed-0abdf2acc1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:22.482009 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2ce2f-c650-4464-a2ed-0abdf2acc1e9 None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:22.482698 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2ce2f-c650-4464-a2ed-0abdf2acc1e9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:22.482999 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2ce2f-c650-4464-a2ed-0abdf2acc1e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:22.484605 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2ce2f-c650-4464-a2ed-0abdf2acc1e9 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:22.490355 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 494/1004] 10.222.0.15 () {56 vars in 1122 bytes} [Fri Jun 3 11:46:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:46:22.495836 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2ce2f-c650-4464-a2ed-0abdf2acc1e9 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:22.498951 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e48d2-d842-4eae-8c45-123fb6799ea2 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:22.533717 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acbab1b-dcb9-4e15-8ded-6079a831fb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:22.534380 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acbab1b-dcb9-4e15-8ded-6079a831fb1f None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:22.534661 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acbab1b-dcb9-4e15-8ded-6079a831fb1f None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:22.534934 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acbab1b-dcb9-4e15-8ded-6079a831fb1f None admin] PATH_INFO: `/v3/services` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:22.535661 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acbab1b-dcb9-4e15-8ded-6079a831fb1f None admin] RBAC: Adding query filter params (type=image) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:22.535970 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acbab1b-dcb9-4e15-8ded-6079a831fb1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:22.537395 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acbab1b-dcb9-4e15-8ded-6079a831fb1f None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:22.551541 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 511/1005] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:46:22 2022] GET /identity/v3/services?type=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:46:22.616713 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2ce2f-c650-4464-a2ed-0abdf2acc1e9 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:22.653341 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269b88f-6889-4f1d-9388-d5f84fbc7d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:22.654012 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269b88f-6889-4f1d-9388-d5f84fbc7d77 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:22.654293 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269b88f-6889-4f1d-9388-d5f84fbc7d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:22.654563 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269b88f-6889-4f1d-9388-d5f84fbc7d77 None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:22.655272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0269b88f-6889-4f1d-9388-d5f84fbc7d77 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:22.655603 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0269b88f-6889-4f1d-9388-d5f84fbc7d77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:22.657035 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0269b88f-6889-4f1d-9388-d5f84fbc7d77 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:22.662873 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 495/1006] 10.222.0.15 () {56 vars in 1122 bytes} [Fri Jun 3 11:46:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:46:22.668552 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acbab1b-dcb9-4e15-8ded-6079a831fb1f None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:22.777853 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acbab1b-dcb9-4e15-8ded-6079a831fb1f None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:22.787408 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:22.814604 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6783655-578e-4e26-8bfc-eacab0ea7a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:22.815273 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6783655-578e-4e26-8bfc-eacab0ea7a24 None admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:22.815586 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6783655-578e-4e26-8bfc-eacab0ea7a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:22.815869 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6783655-578e-4e26-8bfc-eacab0ea7a24 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:22.816619 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6783655-578e-4e26-8bfc-eacab0ea7a24 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:22.817988 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6783655-578e-4e26-8bfc-eacab0ea7a24 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:22.839532 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 512/1007] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Jun 3 11:46:22 2022] POST /identity/v3/endpoints => generated 325 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 11:46:23.300644 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816e0a9-464c-4f2e-8ee2-bb5556002c80 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:23.301181 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816e0a9-464c-4f2e-8ee2-bb5556002c80 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:23.301181 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816e0a9-464c-4f2e-8ee2-bb5556002c80 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:23.302730 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 496/1008] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:46:23.309569 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ab1a5-4031-4756-9e25-6f125f894300 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:23.309964 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ab1a5-4031-4756-9e25-6f125f894300 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:23.310146 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ab1a5-4031-4756-9e25-6f125f894300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:23.326855 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-a09ab1a5-4031-4756-9e25-6f125f894300 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:46:23.328053 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-a09ab1a5-4031-4756-9e25-6f125f894300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:46:23.404065 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 513/1009] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:46:23 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:46:23.426845 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816e0a9-464c-4f2e-8ee2-bb5556002c80 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:23.470273 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:23.528984 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816e0a9-464c-4f2e-8ee2-bb5556002c80 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:23.562374 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e000da-4710-4f1e-ba56-8f408f541cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:23.563092 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e000da-4710-4f1e-ba56-8f408f541cba None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:23.563408 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e000da-4710-4f1e-ba56-8f408f541cba None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:23.563707 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e000da-4710-4f1e-ba56-8f408f541cba None admin] PATH_INFO: `/v3/services/compute` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:23.564351 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e000da-4710-4f1e-ba56-8f408f541cba None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:23.565703 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e000da-4710-4f1e-ba56-8f408f541cba None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:23.577324 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-83e000da-4710-4f1e-ba56-8f408f541cba None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 11:46:23.577324 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:23.577324 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 11:46:23.577324 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 11:46:23.577324 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 11:46:23.577324 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 11:46:23.577324 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 11:46:23.577324 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:46:23.577324 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 11:46:23.577324 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:23.577324 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 11:46:23.577324 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:23.577324 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:23.577324 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:23.577324 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:23.577324 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:23.577324 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:23.578339 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:23.578339 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:23.578339 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:23.578339 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:23.578339 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:23.578339 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:23.578339 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 11:46:23.578339 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 11:46:23.578339 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 11:46:23.578339 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 11:46:23.578339 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:23.578339 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:23.578339 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:23.578339 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:23.578339 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:23.578339 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:23.580119 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:23.580119 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:23.580119 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:23.580119 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:23.580119 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:23.580119 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:23.580119 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:23.580119 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:23.580119 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:23.580119 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:23.580119 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 11:46:23.580119 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:46:23.580119 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 03 11:46:23.580119 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:23.583917 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 497/1010] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:46:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:46:23.585060 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ab1a5-4031-4756-9e25-6f125f894300 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:23.678688 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:23.687207 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ab1a5-4031-4756-9e25-6f125f894300 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:23.722681 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afae8bb-3440-4804-a367-792e3f3e8fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:23.723375 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afae8bb-3440-4804-a367-792e3f3e8fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:23.723691 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afae8bb-3440-4804-a367-792e3f3e8fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:23.723967 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afae8bb-3440-4804-a367-792e3f3e8fc9 None admin] PATH_INFO: `/v3/services` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:23.724670 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afae8bb-3440-4804-a367-792e3f3e8fc9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:23.724975 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afae8bb-3440-4804-a367-792e3f3e8fc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:23.726333 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afae8bb-3440-4804-a367-792e3f3e8fc9 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:23.735840 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 514/1011] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Jun 3 11:46:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:23.737365 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e000da-4710-4f1e-ba56-8f408f541cba None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:23.838594 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e000da-4710-4f1e-ba56-8f408f541cba None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:23.840955 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:23.874591 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0789c8ad-0b6d-4d21-bdd8-f942e2882211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:23.875241 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789c8ad-0b6d-4d21-bdd8-f942e2882211 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:23.875543 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789c8ad-0b6d-4d21-bdd8-f942e2882211 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:23.876432 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789c8ad-0b6d-4d21-bdd8-f942e2882211 None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:23.877225 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0789c8ad-0b6d-4d21-bdd8-f942e2882211 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:23.877529 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0789c8ad-0b6d-4d21-bdd8-f942e2882211 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:23.878885 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0789c8ad-0b6d-4d21-bdd8-f942e2882211 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:23.883834 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 498/1012] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Jun 3 11:46:23 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:23.889311 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afae8bb-3440-4804-a367-792e3f3e8fc9 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:23.997364 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afae8bb-3440-4804-a367-792e3f3e8fc9 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:24.032557 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb59f4d-ff42-4ef6-a8b6-e20cbe2c8e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:24.033237 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb59f4d-ff42-4ef6-a8b6-e20cbe2c8e51 None admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:24.033516 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb59f4d-ff42-4ef6-a8b6-e20cbe2c8e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:24.033788 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb59f4d-ff42-4ef6-a8b6-e20cbe2c8e51 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:24.034538 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb59f4d-ff42-4ef6-a8b6-e20cbe2c8e51 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:24.036025 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb59f4d-ff42-4ef6-a8b6-e20cbe2c8e51 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:24.055011 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 515/1013] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Jun 3 11:46:23 2022] POST /identity/v3/endpoints => generated 334 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:46:24.822332 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4158b60-91a9-4539-90da-197708d41a5f None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:24.822862 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4158b60-91a9-4539-90da-197708d41a5f None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:24.822862 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4158b60-91a9-4539-90da-197708d41a5f None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:24.824433 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 499/1014] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:46:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:46:24.829962 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ac650-8e7c-461e-b2b1-4b0e9afd16a3 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:24.830366 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ac650-8e7c-461e-b2b1-4b0e9afd16a3 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:24.830529 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ac650-8e7c-461e-b2b1-4b0e9afd16a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:24.847691 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-163ac650-8e7c-461e-b2b1-4b0e9afd16a3 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:46:24.848853 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-163ac650-8e7c-461e-b2b1-4b0e9afd16a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:46:24.858268 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:24.925747 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 516/1015] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:46:24 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 11:46:24.948233 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4158b60-91a9-4539-90da-197708d41a5f None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:25.052659 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4158b60-91a9-4539-90da-197708d41a5f None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:25.086524 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5b1c3-8faa-46f9-a7a5-e692f2766eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:25.087186 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5b1c3-8faa-46f9-a7a5-e692f2766eb1 None admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:25.087472 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5b1c3-8faa-46f9-a7a5-e692f2766eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:25.088109 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5b1c3-8faa-46f9-a7a5-e692f2766eb1 None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:25.088594 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5b1c3-8faa-46f9-a7a5-e692f2766eb1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:25.089659 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b18bb6-cbb9-454f-93e2-a562631e2b5b None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:25.089952 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b18bb6-cbb9-454f-93e2-a562631e2b5b None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:25.090059 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5b1c3-8faa-46f9-a7a5-e692f2766eb1 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:25.090235 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b18bb6-cbb9-454f-93e2-a562631e2b5b None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:25.091753 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 517/1016] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 11:46:25.097739 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a19a8-37c9-480e-b886-7d31f916d872 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:25.098028 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a19a8-37c9-480e-b886-7d31f916d872 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:25.098427 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a19a8-37c9-480e-b886-7d31f916d872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:25.108631 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 500/1017] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Jun 3 11:46:24 2022] POST /identity/v3/services => generated 242 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 11:46:25.119262 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-554a19a8-37c9-480e-b886-7d31f916d872 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:46:25.120905 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-554a19a8-37c9-480e-b886-7d31f916d872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:46:25.205068 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 518/1018] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:46:25 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 11:46:25.227842 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5b1c3-8faa-46f9-a7a5-e692f2766eb1 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:25.260240 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:25.347362 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5b1c3-8faa-46f9-a7a5-e692f2766eb1 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:25.385833 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f6e34-fb76-4825-88c6-ae120788bb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:25.386904 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f6e34-fb76-4825-88c6-ae120788bb79 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:25.387339 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f6e34-fb76-4825-88c6-ae120788bb79 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:25.387814 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f6e34-fb76-4825-88c6-ae120788bb79 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:25.389117 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f6e34-fb76-4825-88c6-ae120788bb79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:25.390683 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f6e34-fb76-4825-88c6-ae120788bb79 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:25.393061 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 501/1019] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:46:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:25.398682 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a19a8-37c9-480e-b886-7d31f916d872 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:25.465490 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:25.500720 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a19a8-37c9-480e-b886-7d31f916d872 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:25.534269 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a650dc-ad56-415a-8b5c-14a68602c371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:25.534929 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a650dc-ad56-415a-8b5c-14a68602c371 None admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:25.535209 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a650dc-ad56-415a-8b5c-14a68602c371 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:25.535477 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a650dc-ad56-415a-8b5c-14a68602c371 None admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:25.536209 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a650dc-ad56-415a-8b5c-14a68602c371 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:25.537624 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a650dc-ad56-415a-8b5c-14a68602c371 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:25.564456 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 519/1020] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Jun 3 11:46:25 2022] POST /identity/v3/projects => generated 311 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 11:46:26.409433 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873bb29-5ef1-40ff-8b7b-4dd689003047 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:26.409955 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873bb29-5ef1-40ff-8b7b-4dd689003047 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:26.410031 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873bb29-5ef1-40ff-8b7b-4dd689003047 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:26.411382 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 502/1021] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:46:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:46:26.416793 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120c9ae-4e4e-49a1-ab10-c12683790bff None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:26.417207 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120c9ae-4e4e-49a1-ab10-c12683790bff None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:26.417371 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120c9ae-4e4e-49a1-ab10-c12683790bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:26.436667 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-3120c9ae-4e4e-49a1-ab10-c12683790bff None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:46:26.437855 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-3120c9ae-4e4e-49a1-ab10-c12683790bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:46:26.506716 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 520/1022] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:46:26 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:46:26.530042 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873bb29-5ef1-40ff-8b7b-4dd689003047 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:26.625066 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:26.633537 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873bb29-5ef1-40ff-8b7b-4dd689003047 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:26.667930 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23256050-148c-42e9-9a9e-7a630b634700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:26.668658 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23256050-148c-42e9-9a9e-7a630b634700 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:26.668945 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23256050-148c-42e9-9a9e-7a630b634700 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:26.669223 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23256050-148c-42e9-9a9e-7a630b634700 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:26.680183 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23256050-148c-42e9-9a9e-7a630b634700 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:46:26.688892 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-23256050-148c-42e9-9a9e-7a630b634700 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 11:46:26.688892 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:26.688892 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:26.688892 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:26.688892 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:26.688892 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:26.688892 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:26.688892 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:26.688892 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:26.688892 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:26.688892 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:26.688892 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:26.688892 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:46:26.688892 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:46:26.688892 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:46:26.688892 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:46:26.689906 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:46:26.689906 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:46:26.689906 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:46:26.689906 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:46:26.689906 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:26.689906 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:26.689906 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:26.689906 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:26.689906 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:26.689906 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:26.689906 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:26.689906 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:26.689906 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:26.689906 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:26.689906 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:26.689906 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:26.690756 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:26.690756 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:26.690756 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:26.690756 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:26.690756 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:46:26.690756 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:46:26.690756 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:46:26.690756 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:46:26.690756 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:46:26.690756 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:46:26.690756 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 11:46:26.690756 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:26.695020 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 503/1023] 10.222.0.15 () {56 vars in 1120 bytes} [Fri Jun 3 11:46:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:46:26.696311 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3120c9ae-4e4e-49a1-ab10-c12683790bff None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:26.746864 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:26.800294 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3120c9ae-4e4e-49a1-ab10-c12683790bff None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:26.835565 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750052e-cb1e-4f9f-add8-4a1746e97633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:26.836239 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750052e-cb1e-4f9f-add8-4a1746e97633 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:26.836518 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750052e-cb1e-4f9f-add8-4a1746e97633 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:26.836788 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750052e-cb1e-4f9f-add8-4a1746e97633 None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:26.837528 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6750052e-cb1e-4f9f-add8-4a1746e97633 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:26.837829 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6750052e-cb1e-4f9f-add8-4a1746e97633 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:26.839193 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6750052e-cb1e-4f9f-add8-4a1746e97633 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:26.848073 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 521/1024] 10.222.0.15 () {56 vars in 1115 bytes} [Fri Jun 3 11:46:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:26.854000 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23256050-148c-42e9-9a9e-7a630b634700 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:26.959904 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23256050-148c-42e9-9a9e-7a630b634700 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:26.993177 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e82842-c881-4de3-8103-865d7eeaba91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:26.993960 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e82842-c881-4de3-8103-865d7eeaba91 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:26.994240 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e82842-c881-4de3-8103-865d7eeaba91 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:26.994513 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e82842-c881-4de3-8103-865d7eeaba91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:27.004835 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e82842-c881-4de3-8103-865d7eeaba91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:27.006405 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e82842-c881-4de3-8103-865d7eeaba91 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:27.023512 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-43e82842-c881-4de3-8103-865d7eeaba91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:46:27.023512 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:27.023512 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:27.023512 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:27.023512 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:27.023512 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:27.023512 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:27.023512 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:27.023512 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:27.023512 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:27.023512 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:27.023512 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:27.023512 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:46:27.023512 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:46:27.023512 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:46:27.024430 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:46:27.024430 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:27.024430 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:27.024430 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:27.024430 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:27.024430 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:27.024430 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:27.024430 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:27.024430 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:27.024430 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:27.024430 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:27.024430 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:27.024430 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:27.024430 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:27.024430 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:27.024430 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:27.024430 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:27.025328 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:46:27.025328 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:46:27.025328 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:46:27.025328 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:27.025328 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 504/1025] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:46:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:46:27.030692 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750052e-cb1e-4f9f-add8-4a1746e97633 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:27.139625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750052e-cb1e-4f9f-add8-4a1746e97633 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:27.150741 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:27.176282 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c6496-8137-4181-91f7-2cf18ee3f00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:27.176951 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c6496-8137-4181-91f7-2cf18ee3f00e None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:27.177236 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c6496-8137-4181-91f7-2cf18ee3f00e None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:27.177514 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c6496-8137-4181-91f7-2cf18ee3f00e None admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:27.178234 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c6496-8137-4181-91f7-2cf18ee3f00e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:27.178547 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c6496-8137-4181-91f7-2cf18ee3f00e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:27.179953 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c6496-8137-4181-91f7-2cf18ee3f00e None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:27.191865 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 522/1026] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:46:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:46:27.197171 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e82842-c881-4de3-8103-865d7eeaba91 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:27.209297 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:27.301594 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e82842-c881-4de3-8103-865d7eeaba91 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:27.335934 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306fcb60-c44b-4fae-a2d6-786c190e50f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:27.336720 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306fcb60-c44b-4fae-a2d6-786c190e50f0 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:27.336998 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306fcb60-c44b-4fae-a2d6-786c190e50f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:27.337270 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306fcb60-c44b-4fae-a2d6-786c190e50f0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:27.345515 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306fcb60-c44b-4fae-a2d6-786c190e50f0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:27.346966 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306fcb60-c44b-4fae-a2d6-786c190e50f0 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:27.360960 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-306fcb60-c44b-4fae-a2d6-786c190e50f0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 11:46:27.360960 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:27.360960 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:27.360960 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:27.360960 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:27.360960 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:27.360960 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:27.360960 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:27.360960 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:27.360960 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:27.360960 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:27.360960 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:27.360960 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 11:46:27.360960 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 11:46:27.360960 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 11:46:27.360960 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 11:46:27.362152 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:27.362152 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:27.362152 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 11:46:27.362152 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:46:27.362152 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 11:46:27.362152 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:46:27.362152 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:27.362152 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:27.362152 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:27.362152 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:27.362152 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:27.362152 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:27.362152 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:27.362152 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:27.362152 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:27.362152 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:27.362152 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:27.362152 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:27.363569 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:27.363569 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:27.363569 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 11:46:27.363569 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 11:46:27.363569 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 11:46:27.363569 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 11:46:27.363569 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 11:46:27.363569 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 11:46:27.363569 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 11:46:27.363569 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:27.363569 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 505/1027] 10.222.0.15 () {56 vars in 1093 bytes} [Fri Jun 3 11:46:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:46:27.367807 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c6496-8137-4181-91f7-2cf18ee3f00e None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:27.379779 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ecf8e6-2efe-4194-8e28-14e1aef0cf31 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:27.380073 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ecf8e6-2efe-4194-8e28-14e1aef0cf31 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:27.380354 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ecf8e6-2efe-4194-8e28-14e1aef0cf31 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:27.381714 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 506/1028] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 11:46:27.386927 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4afe69-b06e-43b1-80ef-26794cf4f69b None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:27.387228 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4afe69-b06e-43b1-80ef-26794cf4f69b None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:27.387492 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4afe69-b06e-43b1-80ef-26794cf4f69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:27.404896 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-fa4afe69-b06e-43b1-80ef-26794cf4f69b None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:46:27.406091 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-fa4afe69-b06e-43b1-80ef-26794cf4f69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:46:27.468647 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:27.474298 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c6496-8137-4181-91f7-2cf18ee3f00e None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:27.480347 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 507/1029] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:46:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 11:46:27.499141 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4afe69-b06e-43b1-80ef-26794cf4f69b None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:27.516733 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87755bc0-5456-41d6-a7c4-0a34a8427888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:27.517613 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87755bc0-5456-41d6-a7c4-0a34a8427888 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:27.517899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87755bc0-5456-41d6-a7c4-0a34a8427888 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:27.518173 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87755bc0-5456-41d6-a7c4-0a34a8427888 None admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:27.519004 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87755bc0-5456-41d6-a7c4-0a34a8427888 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:27.519316 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87755bc0-5456-41d6-a7c4-0a34a8427888 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:27.520775 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87755bc0-5456-41d6-a7c4-0a34a8427888 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:27.543463 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 523/1030] 10.222.0.15 () {56 vars in 1133 bytes} [Fri Jun 3 11:46:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:27.544616 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87755bc0-5456-41d6-a7c4-0a34a8427888 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:27.577543 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:27.616144 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4afe69-b06e-43b1-80ef-26794cf4f69b None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:27.650745 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b477f-46fc-4f66-b323-64e4597e936f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:27.651945 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b477f-46fc-4f66-b323-64e4597e936f None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:27.652226 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b477f-46fc-4f66-b323-64e4597e936f None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:27.652498 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b477f-46fc-4f66-b323-64e4597e936f None admin] PATH_INFO: `/v3/services/image` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:27.653155 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b477f-46fc-4f66-b323-64e4597e936f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:27.654518 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b477f-46fc-4f66-b323-64e4597e936f None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:27.662688 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87755bc0-5456-41d6-a7c4-0a34a8427888 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:27.666693 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-5d8b477f-46fc-4f66-b323-64e4597e936f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 11:46:27.666693 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:27.666693 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 11:46:27.666693 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 11:46:27.666693 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 11:46:27.666693 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 11:46:27.666693 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 11:46:27.666693 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:46:27.666693 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 11:46:27.666693 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:27.666693 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 11:46:27.666693 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:27.666693 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:27.666693 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:27.666693 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:27.666693 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:27.666693 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:27.667708 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:27.667708 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:27.667708 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:27.667708 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:27.667708 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:27.667708 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:27.667708 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 11:46:27.667708 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 11:46:27.667708 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 11:46:27.667708 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 11:46:27.667708 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:27.667708 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:27.667708 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:27.667708 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:27.667708 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:27.667708 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:27.668569 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:27.668569 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:27.668569 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:27.668569 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:27.668569 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:27.668569 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:27.668569 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:27.668569 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:27.668569 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:27.668569 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:27.668569 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 11:46:27.668569 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:46:27.668569 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 11:46:27.668569 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:27.673501 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 508/1031] 10.222.0.15 () {56 vars in 1105 bytes} [Fri Jun 3 11:46:27 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:46:27.674260 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b477f-46fc-4f66-b323-64e4597e936f None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:27.701134 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a6fa6-fed3-40b3-a3a2-e0e8769c76a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:27.702163 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a6fa6-fed3-40b3-a3a2-e0e8769c76a6 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:27.702740 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a6fa6-fed3-40b3-a3a2-e0e8769c76a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:27.703200 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a6fa6-fed3-40b3-a3a2-e0e8769c76a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:27.738855 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:27.778072 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a6fa6-fed3-40b3-a3a2-e0e8769c76a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:27.779166 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b477f-46fc-4f66-b323-64e4597e936f None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:27.779553 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a6fa6-fed3-40b3-a3a2-e0e8769c76a6 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:27.809681 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:27.816105 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914269cf-d382-43b2-b729-33167678a8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:27.816778 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914269cf-d382-43b2-b729-33167678a8c2 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:27.817062 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914269cf-d382-43b2-b729-33167678a8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:27.817349 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914269cf-d382-43b2-b729-33167678a8c2 None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:27.818057 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914269cf-d382-43b2-b729-33167678a8c2 None admin] RBAC: Adding query filter params (name=image) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:27.818363 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914269cf-d382-43b2-b729-33167678a8c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:27.819783 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914269cf-d382-43b2-b729-33167678a8c2 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:27.824907 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 509/1032] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:46:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:46:27.830446 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914269cf-d382-43b2-b729-33167678a8c2 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:27.893254 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 524/1033] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:46:27 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 11:46:27.893950 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e66f0-aef3-47b1-a175-eee30fdc86b6 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:27.894240 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e66f0-aef3-47b1-a175-eee30fdc86b6 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:27.894562 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e66f0-aef3-47b1-a175-eee30fdc86b6 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:27.896422 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 525/1034] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:46:27.898963 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e66f0-aef3-47b1-a175-eee30fdc86b6 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:27.939994 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914269cf-d382-43b2-b729-33167678a8c2 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:27.964297 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:27.974120 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62346874-a877-4ea6-a11e-9f719c2f9586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:27.974779 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62346874-a877-4ea6-a11e-9f719c2f9586 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:27.975065 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62346874-a877-4ea6-a11e-9f719c2f9586 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:27.975345 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62346874-a877-4ea6-a11e-9f719c2f9586 None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:27.976087 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62346874-a877-4ea6-a11e-9f719c2f9586 None admin] RBAC: Adding query filter params (type=image) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:27.976397 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62346874-a877-4ea6-a11e-9f719c2f9586 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:27.977779 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62346874-a877-4ea6-a11e-9f719c2f9586 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:27.982554 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 510/1035] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:46:27 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:46:27.982554 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052aeaf-96bb-4ee7-a67a-c063748dbfd1 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:27.982554 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052aeaf-96bb-4ee7-a67a-c063748dbfd1 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:27.982554 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052aeaf-96bb-4ee7-a67a-c063748dbfd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:28.000613 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-2052aeaf-96bb-4ee7-a67a-c063748dbfd1 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:46:28.001795 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-2052aeaf-96bb-4ee7-a67a-c063748dbfd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:46:28.006908 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e66f0-aef3-47b1-a175-eee30fdc86b6 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:28.033336 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:28.041378 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d3191-3254-45b3-986f-db893923c48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:28.042164 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d3191-3254-45b3-986f-db893923c48d None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:28.042452 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d3191-3254-45b3-986f-db893923c48d None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:28.042723 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d3191-3254-45b3-986f-db893923c48d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:28.053495 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d3191-3254-45b3-986f-db893923c48d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:28.054921 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d3191-3254-45b3-986f-db893923c48d None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:28.068461 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 511/1036] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:46:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:46:28.069292 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052aeaf-96bb-4ee7-a67a-c063748dbfd1 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:28.071796 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-bf0d3191-3254-45b3-986f-db893923c48d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:46:28.071796 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:28.071796 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:28.071796 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:28.071796 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:28.071796 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:28.071796 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:28.071796 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:28.071796 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:28.071796 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:28.071796 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:28.071796 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:28.071796 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:46:28.071796 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:46:28.071796 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:46:28.072705 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:46:28.072705 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:28.072705 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:28.072705 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:28.072705 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:28.072705 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:28.072705 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:28.072705 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:28.072705 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:28.072705 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:28.072705 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:28.072705 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:28.072705 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:28.072705 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:28.072705 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:28.072705 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:28.072705 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:28.073616 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:46:28.073616 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:46:28.073616 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:46:28.073616 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:28.073616 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 526/1037] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:46:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:46:28.078306 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d3191-3254-45b3-986f-db893923c48d None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:28.174237 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052aeaf-96bb-4ee7-a67a-c063748dbfd1 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:28.178607 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d3191-3254-45b3-986f-db893923c48d None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:28.193482 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:28.210578 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641345ee-5dde-4ee7-96a6-d9cc2bb16a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:28.211233 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641345ee-5dde-4ee7-96a6-d9cc2bb16a6a None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:28.211541 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641345ee-5dde-4ee7-96a6-d9cc2bb16a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:28.211828 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641345ee-5dde-4ee7-96a6-d9cc2bb16a6a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:28.212612 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641345ee-5dde-4ee7-96a6-d9cc2bb16a6a None admin] RBAC: Adding query filter params (interface=public, service_id=2cd75fcbb5ab485d9af7553b84701a9d, region_id=RegionOne) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:28.212924 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641345ee-5dde-4ee7-96a6-d9cc2bb16a6a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:28.213315 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b9c53-5aaa-4b5e-ab02-b8675caff407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:28.213970 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b9c53-5aaa-4b5e-ab02-b8675caff407 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:28.214256 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b9c53-5aaa-4b5e-ab02-b8675caff407 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:28.214349 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641345ee-5dde-4ee7-96a6-d9cc2bb16a6a None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:28.214532 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b9c53-5aaa-4b5e-ab02-b8675caff407 None admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:28.215248 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b9c53-5aaa-4b5e-ab02-b8675caff407 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:28.215583 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b9c53-5aaa-4b5e-ab02-b8675caff407 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:28.216929 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b9c53-5aaa-4b5e-ab02-b8675caff407 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:28.220012 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 512/1038] 10.222.0.15 () {56 vars in 1251 bytes} [Fri Jun 3 11:46:28 2022] GET /identity/v3/endpoints?service_id=2cd75fcbb5ab485d9af7553b84701a9d&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:28.220910 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641345ee-5dde-4ee7-96a6-d9cc2bb16a6a None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:28.230749 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 527/1039] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:46:28.230749 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b9c53-5aaa-4b5e-ab02-b8675caff407 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:28.275894 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:28.321479 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641345ee-5dde-4ee7-96a6-d9cc2bb16a6a None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:28.333291 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b9c53-5aaa-4b5e-ab02-b8675caff407 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:28.355725 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0df62d-6600-4367-a907-38ec5b1ac5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:28.356519 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0df62d-6600-4367-a907-38ec5b1ac5e8 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:28.356779 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0df62d-6600-4367-a907-38ec5b1ac5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:28.357050 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0df62d-6600-4367-a907-38ec5b1ac5e8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:28.358203 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0df62d-6600-4367-a907-38ec5b1ac5e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:28.359659 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0df62d-6600-4367-a907-38ec5b1ac5e8 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:28.361391 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 513/1040] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:46:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:28.362133 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0df62d-6600-4367-a907-38ec5b1ac5e8 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:28.370505 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21fe8f-fa4c-4b55-a9fb-a8439674886c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:28.371169 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21fe8f-fa4c-4b55-a9fb-a8439674886c None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:28.371452 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21fe8f-fa4c-4b55-a9fb-a8439674886c None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:28.371784 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21fe8f-fa4c-4b55-a9fb-a8439674886c None admin] PATH_INFO: `/v3/services` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:28.372464 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac21fe8f-fa4c-4b55-a9fb-a8439674886c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:28.373825 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac21fe8f-fa4c-4b55-a9fb-a8439674886c None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:28.380385 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 528/1041] 10.222.0.15 () {56 vars in 1087 bytes} [Fri Jun 3 11:46:28 2022] GET /identity/v3/services => generated 1957 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:46:28.381012 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21fe8f-fa4c-4b55-a9fb-a8439674886c None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:28.430693 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:28.487690 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0df62d-6600-4367-a907-38ec5b1ac5e8 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:28.494664 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21fe8f-fa4c-4b55-a9fb-a8439674886c None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:28.497196 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:28.526656 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5273f1d-eae2-4659-8d5d-122e0f99370a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:28.527464 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5273f1d-eae2-4659-8d5d-122e0f99370a None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:28.527782 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5273f1d-eae2-4659-8d5d-122e0f99370a None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:28.528059 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5273f1d-eae2-4659-8d5d-122e0f99370a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:28.534037 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd0770-07b9-4d80-9b25-e96f5e32f507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:28.534729 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd0770-07b9-4d80-9b25-e96f5e32f507 None admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:28.535015 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd0770-07b9-4d80-9b25-e96f5e32f507 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:28.535295 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd0770-07b9-4d80-9b25-e96f5e32f507 None admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:28.536069 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd0770-07b9-4d80-9b25-e96f5e32f507 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:28.536311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5273f1d-eae2-4659-8d5d-122e0f99370a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:28.537518 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd0770-07b9-4d80-9b25-e96f5e32f507 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:28.537756 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5273f1d-eae2-4659-8d5d-122e0f99370a None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:28.553677 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-b5273f1d-eae2-4659-8d5d-122e0f99370a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:46:28.553677 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:28.553677 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:28.553677 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:28.553677 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:28.553677 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:28.553677 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:28.553677 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:28.553677 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:28.553677 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:28.553677 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:28.553677 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:28.553677 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 11:46:28.553677 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 11:46:28.553677 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 11:46:28.554704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 11:46:28.554704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:28.554704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:28.554704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:28.554704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:28.554704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:28.554704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:28.554704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:28.554704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:28.554704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:28.554704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:28.554704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:28.554704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:28.554704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:28.554704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:28.554704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:28.554704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:28.555667 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 11:46:28.555667 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 11:46:28.555667 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 11:46:28.555667 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 11:46:28.555667 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 11:46:28.555667 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 11:46:28.555667 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:46:28.555667 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:28.555667 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 514/1042] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:46:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:46:28.560848 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5273f1d-eae2-4659-8d5d-122e0f99370a None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:28.563539 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 529/1043] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Jun 3 11:46:28 2022] POST /identity/v3/users => generated 285 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:46:28.682972 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5273f1d-eae2-4659-8d5d-122e0f99370a None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:28.698240 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:28.723031 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d95356-cde6-43b4-89c0-9f1e0585a75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:28.723849 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d95356-cde6-43b4-89c0-9f1e0585a75a None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:28.724201 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d95356-cde6-43b4-89c0-9f1e0585a75a None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:28.724586 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d95356-cde6-43b4-89c0-9f1e0585a75a None admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:28.725459 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d95356-cde6-43b4-89c0-9f1e0585a75a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:28.725950 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d95356-cde6-43b4-89c0-9f1e0585a75a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:28.727365 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d95356-cde6-43b4-89c0-9f1e0585a75a None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:28.745709 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 515/1044] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 3 11:46:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:46:28.747001 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd0770-07b9-4d80-9b25-e96f5e32f507 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:28.853928 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd0770-07b9-4d80-9b25-e96f5e32f507 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:28.888152 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69775130-da09-4610-8733-7e5c2c154fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:28.888810 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69775130-da09-4610-8733-7e5c2c154fad None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:28.889093 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69775130-da09-4610-8733-7e5c2c154fad None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:28.889366 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69775130-da09-4610-8733-7e5c2c154fad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:28.890195 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69775130-da09-4610-8733-7e5c2c154fad None admin] RBAC: Adding query filter params (role.id=4e916858113d4ed5bf93f9e457387f15, scope.project.id=cff223ee05524cf4bf3591fc5a39559e, user.id=6247bfb7aebd45eeb97ba5933be44c6d) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:28.891835 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69775130-da09-4610-8733-7e5c2c154fad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:28.894067 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69775130-da09-4610-8733-7e5c2c154fad None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:28.901215 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 530/1045] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:46:28 2022] GET /identity/v3/role_assignments?user.id=6247bfb7aebd45eeb97ba5933be44c6d&scope.project.id=cff223ee05524cf4bf3591fc5a39559e&role.id=4e916858113d4ed5bf93f9e457387f15 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:30.643250 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b9dbf-0cb3-4250-853f-0add1d0ed31c None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:30.643864 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b9dbf-0cb3-4250-853f-0add1d0ed31c None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:30.643864 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b9dbf-0cb3-4250-853f-0add1d0ed31c None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:30.645214 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 516/1046] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:46:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:46:30.650736 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf4196-fcce-4ce7-a291-1f9dc2a0b755 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:30.651137 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf4196-fcce-4ce7-a291-1f9dc2a0b755 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:30.651596 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf4196-fcce-4ce7-a291-1f9dc2a0b755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:30.668582 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-8baf4196-fcce-4ce7-a291-1f9dc2a0b755 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:46:30.669748 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-8baf4196-fcce-4ce7-a291-1f9dc2a0b755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:46:30.696631 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:30.748939 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 531/1047] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:46:30 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:46:30.772265 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b9dbf-0cb3-4250-853f-0add1d0ed31c None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:30.855034 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58114775-bf46-458b-85ce-d5d9e5ee5a1c None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:30.855358 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58114775-bf46-458b-85ce-d5d9e5ee5a1c None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:30.855630 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58114775-bf46-458b-85ce-d5d9e5ee5a1c None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:30.857118 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 532/1048] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:46:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 11:46:30.862391 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183c29a-3937-44c3-ae44-fe3800b6b051 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:30.862679 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183c29a-3937-44c3-ae44-fe3800b6b051 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:30.862954 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183c29a-3937-44c3-ae44-fe3800b6b051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:30.879159 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-f183c29a-3937-44c3-ae44-fe3800b6b051 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:46:30.880359 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-f183c29a-3937-44c3-ae44-fe3800b6b051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:46:30.881804 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b9dbf-0cb3-4250-853f-0add1d0ed31c None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:30.924711 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c480e9-ae7a-403f-a37f-45e01aef8216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:30.925494 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c480e9-ae7a-403f-a37f-45e01aef8216 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:30.925770 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c480e9-ae7a-403f-a37f-45e01aef8216 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:30.926152 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c480e9-ae7a-403f-a37f-45e01aef8216 None admin] PATH_INFO: `/v3/services/image` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:30.926795 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c480e9-ae7a-403f-a37f-45e01aef8216 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:30.928173 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c480e9-ae7a-403f-a37f-45e01aef8216 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:30.940492 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-41c480e9-ae7a-403f-a37f-45e01aef8216 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 11:46:30.940492 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:30.940492 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 11:46:30.940492 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 11:46:30.940492 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 11:46:30.940492 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 11:46:30.940492 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 11:46:30.940492 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:46:30.940492 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 11:46:30.940492 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:30.940492 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 11:46:30.940492 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:30.940492 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:30.940492 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:30.940492 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:30.940492 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:30.940492 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:30.941528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:30.941528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:30.941528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:30.941528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:30.941528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:30.941528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:30.941528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 11:46:30.941528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 11:46:30.941528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 11:46:30.941528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 11:46:30.941528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:30.941528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:30.941528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:30.941528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:30.941528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:30.941528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:30.942412 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:30.942412 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:30.942412 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:30.942412 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:30.942412 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:30.942412 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:30.942412 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:30.942412 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:30.942412 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:30.942412 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:30.942412 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 11:46:30.942412 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:46:30.942412 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 03 11:46:30.942412 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:30.946606 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 517/1049] 10.222.0.15 () {56 vars in 1105 bytes} [Fri Jun 3 11:46:30 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:46:30.947966 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c480e9-ae7a-403f-a37f-45e01aef8216 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:30.958725 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 533/1050] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:46:30 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 11:46:30.981576 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f183c29a-3937-44c3-ae44-fe3800b6b051 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:30.986170 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:31.055900 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c480e9-ae7a-403f-a37f-45e01aef8216 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:31.071561 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:31.090440 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f183c29a-3937-44c3-ae44-fe3800b6b051 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:31.092007 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0a35c-2302-4e18-9673-806306944227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:31.093372 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0a35c-2302-4e18-9673-806306944227 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:31.093372 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0a35c-2302-4e18-9673-806306944227 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:31.093372 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0a35c-2302-4e18-9673-806306944227 None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:31.093880 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef0a35c-2302-4e18-9673-806306944227 None admin] RBAC: Adding query filter params (name=image) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:31.094768 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef0a35c-2302-4e18-9673-806306944227 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:31.096195 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef0a35c-2302-4e18-9673-806306944227 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:31.105763 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 518/1051] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:46:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:46:31.106741 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0a35c-2302-4e18-9673-806306944227 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:31.132008 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2284eb2-7114-49d4-ba85-cf3e55b93e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:31.132810 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2284eb2-7114-49d4-ba85-cf3e55b93e39 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:31.133098 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2284eb2-7114-49d4-ba85-cf3e55b93e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:31.133378 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2284eb2-7114-49d4-ba85-cf3e55b93e39 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:31.143960 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2284eb2-7114-49d4-ba85-cf3e55b93e39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:46:31.151973 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-d2284eb2-7114-49d4-ba85-cf3e55b93e39 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:46:31.151973 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:31.151973 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:31.151973 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:31.151973 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:31.151973 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:31.151973 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:31.151973 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:31.151973 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:31.151973 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:31.151973 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:31.151973 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:31.151973 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:46:31.151973 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:46:31.151973 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:46:31.151973 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:46:31.152981 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:46:31.152981 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:46:31.152981 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:46:31.152981 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:46:31.152981 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:31.152981 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:31.152981 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:31.152981 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:31.152981 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:31.152981 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:31.152981 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:31.152981 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:31.152981 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:31.152981 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:31.152981 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:31.152981 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:31.156379 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:31.156379 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:31.156379 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:31.156379 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:31.156379 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:46:31.156379 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:46:31.156379 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:46:31.156379 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:46:31.156379 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:46:31.156379 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:46:31.156379 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:46:31.156379 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:31.156379 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 534/1052] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 3 11:46:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:46:31.156379 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f65ac-d5bf-4d32-832a-be0d65381f7f None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:31.157929 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f65ac-d5bf-4d32-832a-be0d65381f7f None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:31.157929 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f65ac-d5bf-4d32-832a-be0d65381f7f None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:31.157929 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 535/1053] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:46:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:46:31.159769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f65ac-d5bf-4d32-832a-be0d65381f7f None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:31.204731 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:31.207920 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0a35c-2302-4e18-9673-806306944227 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:31.241319 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f438d7-eb0f-4ee0-a2c5-7abb7bbcb716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:31.242002 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f438d7-eb0f-4ee0-a2c5-7abb7bbcb716 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:31.242288 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f438d7-eb0f-4ee0-a2c5-7abb7bbcb716 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:31.242549 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f438d7-eb0f-4ee0-a2c5-7abb7bbcb716 None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:31.243250 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f438d7-eb0f-4ee0-a2c5-7abb7bbcb716 None admin] RBAC: Adding query filter params (type=image) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:31.243579 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f438d7-eb0f-4ee0-a2c5-7abb7bbcb716 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:31.244946 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f438d7-eb0f-4ee0-a2c5-7abb7bbcb716 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:31.250155 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 519/1054] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:46:31 2022] GET /identity/v3/services?type=image => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:31.251329 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e859003-9fef-4004-a0e2-b9be9990c347 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:31.251690 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e859003-9fef-4004-a0e2-b9be9990c347 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:31.251975 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e859003-9fef-4004-a0e2-b9be9990c347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:31.262037 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f65ac-d5bf-4d32-832a-be0d65381f7f None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:31.268123 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-0e859003-9fef-4004-a0e2-b9be9990c347 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:46:31.269308 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-0e859003-9fef-4004-a0e2-b9be9990c347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:46:31.296061 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b39eb98-a634-48e2-b0fb-5503c69936fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:31.296724 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b39eb98-a634-48e2-b0fb-5503c69936fc None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:31.297005 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b39eb98-a634-48e2-b0fb-5503c69936fc None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:31.297276 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b39eb98-a634-48e2-b0fb-5503c69936fc None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:31.298035 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b39eb98-a634-48e2-b0fb-5503c69936fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:31.298339 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b39eb98-a634-48e2-b0fb-5503c69936fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:31.299710 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b39eb98-a634-48e2-b0fb-5503c69936fc None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:31.308570 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 536/1055] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:46:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:31.312370 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b39eb98-a634-48e2-b0fb-5503c69936fc None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:31.320813 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:31.338689 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 520/1056] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:46:31 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:46:31.339525 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e859003-9fef-4004-a0e2-b9be9990c347 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:31.419410 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b39eb98-a634-48e2-b0fb-5503c69936fc None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:31.434150 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:31.441172 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e859003-9fef-4004-a0e2-b9be9990c347 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:31.452426 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95e5c9-2f5d-4306-92a1-99f1d5a426b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:31.453076 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95e5c9-2f5d-4306-92a1-99f1d5a426b7 None admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:31.453370 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95e5c9-2f5d-4306-92a1-99f1d5a426b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:31.454170 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95e5c9-2f5d-4306-92a1-99f1d5a426b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:31.454899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d95e5c9-2f5d-4306-92a1-99f1d5a426b7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:31.456300 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d95e5c9-2f5d-4306-92a1-99f1d5a426b7 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:31.475522 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 537/1057] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Jun 3 11:46:31 2022] POST /identity/v3/endpoints => generated 327 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:46:31.476322 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95e5c9-2f5d-4306-92a1-99f1d5a426b7 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:31.488431 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da91efd-7b24-478e-a796-06c73df1463b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:31.489321 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da91efd-7b24-478e-a796-06c73df1463b None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:31.489601 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da91efd-7b24-478e-a796-06c73df1463b None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:31.489877 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da91efd-7b24-478e-a796-06c73df1463b None admin] PATH_INFO: `/v3/users/ea337cb4181144248ccc966e2b736035` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:31.506359 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da91efd-7b24-478e-a796-06c73df1463b None admin] RBAC: Authorizing `identity:get_user(user_id=ea337cb4181144248ccc966e2b736035)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:31.507902 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da91efd-7b24-478e-a796-06c73df1463b None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:31.514537 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 521/1058] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:46:31 2022] GET /identity/v3/users/ea337cb4181144248ccc966e2b736035 => generated 285 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:31.515547 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da91efd-7b24-478e-a796-06c73df1463b None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:31.560295 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:31.607038 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95e5c9-2f5d-4306-92a1-99f1d5a426b7 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:31.635196 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da91efd-7b24-478e-a796-06c73df1463b None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:31.647423 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5dc87c-2bef-4b3b-8203-0d61e0e27a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:31.648697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5dc87c-2bef-4b3b-8203-0d61e0e27a39 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:31.648989 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5dc87c-2bef-4b3b-8203-0d61e0e27a39 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:31.649250 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5dc87c-2bef-4b3b-8203-0d61e0e27a39 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:31.662146 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5dc87c-2bef-4b3b-8203-0d61e0e27a39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:46:31.670402 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-ab5dc87c-2bef-4b3b-8203-0d61e0e27a39 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 11:46:31.670402 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:31.670402 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:31.670402 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:31.670402 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:31.670402 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:31.670402 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:31.670402 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:31.670402 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:31.670402 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:31.670402 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:31.670402 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:31.670402 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:46:31.670402 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:46:31.670402 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:46:31.670402 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:46:31.671427 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:46:31.671427 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:46:31.671427 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:46:31.671427 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:46:31.671427 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:31.671427 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:31.671427 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:31.671427 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:31.671427 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:31.671427 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:31.671427 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:31.671427 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:31.671427 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:31.671427 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:31.671427 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:31.671427 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:31.672506 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:31.672506 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:31.672506 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:31.672506 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:31.672506 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:46:31.672506 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:46:31.672506 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:46:31.672506 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:46:31.672506 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:46:31.672506 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:46:31.672506 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 11:46:31.672506 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:31.672506 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 538/1059] 10.222.0.15 () {56 vars in 1120 bytes} [Fri Jun 3 11:46:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:46:31.678138 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5dc87c-2bef-4b3b-8203-0d61e0e27a39 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:31.679160 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625d8a8-7edd-4e3f-b128-b786d759bead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:31.680690 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625d8a8-7edd-4e3f-b128-b786d759bead None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:31.680690 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625d8a8-7edd-4e3f-b128-b786d759bead None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:31.680690 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625d8a8-7edd-4e3f-b128-b786d759bead None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:31.703123 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:31.759989 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c625d8a8-7edd-4e3f-b128-b786d759bead None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:31.761450 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c625d8a8-7edd-4e3f-b128-b786d759bead None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:31.787905 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5dc87c-2bef-4b3b-8203-0d61e0e27a39 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:31.810495 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:31.824827 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ac7c1-dc45-4808-80fc-a854f889857d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:31.825493 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ac7c1-dc45-4808-80fc-a854f889857d None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:31.825773 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ac7c1-dc45-4808-80fc-a854f889857d None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:31.826042 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ac7c1-dc45-4808-80fc-a854f889857d None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:31.826779 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7ac7c1-dc45-4808-80fc-a854f889857d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:31.827084 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7ac7c1-dc45-4808-80fc-a854f889857d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:31.828476 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7ac7c1-dc45-4808-80fc-a854f889857d None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:31.837072 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 539/1060] 10.222.0.15 () {56 vars in 1115 bytes} [Fri Jun 3 11:46:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:46:31.842594 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ac7c1-dc45-4808-80fc-a854f889857d None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:31.863151 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 522/1061] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:46:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 03 11:46:31.868612 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625d8a8-7edd-4e3f-b128-b786d759bead None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:31.923354 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:31.955714 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ac7c1-dc45-4808-80fc-a854f889857d None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:31.979213 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625d8a8-7edd-4e3f-b128-b786d759bead None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:31.991952 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c30c03-edc1-4623-bcd7-1481d77fd91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:31.992758 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c30c03-edc1-4623-bcd7-1481d77fd91e None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:31.993042 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c30c03-edc1-4623-bcd7-1481d77fd91e None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:31.993320 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c30c03-edc1-4623-bcd7-1481d77fd91e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:32.004975 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c30c03-edc1-4623-bcd7-1481d77fd91e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:32.006440 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c30c03-edc1-4623-bcd7-1481d77fd91e None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:32.017222 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4104df-7028-4dc1-840c-7bf90ddc4fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:32.018085 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4104df-7028-4dc1-840c-7bf90ddc4fef None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:32.018368 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4104df-7028-4dc1-840c-7bf90ddc4fef None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:32.018645 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4104df-7028-4dc1-840c-7bf90ddc4fef None admin] PATH_INFO: `/v3/projects/f64a28716fe04a18bf8389e3428e2088` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:32.019856 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4104df-7028-4dc1-840c-7bf90ddc4fef None admin] RBAC: Authorizing `identity:get_project(project_id=f64a28716fe04a18bf8389e3428e2088)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:32.021291 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4104df-7028-4dc1-840c-7bf90ddc4fef None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:32.031853 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 523/1062] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:46:31 2022] GET /identity/v3/projects/f64a28716fe04a18bf8389e3428e2088 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:46:32.031988 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-d6c30c03-edc1-4623-bcd7-1481d77fd91e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:46:32.031988 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:32.031988 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:32.031988 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:32.031988 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:32.031988 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:32.031988 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:32.031988 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:32.031988 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:32.031988 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:32.031988 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:32.031988 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:32.031988 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:46:32.031988 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:46:32.031988 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:46:32.032999 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:46:32.032999 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:32.032999 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:32.032999 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:32.032999 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:32.032999 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:32.032999 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:32.032999 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:32.032999 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:32.032999 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:32.032999 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:32.032999 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:32.032999 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:32.032999 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:32.032999 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:32.032999 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:32.032999 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:32.034088 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:46:32.034088 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:46:32.034088 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:46:32.034088 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:32.034088 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 540/1063] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:46:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:46:32.034434 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4104df-7028-4dc1-840c-7bf90ddc4fef None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:32.036302 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c30c03-edc1-4623-bcd7-1481d77fd91e None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:32.078217 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:32.137902 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4104df-7028-4dc1-840c-7bf90ddc4fef None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:32.147819 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c30c03-edc1-4623-bcd7-1481d77fd91e None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:32.154714 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:32.173713 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07a53b-cdc8-4715-9879-25b2683bdf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:32.174289 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07a53b-cdc8-4715-9879-25b2683bdf83 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:32.174570 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07a53b-cdc8-4715-9879-25b2683bdf83 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:32.174844 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07a53b-cdc8-4715-9879-25b2683bdf83 None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:32.175578 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07a53b-cdc8-4715-9879-25b2683bdf83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:32.175890 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07a53b-cdc8-4715-9879-25b2683bdf83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:32.177230 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07a53b-cdc8-4715-9879-25b2683bdf83 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:32.185755 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05ddf7-f08f-4c8f-bb89-127368198578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:32.186400 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05ddf7-f08f-4c8f-bb89-127368198578 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:32.186683 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05ddf7-f08f-4c8f-bb89-127368198578 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:32.186969 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05ddf7-f08f-4c8f-bb89-127368198578 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:32.187803 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05ddf7-f08f-4c8f-bb89-127368198578 None admin] RBAC: Adding query filter params (role.id=c486e164840b41a59fd118dece2ce572, scope.project.id=f64a28716fe04a18bf8389e3428e2088, user.id=ea337cb4181144248ccc966e2b736035) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:32.188719 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05ddf7-f08f-4c8f-bb89-127368198578 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:32.189829 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 524/1064] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:32.190139 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05ddf7-f08f-4c8f-bb89-127368198578 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:32.194990 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07a53b-cdc8-4715-9879-25b2683bdf83 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:32.207854 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 541/1065] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:46:32 2022] GET /identity/v3/role_assignments?user.id=ea337cb4181144248ccc966e2b736035&scope.project.id=f64a28716fe04a18bf8389e3428e2088&role.id=c486e164840b41a59fd118dece2ce572 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:46:32.316349 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07a53b-cdc8-4715-9879-25b2683bdf83 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:32.352810 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee1ffd-cc9e-4aa9-89ea-0c62d5bbedc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:32.353598 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee1ffd-cc9e-4aa9-89ea-0c62d5bbedc9 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:32.353878 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee1ffd-cc9e-4aa9-89ea-0c62d5bbedc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:32.354156 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee1ffd-cc9e-4aa9-89ea-0c62d5bbedc9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:32.363311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ee1ffd-cc9e-4aa9-89ea-0c62d5bbedc9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:32.364811 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ee1ffd-cc9e-4aa9-89ea-0c62d5bbedc9 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:32.379687 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-07ee1ffd-cc9e-4aa9-89ea-0c62d5bbedc9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 11:46:32.379687 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:32.379687 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:32.379687 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:32.379687 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:32.379687 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:32.379687 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:32.379687 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:32.379687 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:32.379687 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:32.379687 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:32.379687 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:32.379687 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 11:46:32.379687 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 11:46:32.379687 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 11:46:32.379687 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 11:46:32.380716 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:32.380716 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:32.380716 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 11:46:32.380716 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:46:32.380716 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 11:46:32.380716 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:46:32.380716 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:32.380716 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:32.380716 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:32.380716 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:32.380716 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:32.380716 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:32.380716 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:32.380716 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:32.380716 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:32.380716 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:32.380716 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:32.380716 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:32.381649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:32.381649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:32.381649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 11:46:32.381649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 11:46:32.381649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 11:46:32.381649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 11:46:32.381649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 11:46:32.381649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 11:46:32.381649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 11:46:32.381649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:32.383827 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 525/1066] 10.222.0.15 () {56 vars in 1093 bytes} [Fri Jun 3 11:46:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:46:32.386596 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05ddf7-f08f-4c8f-bb89-127368198578 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:32.486658 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:32.489919 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05ddf7-f08f-4c8f-bb89-127368198578 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:32.523832 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8c0df-1531-437f-8a57-ceca8450e58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:32.524497 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8c0df-1531-437f-8a57-ceca8450e58d None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:32.524775 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8c0df-1531-437f-8a57-ceca8450e58d None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:32.525044 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8c0df-1531-437f-8a57-ceca8450e58d None admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:32.525868 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f8c0df-1531-437f-8a57-ceca8450e58d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:32.526173 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f8c0df-1531-437f-8a57-ceca8450e58d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:32.527888 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f8c0df-1531-437f-8a57-ceca8450e58d None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:32.550678 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 542/1067] 10.222.0.15 () {56 vars in 1133 bytes} [Fri Jun 3 11:46:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:32.551988 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee1ffd-cc9e-4aa9-89ea-0c62d5bbedc9 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:32.587282 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:32.655261 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee1ffd-cc9e-4aa9-89ea-0c62d5bbedc9 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:32.690320 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda3965-05df-426a-9dcf-5cce997a7a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:32.691115 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda3965-05df-426a-9dcf-5cce997a7a4a None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:32.691394 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda3965-05df-426a-9dcf-5cce997a7a4a None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:32.691700 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda3965-05df-426a-9dcf-5cce997a7a4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:32.702114 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda3965-05df-426a-9dcf-5cce997a7a4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:32.704194 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda3965-05df-426a-9dcf-5cce997a7a4a None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:32.722793 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-ddda3965-05df-426a-9dcf-5cce997a7a4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:46:32.722793 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:32.722793 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:32.722793 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:32.722793 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:32.722793 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:32.722793 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:32.722793 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:32.722793 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:32.722793 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:32.722793 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:32.722793 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:32.722793 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:46:32.722793 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:46:32.722793 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:46:32.723731 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:46:32.723731 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:32.723731 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:32.723731 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:32.723731 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:32.723731 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:32.723731 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:32.723731 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:32.723731 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:32.723731 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:32.723731 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:32.723731 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:32.723731 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:32.723731 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:32.723731 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:32.723731 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:32.723731 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:32.729185 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:46:32.729185 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:46:32.729185 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:46:32.729185 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:32.729185 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 526/1068] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:46:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:46:32.730961 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8c0df-1531-437f-8a57-ceca8450e58d None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:32.831939 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8c0df-1531-437f-8a57-ceca8450e58d None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:32.865363 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e364b5-01c4-4cfc-8542-8d2bfe3e803a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:32.866019 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e364b5-01c4-4cfc-8542-8d2bfe3e803a None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:32.866299 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e364b5-01c4-4cfc-8542-8d2bfe3e803a None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:32.866569 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e364b5-01c4-4cfc-8542-8d2bfe3e803a None admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:32.867280 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e364b5-01c4-4cfc-8542-8d2bfe3e803a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:32.867607 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e364b5-01c4-4cfc-8542-8d2bfe3e803a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:32.868965 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e364b5-01c4-4cfc-8542-8d2bfe3e803a None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:32.884793 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 543/1069] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:32.886032 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda3965-05df-426a-9dcf-5cce997a7a4a None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:32.980541 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:32.993532 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda3965-05df-426a-9dcf-5cce997a7a4a None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:33.028928 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970e102-8773-47fd-8f26-33494ead8bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:33.029718 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970e102-8773-47fd-8f26-33494ead8bea None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:33.029994 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970e102-8773-47fd-8f26-33494ead8bea None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:33.030264 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970e102-8773-47fd-8f26-33494ead8bea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:33.037359 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1970e102-8773-47fd-8f26-33494ead8bea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:33.038785 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1970e102-8773-47fd-8f26-33494ead8bea None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:33.052444 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-1970e102-8773-47fd-8f26-33494ead8bea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:46:33.052444 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:33.052444 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:33.052444 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:33.052444 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:33.052444 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:33.052444 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:33.052444 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:33.052444 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:33.052444 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:33.052444 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:33.052444 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:33.052444 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 11:46:33.052444 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 11:46:33.052444 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 11:46:33.053364 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 11:46:33.053364 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:33.053364 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:33.053364 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:33.053364 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:33.053364 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:33.053364 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:33.053364 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:33.053364 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:33.053364 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:33.053364 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:33.053364 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:33.053364 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:33.053364 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:33.053364 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:33.053364 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:33.053364 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:33.054322 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 11:46:33.054322 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 11:46:33.054322 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 11:46:33.054322 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 11:46:33.054322 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 11:46:33.054322 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 11:46:33.054322 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:46:33.054322 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:33.054322 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 527/1070] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:46:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:46:33.059296 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e364b5-01c4-4cfc-8542-8d2bfe3e803a None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:33.083990 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:33.166010 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e364b5-01c4-4cfc-8542-8d2bfe3e803a None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:33.199806 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af568b6a-4b52-41da-b1fc-7bdedc372bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:33.200481 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af568b6a-4b52-41da-b1fc-7bdedc372bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:33.200766 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af568b6a-4b52-41da-b1fc-7bdedc372bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:33.201045 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af568b6a-4b52-41da-b1fc-7bdedc372bd4 None admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:33.201836 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af568b6a-4b52-41da-b1fc-7bdedc372bd4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:33.202151 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af568b6a-4b52-41da-b1fc-7bdedc372bd4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:33.203636 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af568b6a-4b52-41da-b1fc-7bdedc372bd4 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:33.217072 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 544/1071] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 3 11:46:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:33.222147 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970e102-8773-47fd-8f26-33494ead8bea None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:33.324166 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970e102-8773-47fd-8f26-33494ead8bea None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:33.358836 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a42a9-eb47-4075-be5b-0d9223c279ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:33.360468 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a42a9-eb47-4075-be5b-0d9223c279ff None admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:33.360760 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a42a9-eb47-4075-be5b-0d9223c279ff None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:33.361035 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a42a9-eb47-4075-be5b-0d9223c279ff None admin] PATH_INFO: `/v3/projects/cff223ee05524cf4bf3591fc5a39559e/users/6247bfb7aebd45eeb97ba5933be44c6d/roles/4e916858113d4ed5bf93f9e457387f15` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:33.363260 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a42a9-eb47-4075-be5b-0d9223c279ff None admin] RBAC: Authorizing `identity:create_grant(project_id=cff223ee05524cf4bf3591fc5a39559e, user_id=6247bfb7aebd45eeb97ba5933be44c6d, role_id=4e916858113d4ed5bf93f9e457387f15)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:33.364729 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a42a9-eb47-4075-be5b-0d9223c279ff None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:33.379460 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 528/1072] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Jun 3 11:46:33 2022] PUT /identity/v3/projects/cff223ee05524cf4bf3591fc5a39559e/users/6247bfb7aebd45eeb97ba5933be44c6d/roles/4e916858113d4ed5bf93f9e457387f15 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 11:46:33.767969 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85128afc-c31c-427d-bc29-0ac90abfe2ae None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:33.768464 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85128afc-c31c-427d-bc29-0ac90abfe2ae None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:33.768464 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85128afc-c31c-427d-bc29-0ac90abfe2ae None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:33.769978 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 545/1073] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:46:33.775535 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2a7b3-a606-451a-b6ff-850e09250a66 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:33.777984 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2a7b3-a606-451a-b6ff-850e09250a66 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:33.777984 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2a7b3-a606-451a-b6ff-850e09250a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:33.794230 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-ccb2a7b3-a606-451a-b6ff-850e09250a66 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:46:33.795700 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-ccb2a7b3-a606-451a-b6ff-850e09250a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:46:33.798455 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:33.867671 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 529/1074] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:46:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:46:33.889446 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85128afc-c31c-427d-bc29-0ac90abfe2ae None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:33.975541 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:33.999903 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85128afc-c31c-427d-bc29-0ac90abfe2ae None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:34.034199 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc24a87-3255-4a5c-83dc-127569acef63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:34.034777 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc24a87-3255-4a5c-83dc-127569acef63 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:34.035064 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc24a87-3255-4a5c-83dc-127569acef63 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:34.035344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc24a87-3255-4a5c-83dc-127569acef63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:34.104009 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc24a87-3255-4a5c-83dc-127569acef63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:34.105476 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc24a87-3255-4a5c-83dc-127569acef63 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:34.187799 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:34.212568 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 546/1075] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:46:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 11:46:34.219533 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2a7b3-a606-451a-b6ff-850e09250a66 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:34.320322 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2a7b3-a606-451a-b6ff-850e09250a66 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:34.353962 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b69241-c174-490f-abbe-370236c8f238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:34.354747 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b69241-c174-490f-abbe-370236c8f238 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:34.355025 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b69241-c174-490f-abbe-370236c8f238 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:34.355295 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b69241-c174-490f-abbe-370236c8f238 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:34.362812 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:34.367210 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b69241-c174-490f-abbe-370236c8f238 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:34.368665 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b69241-c174-490f-abbe-370236c8f238 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:34.386688 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-c4b69241-c174-490f-abbe-370236c8f238 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:46:34.386688 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:34.386688 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:34.386688 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:34.386688 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:34.386688 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:34.386688 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:34.386688 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:34.386688 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:34.386688 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:34.386688 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:34.386688 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:34.386688 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:46:34.386688 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:46:34.386688 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:46:34.387649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:46:34.387649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:34.387649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:34.387649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:34.387649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:34.387649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:34.387649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:34.387649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:34.387649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:34.387649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:34.387649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:34.387649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:34.387649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:34.387649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:34.387649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:34.387649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:34.387649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:34.388564 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:46:34.388564 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:46:34.388564 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:46:34.388564 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:34.391856 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 530/1076] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:46:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:46:34.393789 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc24a87-3255-4a5c-83dc-127569acef63 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:34.449304 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd56a4-40d2-48ae-9b7d-abb8f492098a None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:34.449616 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd56a4-40d2-48ae-9b7d-abb8f492098a None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:34.449857 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd56a4-40d2-48ae-9b7d-abb8f492098a None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:34.451202 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 531/1077] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:46:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 11:46:34.456016 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08398f-9927-46b1-9aa8-10dd6be6a3e9 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:34.456298 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08398f-9927-46b1-9aa8-10dd6be6a3e9 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:34.456572 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08398f-9927-46b1-9aa8-10dd6be6a3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:34.473429 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-ee08398f-9927-46b1-9aa8-10dd6be6a3e9 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:46:34.474602 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-ee08398f-9927-46b1-9aa8-10dd6be6a3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:46:34.504852 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc24a87-3255-4a5c-83dc-127569acef63 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:34.542633 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e22e32-083a-4da0-990e-01846ad883c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:34.543295 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e22e32-083a-4da0-990e-01846ad883c0 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:34.543600 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e22e32-083a-4da0-990e-01846ad883c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:34.543875 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e22e32-083a-4da0-990e-01846ad883c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:34.544587 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e22e32-083a-4da0-990e-01846ad883c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:34.544890 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e22e32-083a-4da0-990e-01846ad883c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:34.547925 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 532/1078] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:46:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 11:46:34.548075 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e22e32-083a-4da0-990e-01846ad883c0 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:34.562067 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 547/1079] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:46:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:46:34.573026 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08398f-9927-46b1-9aa8-10dd6be6a3e9 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:34.683025 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08398f-9927-46b1-9aa8-10dd6be6a3e9 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:34.705202 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:34.721944 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec04959-8b23-49dd-a25c-9e0d0e523273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:34.722750 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec04959-8b23-49dd-a25c-9e0d0e523273 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:34.723031 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec04959-8b23-49dd-a25c-9e0d0e523273 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:34.723302 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec04959-8b23-49dd-a25c-9e0d0e523273 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:34.735406 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec04959-8b23-49dd-a25c-9e0d0e523273 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:46:34.743220 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-8ec04959-8b23-49dd-a25c-9e0d0e523273 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:46:34.743220 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:34.743220 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:34.743220 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:34.743220 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:34.743220 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:34.743220 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:34.743220 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:34.743220 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:34.743220 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:34.743220 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:34.743220 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:34.743220 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:46:34.743220 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:46:34.743220 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:46:34.743220 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:46:34.744395 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:46:34.744395 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:46:34.744395 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:46:34.744395 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:46:34.744395 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:34.744395 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:34.744395 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:34.744395 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:34.744395 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:34.744395 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:34.744395 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:34.744395 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:34.744395 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:34.744395 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:34.744395 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:34.744395 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:34.750744 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:34.750744 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:34.750744 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:34.750744 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:34.750744 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:46:34.750744 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:46:34.750744 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:46:34.750744 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:46:34.750744 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:46:34.750744 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:46:34.750744 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:46:34.750744 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:34.750744 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 533/1080] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 3 11:46:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:46:34.752019 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e22e32-083a-4da0-990e-01846ad883c0 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:34.793934 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:34.863305 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e22e32-083a-4da0-990e-01846ad883c0 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:34.905648 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25e278-3634-49b8-8159-4890cf4e265c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:34.906324 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25e278-3634-49b8-8159-4890cf4e265c None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:34.906624 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25e278-3634-49b8-8159-4890cf4e265c None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:34.907425 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25e278-3634-49b8-8159-4890cf4e265c None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:34.908203 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd25e278-3634-49b8-8159-4890cf4e265c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:34.908509 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd25e278-3634-49b8-8159-4890cf4e265c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:34.909882 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd25e278-3634-49b8-8159-4890cf4e265c None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:34.918326 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 548/1081] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:46:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:46:34.924568 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec04959-8b23-49dd-a25c-9e0d0e523273 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:35.020459 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec04959-8b23-49dd-a25c-9e0d0e523273 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:35.052951 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742a0bb-1f01-462c-92e4-c8025a17f8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:35.053808 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742a0bb-1f01-462c-92e4-c8025a17f8e5 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:35.054084 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742a0bb-1f01-462c-92e4-c8025a17f8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:35.054351 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742a0bb-1f01-462c-92e4-c8025a17f8e5 None admin] PATH_INFO: `/v3/users/ea337cb4181144248ccc966e2b736035` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:35.055530 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3742a0bb-1f01-462c-92e4-c8025a17f8e5 None admin] RBAC: Authorizing `identity:get_user(user_id=ea337cb4181144248ccc966e2b736035)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:35.056959 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3742a0bb-1f01-462c-92e4-c8025a17f8e5 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:35.058562 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 534/1082] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:46:34 2022] GET /identity/v3/users/ea337cb4181144248ccc966e2b736035 => generated 285 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:35.065130 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25e278-3634-49b8-8159-4890cf4e265c None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:35.160728 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:35.163830 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25e278-3634-49b8-8159-4890cf4e265c None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:35.197699 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac599d80-9958-4d90-a649-d66b84df6133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:35.198556 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac599d80-9958-4d90-a649-d66b84df6133 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:35.198836 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac599d80-9958-4d90-a649-d66b84df6133 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:35.199108 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac599d80-9958-4d90-a649-d66b84df6133 None admin] PATH_INFO: `/v3/projects/f64a28716fe04a18bf8389e3428e2088` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:35.200312 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac599d80-9958-4d90-a649-d66b84df6133 None admin] RBAC: Authorizing `identity:get_project(project_id=f64a28716fe04a18bf8389e3428e2088)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:35.201750 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac599d80-9958-4d90-a649-d66b84df6133 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:35.203484 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 549/1083] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:46:35 2022] GET /identity/v3/projects/f64a28716fe04a18bf8389e3428e2088 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:35.209273 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742a0bb-1f01-462c-92e4-c8025a17f8e5 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:35.257759 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:35.311576 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742a0bb-1f01-462c-92e4-c8025a17f8e5 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:35.345523 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1432c74-defe-4a32-811b-7bce0b2a2371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:35.346396 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1432c74-defe-4a32-811b-7bce0b2a2371 None admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:35.346676 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1432c74-defe-4a32-811b-7bce0b2a2371 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:35.346950 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1432c74-defe-4a32-811b-7bce0b2a2371 None admin] PATH_INFO: `/v3/projects/f64a28716fe04a18bf8389e3428e2088/users/ea337cb4181144248ccc966e2b736035/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:35.348930 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1432c74-defe-4a32-811b-7bce0b2a2371 None admin] RBAC: Authorizing `identity:create_grant(project_id=f64a28716fe04a18bf8389e3428e2088, user_id=ea337cb4181144248ccc966e2b736035, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:35.350354 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1432c74-defe-4a32-811b-7bce0b2a2371 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:35.363186 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 535/1084] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Jun 3 11:46:35 2022] PUT /identity/v3/projects/f64a28716fe04a18bf8389e3428e2088/users/ea337cb4181144248ccc966e2b736035/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 11:46:35.623102 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeadbaf-7dba-4b10-9e79-fcefe502be3b None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:35.623523 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeadbaf-7dba-4b10-9e79-fcefe502be3b None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:35.623850 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeadbaf-7dba-4b10-9e79-fcefe502be3b None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:35.625195 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 550/1085] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:46:35.630755 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3508c3-ce25-4de1-9fc2-d17f5223389e None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:35.631050 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3508c3-ce25-4de1-9fc2-d17f5223389e None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:35.631334 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3508c3-ce25-4de1-9fc2-d17f5223389e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:35.648497 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-7e3508c3-ce25-4de1-9fc2-d17f5223389e None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:46:35.649679 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-7e3508c3-ce25-4de1-9fc2-d17f5223389e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:46:35.715374 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 536/1086] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:46:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:46:35.739156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeadbaf-7dba-4b10-9e79-fcefe502be3b None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:35.838986 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeadbaf-7dba-4b10-9e79-fcefe502be3b None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:35.872019 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e9532-5e0d-4796-9bd0-2854e53196ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:35.872827 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e9532-5e0d-4796-9bd0-2854e53196ee None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:35.873159 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e9532-5e0d-4796-9bd0-2854e53196ee None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:35.873387 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e9532-5e0d-4796-9bd0-2854e53196ee None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:35.884321 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e9532-5e0d-4796-9bd0-2854e53196ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:46:35.892502 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-0f7e9532-5e0d-4796-9bd0-2854e53196ee None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 11:46:35.892502 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:35.892502 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:35.892502 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:35.892502 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:35.892502 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:35.892502 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:35.892502 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:35.892502 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:35.892502 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:35.892502 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:35.892502 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:35.892502 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:46:35.892502 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:46:35.892502 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:46:35.892502 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:46:35.893430 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:46:35.893430 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:46:35.893430 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:46:35.893430 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:46:35.893430 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:35.893430 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:35.893430 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:35.893430 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:35.893430 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:35.893430 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:35.893430 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:35.893430 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:35.893430 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:35.893430 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:35.893430 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:35.893430 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:35.894302 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:35.894302 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:35.894302 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:35.894302 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:35.894302 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:46:35.894302 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:46:35.894302 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:46:35.894302 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:46:35.894302 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:46:35.894302 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:46:35.894302 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 03 11:46:35.894302 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:35.896019 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 551/1087] 10.222.0.15 () {56 vars in 1120 bytes} [Fri Jun 3 11:46:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:46:35.900050 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3508c3-ce25-4de1-9fc2-d17f5223389e None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:35.939272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:35.998125 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3508c3-ce25-4de1-9fc2-d17f5223389e None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:36.032112 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7212fe-1fb5-4a12-862a-cc37854e62a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:36.032779 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7212fe-1fb5-4a12-862a-cc37854e62a4 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:36.033062 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7212fe-1fb5-4a12-862a-cc37854e62a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:36.033337 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7212fe-1fb5-4a12-862a-cc37854e62a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:36.034077 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7212fe-1fb5-4a12-862a-cc37854e62a4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:36.034383 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7212fe-1fb5-4a12-862a-cc37854e62a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:36.035837 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7212fe-1fb5-4a12-862a-cc37854e62a4 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:36.043702 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 537/1088] 10.222.0.15 () {56 vars in 1115 bytes} [Fri Jun 3 11:46:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:36.049874 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e9532-5e0d-4796-9bd0-2854e53196ee None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:36.077371 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:36.148232 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e9532-5e0d-4796-9bd0-2854e53196ee None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:36.181991 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0644b3-ff1a-4d37-bfd5-e4f30f445d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:36.182771 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0644b3-ff1a-4d37-bfd5-e4f30f445d47 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:36.183048 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0644b3-ff1a-4d37-bfd5-e4f30f445d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:36.183313 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0644b3-ff1a-4d37-bfd5-e4f30f445d47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:36.193008 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0644b3-ff1a-4d37-bfd5-e4f30f445d47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:36.194449 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0644b3-ff1a-4d37-bfd5-e4f30f445d47 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:36.211076 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-6e0644b3-ff1a-4d37-bfd5-e4f30f445d47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:46:36.211076 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:36.211076 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:36.211076 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:36.211076 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:36.211076 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:36.211076 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:36.211076 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:36.211076 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:36.211076 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:36.211076 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:36.211076 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:36.211076 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:46:36.211076 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:46:36.211076 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:46:36.212024 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:46:36.212024 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:36.212024 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:36.212024 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:36.212024 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:36.212024 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:36.212024 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:36.212024 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:36.212024 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:36.212024 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:36.212024 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:36.212024 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:36.212024 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:36.212024 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:36.212024 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:36.212024 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:36.212024 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:36.212927 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:46:36.212927 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:46:36.212927 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:46:36.212927 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:36.212927 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 552/1089] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:46:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:46:36.217936 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7212fe-1fb5-4a12-862a-cc37854e62a4 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:36.313168 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:36.316277 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7212fe-1fb5-4a12-862a-cc37854e62a4 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:36.349203 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f208a-96fd-4b11-8819-100d3b2f7995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:36.349849 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f208a-96fd-4b11-8819-100d3b2f7995 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:36.350132 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f208a-96fd-4b11-8819-100d3b2f7995 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:36.350410 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f208a-96fd-4b11-8819-100d3b2f7995 None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:36.351120 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f208a-96fd-4b11-8819-100d3b2f7995 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:36.351428 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f208a-96fd-4b11-8819-100d3b2f7995 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:36.352836 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f208a-96fd-4b11-8819-100d3b2f7995 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:36.365468 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 538/1090] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:36.370903 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0644b3-ff1a-4d37-bfd5-e4f30f445d47 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:36.453028 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:36.473344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0644b3-ff1a-4d37-bfd5-e4f30f445d47 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:36.507787 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8bc547-d074-410b-bf5d-a63996229fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:36.508574 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8bc547-d074-410b-bf5d-a63996229fbc None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:36.508854 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8bc547-d074-410b-bf5d-a63996229fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:36.509126 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8bc547-d074-410b-bf5d-a63996229fbc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:36.516015 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8bc547-d074-410b-bf5d-a63996229fbc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:36.517440 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8bc547-d074-410b-bf5d-a63996229fbc None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:36.531587 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-1b8bc547-d074-410b-bf5d-a63996229fbc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 03 11:46:36.531587 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:36.531587 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:36.531587 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:36.531587 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:36.531587 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:36.531587 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:36.531587 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:36.531587 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:36.531587 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:36.531587 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:36.531587 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:36.531587 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 11:46:36.531587 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 11:46:36.531587 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 11:46:36.531587 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 11:46:36.532697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:36.532697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:36.532697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 11:46:36.532697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:46:36.532697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 11:46:36.532697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:46:36.532697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:36.532697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:36.532697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:36.532697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:36.532697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:36.532697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:36.532697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:36.532697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:36.532697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:36.532697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:36.532697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:36.532697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:36.533728 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:36.533728 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:36.533728 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 11:46:36.533728 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 11:46:36.533728 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 11:46:36.533728 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 11:46:36.533728 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 11:46:36.533728 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 11:46:36.533728 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 03 11:46:36.533728 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:46:36.535663 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 553/1091] 10.222.0.15 () {56 vars in 1093 bytes} [Fri Jun 3 11:46:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:46:36.538346 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f208a-96fd-4b11-8819-100d3b2f7995 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:36.635141 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f208a-96fd-4b11-8819-100d3b2f7995 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:36.667563 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc3be1-4a47-4831-803c-7548b702a0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:36.668217 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc3be1-4a47-4831-803c-7548b702a0ee None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:36.668499 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc3be1-4a47-4831-803c-7548b702a0ee None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:36.668776 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc3be1-4a47-4831-803c-7548b702a0ee None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:36.669598 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc3be1-4a47-4831-803c-7548b702a0ee None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:36.669905 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc3be1-4a47-4831-803c-7548b702a0ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:36.671334 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc3be1-4a47-4831-803c-7548b702a0ee None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:36.689060 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 539/1092] 10.222.0.15 () {56 vars in 1133 bytes} [Fri Jun 3 11:46:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:36.694588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8bc547-d074-410b-bf5d-a63996229fbc None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:36.790799 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8bc547-d074-410b-bf5d-a63996229fbc None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:36.823077 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee6cd1-6402-404c-bd8f-47e4d40a8be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:36.823736 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee6cd1-6402-404c-bd8f-47e4d40a8be0 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:36.824015 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee6cd1-6402-404c-bd8f-47e4d40a8be0 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:36.824284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee6cd1-6402-404c-bd8f-47e4d40a8be0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:36.834685 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:36.889431 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee6cd1-6402-404c-bd8f-47e4d40a8be0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:36.890909 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee6cd1-6402-404c-bd8f-47e4d40a8be0 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:36.986871 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 554/1093] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:46:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 03 11:46:36.992477 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc3be1-4a47-4831-803c-7548b702a0ee None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:37.011456 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:37.091725 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc3be1-4a47-4831-803c-7548b702a0ee None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:37.125923 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c894cca7-35d5-4f22-afbb-a8ddba87725e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:37.126713 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894cca7-35d5-4f22-afbb-a8ddba87725e None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:37.126996 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894cca7-35d5-4f22-afbb-a8ddba87725e None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:37.127272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894cca7-35d5-4f22-afbb-a8ddba87725e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:37.137150 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c894cca7-35d5-4f22-afbb-a8ddba87725e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:37.138585 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c894cca7-35d5-4f22-afbb-a8ddba87725e None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:37.156253 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-c894cca7-35d5-4f22-afbb-a8ddba87725e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:46:37.156253 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:37.156253 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:37.156253 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:37.156253 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:37.156253 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:37.156253 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:37.156253 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:37.156253 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:37.156253 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:37.156253 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:37.156253 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:37.156253 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:46:37.156253 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:46:37.156253 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:46:37.157752 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:46:37.157752 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:37.157752 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:37.157752 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:37.157752 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:37.157752 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:37.157752 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:37.157752 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:37.157752 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:37.157752 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:37.157752 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:37.157752 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:37.157752 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:37.157752 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:37.157752 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:37.157752 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:37.157752 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:37.158643 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:46:37.158643 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:46:37.158643 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:46:37.158643 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:37.158643 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 540/1094] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:46:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:46:37.163623 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee6cd1-6402-404c-bd8f-47e4d40a8be0 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:37.203254 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:37.261782 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee6cd1-6402-404c-bd8f-47e4d40a8be0 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:37.299080 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2921a5-02a2-4523-94c8-2f23edf9f53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:37.299767 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2921a5-02a2-4523-94c8-2f23edf9f53c None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:37.300046 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2921a5-02a2-4523-94c8-2f23edf9f53c None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:37.300318 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2921a5-02a2-4523-94c8-2f23edf9f53c None admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:37.301037 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2921a5-02a2-4523-94c8-2f23edf9f53c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:37.301339 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2921a5-02a2-4523-94c8-2f23edf9f53c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:37.302693 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2921a5-02a2-4523-94c8-2f23edf9f53c None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:37.313661 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 555/1095] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:46:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:37.319185 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c894cca7-35d5-4f22-afbb-a8ddba87725e None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:37.386798 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:37.419820 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c894cca7-35d5-4f22-afbb-a8ddba87725e None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:37.453914 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f401e3-57bf-44d8-ac43-f6f1d2836479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:37.454693 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f401e3-57bf-44d8-ac43-f6f1d2836479 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:37.454975 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f401e3-57bf-44d8-ac43-f6f1d2836479 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:37.455247 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f401e3-57bf-44d8-ac43-f6f1d2836479 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:37.461875 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f401e3-57bf-44d8-ac43-f6f1d2836479 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:37.463326 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f401e3-57bf-44d8-ac43-f6f1d2836479 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:37.476730 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-48f401e3-57bf-44d8-ac43-f6f1d2836479 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:46:37.476730 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:37.476730 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:37.476730 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:37.476730 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:37.476730 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:37.476730 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:37.476730 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:37.476730 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:37.476730 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:37.476730 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:37.476730 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:37.476730 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 11:46:37.476730 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 11:46:37.476730 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 11:46:37.477707 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 11:46:37.477707 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:37.477707 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:37.477707 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:37.477707 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:37.477707 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:37.477707 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:37.477707 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:37.477707 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:37.477707 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:37.477707 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:37.477707 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:37.477707 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:37.477707 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:37.477707 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:37.477707 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:37.477707 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:37.478624 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 11:46:37.478624 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 11:46:37.478624 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 11:46:37.478624 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 11:46:37.478624 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 11:46:37.478624 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 11:46:37.478624 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:46:37.478624 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:37.478624 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 541/1096] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:46:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:46:37.483632 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2921a5-02a2-4523-94c8-2f23edf9f53c None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:37.578630 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:37.581722 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2921a5-02a2-4523-94c8-2f23edf9f53c None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:37.584471 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a8956-2c5f-4572-9fd6-2b460ac16337 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:37.584757 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a8956-2c5f-4572-9fd6-2b460ac16337 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:37.585038 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a8956-2c5f-4572-9fd6-2b460ac16337 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:37.586394 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 542/1097] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 11:46:37.591300 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035946bd-6e54-46c9-8e20-65bcc183270a None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:37.591613 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035946bd-6e54-46c9-8e20-65bcc183270a None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:37.591887 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035946bd-6e54-46c9-8e20-65bcc183270a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:37.608954 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-035946bd-6e54-46c9-8e20-65bcc183270a None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:46:37.610783 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-035946bd-6e54-46c9-8e20-65bcc183270a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:46:37.617489 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20bd926-8188-448e-bd59-87c2434d6f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:37.618148 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bd926-8188-448e-bd59-87c2434d6f6c None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:37.618427 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bd926-8188-448e-bd59-87c2434d6f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:37.618698 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bd926-8188-448e-bd59-87c2434d6f6c None admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:37.619470 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20bd926-8188-448e-bd59-87c2434d6f6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:37.619807 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20bd926-8188-448e-bd59-87c2434d6f6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:37.621216 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20bd926-8188-448e-bd59-87c2434d6f6c None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:37.633380 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 556/1098] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 3 11:46:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:37.639005 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20bd926-8188-448e-bd59-87c2434d6f6c None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:37.677427 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 543/1099] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:46:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 11:46:37.700666 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035946bd-6e54-46c9-8e20-65bcc183270a None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:37.737618 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20bd926-8188-448e-bd59-87c2434d6f6c None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:37.756823 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:37.770393 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7238e-6e9f-448c-b47f-b84c4b088e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:37.771040 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7238e-6e9f-448c-b47f-b84c4b088e88 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:37.771320 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7238e-6e9f-448c-b47f-b84c4b088e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:37.771619 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7238e-6e9f-448c-b47f-b84c4b088e88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:37.772441 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7238e-6e9f-448c-b47f-b84c4b088e88 None admin] RBAC: Adding query filter params (role.id=4e916858113d4ed5bf93f9e457387f15, scope.project.id=cff223ee05524cf4bf3591fc5a39559e, user.id=6247bfb7aebd45eeb97ba5933be44c6d) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:37.772751 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7238e-6e9f-448c-b47f-b84c4b088e88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:37.774166 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7238e-6e9f-448c-b47f-b84c4b088e88 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:37.780111 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 557/1100] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:46:37 2022] GET /identity/v3/role_assignments?user.id=6247bfb7aebd45eeb97ba5933be44c6d&scope.project.id=cff223ee05524cf4bf3591fc5a39559e&role.id=4e916858113d4ed5bf93f9e457387f15 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:46:37.799426 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035946bd-6e54-46c9-8e20-65bcc183270a None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:37.837371 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117354b3-6b88-4f84-9884-68f0d4a2aeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:37.838185 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117354b3-6b88-4f84-9884-68f0d4a2aeaf None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:37.838467 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117354b3-6b88-4f84-9884-68f0d4a2aeaf None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:37.838747 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117354b3-6b88-4f84-9884-68f0d4a2aeaf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:37.851278 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117354b3-6b88-4f84-9884-68f0d4a2aeaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:46:37.859054 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-117354b3-6b88-4f84-9884-68f0d4a2aeaf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:46:37.859054 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:37.859054 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:37.859054 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:37.859054 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:37.859054 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:37.859054 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:37.859054 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:37.859054 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:37.859054 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:37.859054 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:37.859054 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:37.859054 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:46:37.859054 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:46:37.859054 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:46:37.859054 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:46:37.860896 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:46:37.860896 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:46:37.860896 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:46:37.860896 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:46:37.860896 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:37.860896 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:37.860896 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:37.860896 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:37.860896 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:37.860896 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:37.860896 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:37.860896 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:37.860896 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:37.860896 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:37.860896 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:37.860896 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:37.862135 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:37.862135 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:37.862135 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:37.862135 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:37.862135 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:46:37.862135 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:46:37.862135 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:46:37.862135 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:46:37.862135 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:46:37.862135 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:46:37.862135 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:46:37.862135 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:37.862135 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 544/1101] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 3 11:46:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:46:37.867144 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7238e-6e9f-448c-b47f-b84c4b088e88 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:37.894200 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:37.973438 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7238e-6e9f-448c-b47f-b84c4b088e88 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:38.008850 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5fdc6f-0e7a-4463-bb88-96253ed7be22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:38.009520 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5fdc6f-0e7a-4463-bb88-96253ed7be22 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:38.009805 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5fdc6f-0e7a-4463-bb88-96253ed7be22 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:38.010079 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5fdc6f-0e7a-4463-bb88-96253ed7be22 None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:38.010828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5fdc6f-0e7a-4463-bb88-96253ed7be22 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:38.011141 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5fdc6f-0e7a-4463-bb88-96253ed7be22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:38.012538 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5fdc6f-0e7a-4463-bb88-96253ed7be22 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:38.020836 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 558/1102] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:46:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:38.026991 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117354b3-6b88-4f84-9884-68f0d4a2aeaf None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:38.128361 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117354b3-6b88-4f84-9884-68f0d4a2aeaf None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:38.148764 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:38.163921 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa14f719-d3bc-440e-8fee-500557b16e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:38.164797 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14f719-d3bc-440e-8fee-500557b16e6e None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:38.165078 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14f719-d3bc-440e-8fee-500557b16e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:38.165351 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14f719-d3bc-440e-8fee-500557b16e6e None admin] PATH_INFO: `/v3/users/ea337cb4181144248ccc966e2b736035` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:38.166937 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa14f719-d3bc-440e-8fee-500557b16e6e None admin] RBAC: Authorizing `identity:get_user(user_id=ea337cb4181144248ccc966e2b736035)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:38.168428 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa14f719-d3bc-440e-8fee-500557b16e6e None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:38.170060 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 545/1103] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:46:38 2022] GET /identity/v3/users/ea337cb4181144248ccc966e2b736035 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:38.176089 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5fdc6f-0e7a-4463-bb88-96253ed7be22 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:38.264143 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:38.281160 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5fdc6f-0e7a-4463-bb88-96253ed7be22 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:38.315138 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf483dab-70f1-4e99-8087-b1964480439f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:38.315818 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf483dab-70f1-4e99-8087-b1964480439f None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:38.316102 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf483dab-70f1-4e99-8087-b1964480439f None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:38.316380 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf483dab-70f1-4e99-8087-b1964480439f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:38.384255 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf483dab-70f1-4e99-8087-b1964480439f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:38.386031 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf483dab-70f1-4e99-8087-b1964480439f None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:38.471526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:38.487642 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 559/1104] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:46:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 03 11:46:38.493775 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa14f719-d3bc-440e-8fee-500557b16e6e None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:38.596442 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa14f719-d3bc-440e-8fee-500557b16e6e None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:38.631943 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd01435-c76d-45a9-8b61-ea0238e23a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:38.632792 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd01435-c76d-45a9-8b61-ea0238e23a83 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:38.633070 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd01435-c76d-45a9-8b61-ea0238e23a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:38.633346 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd01435-c76d-45a9-8b61-ea0238e23a83 None admin] PATH_INFO: `/v3/projects/f64a28716fe04a18bf8389e3428e2088` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:38.634507 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd01435-c76d-45a9-8b61-ea0238e23a83 None admin] RBAC: Authorizing `identity:get_project(project_id=f64a28716fe04a18bf8389e3428e2088)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:38.635979 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd01435-c76d-45a9-8b61-ea0238e23a83 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:38.637840 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 546/1105] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:46:38 2022] GET /identity/v3/projects/f64a28716fe04a18bf8389e3428e2088 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:38.644398 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf483dab-70f1-4e99-8087-b1964480439f None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:38.743758 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf483dab-70f1-4e99-8087-b1964480439f None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:38.776025 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd531fcf-6eac-48b8-a52d-810ba1d2ae8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:38.776930 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd531fcf-6eac-48b8-a52d-810ba1d2ae8f None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:38.777218 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd531fcf-6eac-48b8-a52d-810ba1d2ae8f None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:38.777493 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd531fcf-6eac-48b8-a52d-810ba1d2ae8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:38.778318 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd531fcf-6eac-48b8-a52d-810ba1d2ae8f None admin] RBAC: Adding query filter params (role.id=c486e164840b41a59fd118dece2ce572, scope.project.id=f64a28716fe04a18bf8389e3428e2088, user.id=ea337cb4181144248ccc966e2b736035) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:38.778631 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd531fcf-6eac-48b8-a52d-810ba1d2ae8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:38.780088 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd531fcf-6eac-48b8-a52d-810ba1d2ae8f None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:38.786238 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 560/1106] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:46:38 2022] GET /identity/v3/role_assignments?user.id=ea337cb4181144248ccc966e2b736035&scope.project.id=f64a28716fe04a18bf8389e3428e2088&role.id=c486e164840b41a59fd118dece2ce572 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:41.012475 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64440182-5127-4324-970f-de064af5dad5 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:41.013022 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64440182-5127-4324-970f-de064af5dad5 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:41.013022 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64440182-5127-4324-970f-de064af5dad5 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:41.014361 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 547/1107] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:46:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:46:41.019689 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26dda00-d3bd-4805-a5e3-b7b7ad8861e6 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:41.020064 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26dda00-d3bd-4805-a5e3-b7b7ad8861e6 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:41.020250 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26dda00-d3bd-4805-a5e3-b7b7ad8861e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:41.036865 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-c26dda00-d3bd-4805-a5e3-b7b7ad8861e6 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:46:41.038058 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-c26dda00-d3bd-4805-a5e3-b7b7ad8861e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:46:41.083074 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:41.103511 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 561/1108] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:46:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:46:41.129537 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64440182-5127-4324-970f-de064af5dad5 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:41.185417 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:41.228490 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64440182-5127-4324-970f-de064af5dad5 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:41.261631 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad1b76-a924-42c5-95be-910dee5b2b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:41.262407 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad1b76-a924-42c5-95be-910dee5b2b9d None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:41.262689 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad1b76-a924-42c5-95be-910dee5b2b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:41.262962 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad1b76-a924-42c5-95be-910dee5b2b9d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:41.264137 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad1b76-a924-42c5-95be-910dee5b2b9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:41.265553 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad1b76-a924-42c5-95be-910dee5b2b9d None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:41.267154 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 548/1109] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:46:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:41.272959 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26dda00-d3bd-4805-a5e3-b7b7ad8861e6 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:41.367864 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26dda00-d3bd-4805-a5e3-b7b7ad8861e6 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:41.399768 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180da99-af69-4f46-8c44-2a74298a2d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:41.400423 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180da99-af69-4f46-8c44-2a74298a2d79 None admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:41.400706 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180da99-af69-4f46-8c44-2a74298a2d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:41.400977 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180da99-af69-4f46-8c44-2a74298a2d79 None admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:41.401942 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6180da99-af69-4f46-8c44-2a74298a2d79 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:41.403361 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6180da99-af69-4f46-8c44-2a74298a2d79 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:41.423307 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 562/1110] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Jun 3 11:46:41 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:46:43.655696 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1beef-8c1f-4b53-8b8d-7e88b9b3609e None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:43.656225 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1beef-8c1f-4b53-8b8d-7e88b9b3609e None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:43.656225 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1beef-8c1f-4b53-8b8d-7e88b9b3609e None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:43.658102 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 549/1111] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:46:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:46:43.663177 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc3c2a-4d6b-4fd6-bd6c-62e45b1b8ba2 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:43.663558 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc3c2a-4d6b-4fd6-bd6c-62e45b1b8ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:43.663761 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc3c2a-4d6b-4fd6-bd6c-62e45b1b8ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:43.680521 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-f2dc3c2a-4d6b-4fd6-bd6c-62e45b1b8ba2 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:46:43.681683 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-f2dc3c2a-4d6b-4fd6-bd6c-62e45b1b8ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:46:43.708968 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:43.747055 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 563/1112] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:46:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:46:43.769913 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1beef-8c1f-4b53-8b8d-7e88b9b3609e None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:43.867047 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1beef-8c1f-4b53-8b8d-7e88b9b3609e None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:43.889009 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:43.900589 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0e6a0-0076-4b6f-8265-817619e70f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:43.901678 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0e6a0-0076-4b6f-8265-817619e70f3c None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:43.901965 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0e6a0-0076-4b6f-8265-817619e70f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:43.902237 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0e6a0-0076-4b6f-8265-817619e70f3c None admin] PATH_INFO: `/v3/roles/5d1199580aaa485bb120b35e6f771ff9` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:43.903708 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0e6a0-0076-4b6f-8265-817619e70f3c None admin] RBAC: Authorizing `identity:get_role(role_id=5d1199580aaa485bb120b35e6f771ff9)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:43.905055 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0e6a0-0076-4b6f-8265-817619e70f3c None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:43.907172 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 550/1113] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:46:43 2022] GET /identity/v3/roles/5d1199580aaa485bb120b35e6f771ff9 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:43.912764 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc3c2a-4d6b-4fd6-bd6c-62e45b1b8ba2 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:44.008408 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc3c2a-4d6b-4fd6-bd6c-62e45b1b8ba2 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:44.042443 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcda6f2-f683-4ddc-b531-fb9a88430cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:44.043304 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcda6f2-f683-4ddc-b531-fb9a88430cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:44.043619 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcda6f2-f683-4ddc-b531-fb9a88430cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:44.043897 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcda6f2-f683-4ddc-b531-fb9a88430cf6 None admin] PATH_INFO: `/v3/users/402b7cc01ca149cbbbf617fb6303d35a` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:44.056734 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcda6f2-f683-4ddc-b531-fb9a88430cf6 None admin] RBAC: Authorizing `identity:get_user(user_id=402b7cc01ca149cbbbf617fb6303d35a)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:44.058167 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcda6f2-f683-4ddc-b531-fb9a88430cf6 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:44.059822 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 564/1114] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:46:43 2022] GET /identity/v3/users/402b7cc01ca149cbbbf617fb6303d35a => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:44.065490 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0e6a0-0076-4b6f-8265-817619e70f3c None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:44.162297 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0e6a0-0076-4b6f-8265-817619e70f3c None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:44.193733 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d866e1d-c090-4136-9730-b3f99a4608d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:44.194361 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d866e1d-c090-4136-9730-b3f99a4608d5 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:44.194643 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d866e1d-c090-4136-9730-b3f99a4608d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:44.194917 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d866e1d-c090-4136-9730-b3f99a4608d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:44.251334 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:44.260620 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d866e1d-c090-4136-9730-b3f99a4608d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:44.262092 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d866e1d-c090-4136-9730-b3f99a4608d5 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:44.356044 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 551/1115] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:46:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 11:46:44.361792 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcda6f2-f683-4ddc-b531-fb9a88430cf6 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:44.386250 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:44.458803 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcda6f2-f683-4ddc-b531-fb9a88430cf6 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:44.490499 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63adbaed-0dbb-4dcb-b127-1c7368834b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:44.491336 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adbaed-0dbb-4dcb-b127-1c7368834b40 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:44.491635 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adbaed-0dbb-4dcb-b127-1c7368834b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:44.491912 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adbaed-0dbb-4dcb-b127-1c7368834b40 None admin] PATH_INFO: `/v3/projects/f64a28716fe04a18bf8389e3428e2088` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:44.493059 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63adbaed-0dbb-4dcb-b127-1c7368834b40 None admin] RBAC: Authorizing `identity:get_project(project_id=f64a28716fe04a18bf8389e3428e2088)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:44.494465 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63adbaed-0dbb-4dcb-b127-1c7368834b40 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:44.496127 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 565/1116] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:46:44 2022] GET /identity/v3/projects/f64a28716fe04a18bf8389e3428e2088 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:44.502539 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d866e1d-c090-4136-9730-b3f99a4608d5 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:44.589021 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:44.597830 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d866e1d-c090-4136-9730-b3f99a4608d5 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:44.630343 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c7371-85a6-499f-96e7-0858c60e0251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:44.630968 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c7371-85a6-499f-96e7-0858c60e0251 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:44.631249 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c7371-85a6-499f-96e7-0858c60e0251 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:44.631540 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c7371-85a6-499f-96e7-0858c60e0251 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:44.632357 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c7371-85a6-499f-96e7-0858c60e0251 None admin] RBAC: Adding query filter params (role.id=5d1199580aaa485bb120b35e6f771ff9, scope.project.id=f64a28716fe04a18bf8389e3428e2088, user.id=402b7cc01ca149cbbbf617fb6303d35a) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:44.632664 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c7371-85a6-499f-96e7-0858c60e0251 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:44.634068 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c7371-85a6-499f-96e7-0858c60e0251 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:44.639318 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 552/1117] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:46:44 2022] GET /identity/v3/role_assignments?user.id=402b7cc01ca149cbbbf617fb6303d35a&scope.project.id=f64a28716fe04a18bf8389e3428e2088&role.id=5d1199580aaa485bb120b35e6f771ff9 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:46.839373 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b081e33-1b20-4fd4-a995-5217de627468 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:46.839956 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b081e33-1b20-4fd4-a995-5217de627468 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:46.839956 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b081e33-1b20-4fd4-a995-5217de627468 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:46.841305 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 566/1118] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:46:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:46:46.846470 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb35153-7ecd-4766-bbab-2c7361aa6472 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:46.846912 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb35153-7ecd-4766-bbab-2c7361aa6472 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:46.847032 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb35153-7ecd-4766-bbab-2c7361aa6472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:46.863470 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-2bb35153-7ecd-4766-bbab-2c7361aa6472 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:46:46.864683 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-2bb35153-7ecd-4766-bbab-2c7361aa6472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:46:46.936840 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 553/1119] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:46:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:46:46.959914 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b081e33-1b20-4fd4-a995-5217de627468 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:47.049060 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:47.058519 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b081e33-1b20-4fd4-a995-5217de627468 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:47.091044 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a16f6-1895-43cf-bdad-c54b7f4c6f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:47.091859 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a16f6-1895-43cf-bdad-c54b7f4c6f7c None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:47.092144 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a16f6-1895-43cf-bdad-c54b7f4c6f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:47.092418 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a16f6-1895-43cf-bdad-c54b7f4c6f7c None admin] PATH_INFO: `/v3/roles/5d1199580aaa485bb120b35e6f771ff9` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:47.093924 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3a16f6-1895-43cf-bdad-c54b7f4c6f7c None admin] RBAC: Authorizing `identity:get_role(role_id=5d1199580aaa485bb120b35e6f771ff9)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:47.095278 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3a16f6-1895-43cf-bdad-c54b7f4c6f7c None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:47.096647 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 567/1120] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:46:46 2022] GET /identity/v3/roles/5d1199580aaa485bb120b35e6f771ff9 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:47.102271 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb35153-7ecd-4766-bbab-2c7361aa6472 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:47.184126 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:47.199579 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb35153-7ecd-4766-bbab-2c7361aa6472 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:47.231984 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5fd664-4295-49d2-9394-f67fbb6b4a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:47.232834 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5fd664-4295-49d2-9394-f67fbb6b4a91 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:47.233120 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5fd664-4295-49d2-9394-f67fbb6b4a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:47.233395 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5fd664-4295-49d2-9394-f67fbb6b4a91 None admin] PATH_INFO: `/v3/users/402b7cc01ca149cbbbf617fb6303d35a` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:47.235430 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5fd664-4295-49d2-9394-f67fbb6b4a91 None admin] RBAC: Authorizing `identity:get_user(user_id=402b7cc01ca149cbbbf617fb6303d35a)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:47.236889 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5fd664-4295-49d2-9394-f67fbb6b4a91 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:47.238479 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 554/1121] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:46:47 2022] GET /identity/v3/users/402b7cc01ca149cbbbf617fb6303d35a => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:47.244401 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a16f6-1895-43cf-bdad-c54b7f4c6f7c None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:47.340524 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a16f6-1895-43cf-bdad-c54b7f4c6f7c None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:47.373595 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8aefa-94d6-4510-b2c9-8d058de2d139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:47.374379 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8aefa-94d6-4510-b2c9-8d058de2d139 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:47.374658 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8aefa-94d6-4510-b2c9-8d058de2d139 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:47.374930 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8aefa-94d6-4510-b2c9-8d058de2d139 None admin] PATH_INFO: `/v3/projects/f64a28716fe04a18bf8389e3428e2088` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:47.376142 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c8aefa-94d6-4510-b2c9-8d058de2d139 None admin] RBAC: Authorizing `identity:get_project(project_id=f64a28716fe04a18bf8389e3428e2088)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:47.377565 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c8aefa-94d6-4510-b2c9-8d058de2d139 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:47.379219 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 568/1122] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:46:47 2022] GET /identity/v3/projects/f64a28716fe04a18bf8389e3428e2088 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:47.384960 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5fd664-4295-49d2-9394-f67fbb6b4a91 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:47.479969 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5fd664-4295-49d2-9394-f67fbb6b4a91 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:47.513639 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9bdc08-6beb-4fd1-acde-6922e4f01e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:47.514511 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bdc08-6beb-4fd1-acde-6922e4f01e12 None admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:47.514796 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bdc08-6beb-4fd1-acde-6922e4f01e12 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:47.515070 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bdc08-6beb-4fd1-acde-6922e4f01e12 None admin] PATH_INFO: `/v3/projects/f64a28716fe04a18bf8389e3428e2088/users/402b7cc01ca149cbbbf617fb6303d35a/roles/5d1199580aaa485bb120b35e6f771ff9` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:47.517285 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9bdc08-6beb-4fd1-acde-6922e4f01e12 None admin] RBAC: Authorizing `identity:create_grant(project_id=f64a28716fe04a18bf8389e3428e2088, user_id=402b7cc01ca149cbbbf617fb6303d35a, role_id=5d1199580aaa485bb120b35e6f771ff9)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:47.518709 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9bdc08-6beb-4fd1-acde-6922e4f01e12 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:47.531217 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 555/1123] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Jun 3 11:46:47 2022] PUT /identity/v3/projects/f64a28716fe04a18bf8389e3428e2088/users/402b7cc01ca149cbbbf617fb6303d35a/roles/5d1199580aaa485bb120b35e6f771ff9 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:46:49.725488 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a709bf3-7142-485e-a142-079cffca7aef None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:49.726040 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a709bf3-7142-485e-a142-079cffca7aef None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:49.726040 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a709bf3-7142-485e-a142-079cffca7aef None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:49.727415 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 569/1124] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:46:49.732529 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a81395-cbaa-4d0a-a1b0-b725ec6ff7a2 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:49.732962 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a81395-cbaa-4d0a-a1b0-b725ec6ff7a2 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:49.733102 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a81395-cbaa-4d0a-a1b0-b725ec6ff7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:49.750182 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-c8a81395-cbaa-4d0a-a1b0-b725ec6ff7a2 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:46:49.751373 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-c8a81395-cbaa-4d0a-a1b0-b725ec6ff7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:46:49.760354 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:49.818132 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 556/1125] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:46:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:46:49.841257 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a709bf3-7142-485e-a142-079cffca7aef None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:49.869683 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:49.943083 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a709bf3-7142-485e-a142-079cffca7aef None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:49.975191 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8aa592-be84-44ae-bef3-d52b4dec0e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:49.976114 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8aa592-be84-44ae-bef3-d52b4dec0e3b None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:49.976350 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8aa592-be84-44ae-bef3-d52b4dec0e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:49.976625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8aa592-be84-44ae-bef3-d52b4dec0e3b None admin] PATH_INFO: `/v3/roles/5d1199580aaa485bb120b35e6f771ff9` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:49.978094 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8aa592-be84-44ae-bef3-d52b4dec0e3b None admin] RBAC: Authorizing `identity:get_role(role_id=5d1199580aaa485bb120b35e6f771ff9)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:49.979461 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8aa592-be84-44ae-bef3-d52b4dec0e3b None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:49.980838 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 570/1126] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:46:49 2022] GET /identity/v3/roles/5d1199580aaa485bb120b35e6f771ff9 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:49.987028 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a81395-cbaa-4d0a-a1b0-b725ec6ff7a2 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:50.082649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a81395-cbaa-4d0a-a1b0-b725ec6ff7a2 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:50.115386 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825506d-1f5c-49f3-8d7c-0b7cba928744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:50.116263 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825506d-1f5c-49f3-8d7c-0b7cba928744 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:50.116546 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825506d-1f5c-49f3-8d7c-0b7cba928744 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:50.116820 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825506d-1f5c-49f3-8d7c-0b7cba928744 None admin] PATH_INFO: `/v3/users/402b7cc01ca149cbbbf617fb6303d35a` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:50.117987 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825506d-1f5c-49f3-8d7c-0b7cba928744 None admin] RBAC: Authorizing `identity:get_user(user_id=402b7cc01ca149cbbbf617fb6303d35a)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:50.119402 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825506d-1f5c-49f3-8d7c-0b7cba928744 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:50.121020 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 557/1127] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:46:49 2022] GET /identity/v3/users/402b7cc01ca149cbbbf617fb6303d35a => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:50.126979 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8aa592-be84-44ae-bef3-d52b4dec0e3b None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:50.217329 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:50.223392 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8aa592-be84-44ae-bef3-d52b4dec0e3b None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:50.256725 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5286e-3f9e-41f8-8f7b-185d1a16997a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:50.257301 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5286e-3f9e-41f8-8f7b-185d1a16997a None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:50.257586 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5286e-3f9e-41f8-8f7b-185d1a16997a None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:50.257862 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5286e-3f9e-41f8-8f7b-185d1a16997a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:50.322402 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a5286e-3f9e-41f8-8f7b-185d1a16997a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:50.323861 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a5286e-3f9e-41f8-8f7b-185d1a16997a None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:50.412680 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:50.419197 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 571/1128] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:46:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 11:46:50.425532 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825506d-1f5c-49f3-8d7c-0b7cba928744 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:50.439825 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:50.522064 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825506d-1f5c-49f3-8d7c-0b7cba928744 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:50.555323 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ddeb2-3d14-4eed-a6fd-d7a178f0d87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:50.556196 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ddeb2-3d14-4eed-a6fd-d7a178f0d87c None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:50.556481 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ddeb2-3d14-4eed-a6fd-d7a178f0d87c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:50.556758 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ddeb2-3d14-4eed-a6fd-d7a178f0d87c None admin] PATH_INFO: `/v3/projects/f64a28716fe04a18bf8389e3428e2088` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:50.557919 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ddeb2-3d14-4eed-a6fd-d7a178f0d87c None admin] RBAC: Authorizing `identity:get_project(project_id=f64a28716fe04a18bf8389e3428e2088)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:50.559337 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ddeb2-3d14-4eed-a6fd-d7a178f0d87c None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:50.561014 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 558/1129] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:46:50 2022] GET /identity/v3/projects/f64a28716fe04a18bf8389e3428e2088 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:50.566885 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5286e-3f9e-41f8-8f7b-185d1a16997a None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:50.662127 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5286e-3f9e-41f8-8f7b-185d1a16997a None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:50.693918 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeeb96f-fad4-49b4-85cf-d0eb43ce1610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:50.694549 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeeb96f-fad4-49b4-85cf-d0eb43ce1610 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:50.694825 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeeb96f-fad4-49b4-85cf-d0eb43ce1610 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:50.695093 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeeb96f-fad4-49b4-85cf-d0eb43ce1610 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:50.695937 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeeb96f-fad4-49b4-85cf-d0eb43ce1610 None admin] RBAC: Adding query filter params (role.id=5d1199580aaa485bb120b35e6f771ff9, scope.project.id=f64a28716fe04a18bf8389e3428e2088, user.id=402b7cc01ca149cbbbf617fb6303d35a) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:50.696248 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeeb96f-fad4-49b4-85cf-d0eb43ce1610 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:50.697654 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeeb96f-fad4-49b4-85cf-d0eb43ce1610 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:50.703941 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 572/1130] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:46:50 2022] GET /identity/v3/role_assignments?user.id=402b7cc01ca149cbbbf617fb6303d35a&scope.project.id=f64a28716fe04a18bf8389e3428e2088&role.id=5d1199580aaa485bb120b35e6f771ff9 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:52.929134 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbebcf-2410-4432-8b1e-4e539e7828a3 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:52.929612 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbebcf-2410-4432-8b1e-4e539e7828a3 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:52.929702 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbebcf-2410-4432-8b1e-4e539e7828a3 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:52.931040 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 559/1131] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:46:52.936280 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4ccc3-062a-42c8-9e0c-e739cadfcc7b None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:52.936714 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4ccc3-062a-42c8-9e0c-e739cadfcc7b None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:52.936840 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4ccc3-062a-42c8-9e0c-e739cadfcc7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:52.953701 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-11a4ccc3-062a-42c8-9e0c-e739cadfcc7b None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:46:52.954864 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-11a4ccc3-062a-42c8-9e0c-e739cadfcc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:46:53.008038 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:53.020018 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 573/1132] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:46:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:46:53.043706 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbbebcf-2410-4432-8b1e-4e539e7828a3 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:53.122048 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:53.141844 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbbebcf-2410-4432-8b1e-4e539e7828a3 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:53.174961 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d7ae9-8955-4bbe-bd93-d76f89a7a036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:53.175701 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d7ae9-8955-4bbe-bd93-d76f89a7a036 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:53.175990 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d7ae9-8955-4bbe-bd93-d76f89a7a036 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:53.176270 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d7ae9-8955-4bbe-bd93-d76f89a7a036 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:53.177430 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d7ae9-8955-4bbe-bd93-d76f89a7a036 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:53.179008 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d7ae9-8955-4bbe-bd93-d76f89a7a036 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:53.180620 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 560/1133] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:46:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:53.186448 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4ccc3-062a-42c8-9e0c-e739cadfcc7b None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:53.282325 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4ccc3-062a-42c8-9e0c-e739cadfcc7b None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:53.314969 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2ab86-8ec9-4c69-94de-9e867d2099aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:53.315705 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2ab86-8ec9-4c69-94de-9e867d2099aa None admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:53.315932 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2ab86-8ec9-4c69-94de-9e867d2099aa None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:53.316209 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2ab86-8ec9-4c69-94de-9e867d2099aa None admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:53.316919 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe2ab86-8ec9-4c69-94de-9e867d2099aa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:53.318342 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe2ab86-8ec9-4c69-94de-9e867d2099aa None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:53.342874 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 574/1134] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Jun 3 11:46:53 2022] POST /identity/v3/projects => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:46:55.574718 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c26a44-a38e-405c-aba4-c0930ca7c343 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:55.575237 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c26a44-a38e-405c-aba4-c0930ca7c343 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:55.575237 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c26a44-a38e-405c-aba4-c0930ca7c343 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:55.576591 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 561/1135] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:46:55.581789 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982bea5-6010-417f-84c3-39917e612ef0 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:55.582228 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982bea5-6010-417f-84c3-39917e612ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:55.582332 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982bea5-6010-417f-84c3-39917e612ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:55.599204 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-8982bea5-6010-417f-84c3-39917e612ef0 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:46:55.600392 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-8982bea5-6010-417f-84c3-39917e612ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:46:55.633955 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:55.665789 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 575/1136] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:46:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 11:46:55.690733 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c26a44-a38e-405c-aba4-c0930ca7c343 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:55.789335 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c26a44-a38e-405c-aba4-c0930ca7c343 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:55.822039 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf849e95-d497-4498-b93d-9c48c9088703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:55.822804 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf849e95-d497-4498-b93d-9c48c9088703 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:55.823089 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf849e95-d497-4498-b93d-9c48c9088703 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:55.823368 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf849e95-d497-4498-b93d-9c48c9088703 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:55.824557 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf849e95-d497-4498-b93d-9c48c9088703 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:55.826031 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf849e95-d497-4498-b93d-9c48c9088703 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:55.827553 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 562/1137] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:46:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:55.833150 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8982bea5-6010-417f-84c3-39917e612ef0 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:55.930140 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8982bea5-6010-417f-84c3-39917e612ef0 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:55.962710 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bbed5a-60c1-4622-9789-c9dcd40b9b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:55.963370 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bbed5a-60c1-4622-9789-c9dcd40b9b0d None admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:55.963692 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bbed5a-60c1-4622-9789-c9dcd40b9b0d None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:55.963971 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bbed5a-60c1-4622-9789-c9dcd40b9b0d None admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:55.964671 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bbed5a-60c1-4622-9789-c9dcd40b9b0d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:55.966096 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bbed5a-60c1-4622-9789-c9dcd40b9b0d None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:55.985819 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 576/1138] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Jun 3 11:46:55 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:46:58.217068 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d9630-44c2-4d90-a364-91aa8929d3d4 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:58.217595 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d9630-44c2-4d90-a364-91aa8929d3d4 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:58.217595 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d9630-44c2-4d90-a364-91aa8929d3d4 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:58.219519 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 563/1139] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:46:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:46:58.224727 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd861d-682d-466b-bb9f-4774081a47fd None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:58.225099 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd861d-682d-466b-bb9f-4774081a47fd None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:58.225283 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd861d-682d-466b-bb9f-4774081a47fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:58.241473 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-b8fd861d-682d-466b-bb9f-4774081a47fd None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:46:58.242638 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-b8fd861d-682d-466b-bb9f-4774081a47fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:46:58.264352 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:58.308987 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 577/1140] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:46:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:46:58.332530 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d9630-44c2-4d90-a364-91aa8929d3d4 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:58.350794 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:58.431550 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d9630-44c2-4d90-a364-91aa8929d3d4 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:58.464013 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8bc3be-597d-419e-9e82-8c224c29aca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:58.464781 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8bc3be-597d-419e-9e82-8c224c29aca5 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:58.465059 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8bc3be-597d-419e-9e82-8c224c29aca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:58.465330 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8bc3be-597d-419e-9e82-8c224c29aca5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:58.475750 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8bc3be-597d-419e-9e82-8c224c29aca5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:46:58.483119 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-2c8bc3be-597d-419e-9e82-8c224c29aca5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:46:58.483119 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:46:58.483119 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:46:58.483119 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:46:58.483119 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:46:58.483119 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:46:58.483119 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:46:58.483119 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:46:58.483119 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:46:58.483119 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:46:58.483119 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:46:58.483119 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:46:58.483119 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:46:58.483119 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:46:58.483119 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:46:58.483119 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:46:58.484272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:46:58.484272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:46:58.484272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:46:58.484272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:46:58.484272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:46:58.484272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:46:58.484272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:46:58.484272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:46:58.484272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:46:58.484272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:46:58.484272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:46:58.484272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:46:58.484272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:46:58.484272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:46:58.484272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:46:58.484272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:46:58.485340 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:46:58.485340 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:46:58.485340 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:46:58.485340 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:46:58.485340 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:46:58.485340 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:46:58.485340 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:46:58.485340 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:46:58.485340 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:46:58.485340 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:46:58.485340 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:46:58.485340 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:46:58.485340 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 564/1141] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 3 11:46:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:46:58.490335 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd861d-682d-466b-bb9f-4774081a47fd None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:58.589416 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd861d-682d-466b-bb9f-4774081a47fd None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:58.622946 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b4b28-4de6-4cd5-8555-6d2ebed8a16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:58.623644 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b4b28-4de6-4cd5-8555-6d2ebed8a16a None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:58.623929 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b4b28-4de6-4cd5-8555-6d2ebed8a16a None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:58.624202 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b4b28-4de6-4cd5-8555-6d2ebed8a16a None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:58.625011 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b4b28-4de6-4cd5-8555-6d2ebed8a16a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:58.625359 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b4b28-4de6-4cd5-8555-6d2ebed8a16a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:58.626723 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b4b28-4de6-4cd5-8555-6d2ebed8a16a None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:58.634559 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 578/1142] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:46:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:58.640980 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8bc3be-597d-419e-9e82-8c224c29aca5 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:58.717791 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:58.740636 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8bc3be-597d-419e-9e82-8c224c29aca5 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:58.772381 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ba514-92d2-4caa-9d00-fe85d402b94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:58.773232 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ba514-92d2-4caa-9d00-fe85d402b94c None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:58.773509 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ba514-92d2-4caa-9d00-fe85d402b94c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:58.773777 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ba514-92d2-4caa-9d00-fe85d402b94c None admin] PATH_INFO: `/v3/users/af04d4344ff04c8081f114286d0ef1a6` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:58.787028 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ba514-92d2-4caa-9d00-fe85d402b94c None admin] RBAC: Authorizing `identity:get_user(user_id=af04d4344ff04c8081f114286d0ef1a6)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:58.788495 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ba514-92d2-4caa-9d00-fe85d402b94c None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:58.790080 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 565/1143] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:46:58 2022] GET /identity/v3/users/af04d4344ff04c8081f114286d0ef1a6 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:58.795887 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b4b28-4de6-4cd5-8555-6d2ebed8a16a None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:58.817355 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:58.893617 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b4b28-4de6-4cd5-8555-6d2ebed8a16a None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:58.926596 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1404f1d-512f-4bf7-9688-fb4cd6e6680e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:58.927233 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1404f1d-512f-4bf7-9688-fb4cd6e6680e None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:58.927535 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1404f1d-512f-4bf7-9688-fb4cd6e6680e None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:58.927816 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1404f1d-512f-4bf7-9688-fb4cd6e6680e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:58.991342 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1404f1d-512f-4bf7-9688-fb4cd6e6680e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:58.992747 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1404f1d-512f-4bf7-9688-fb4cd6e6680e None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:59.012295 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:59.087236 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 579/1144] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:46:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 11:46:59.093080 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ba514-92d2-4caa-9d00-fe85d402b94c None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:59.188267 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ba514-92d2-4caa-9d00-fe85d402b94c None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:59.220527 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117c2c4-72b4-4cd4-bf48-08eed234993c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:59.221362 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117c2c4-72b4-4cd4-bf48-08eed234993c None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:59.221639 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117c2c4-72b4-4cd4-bf48-08eed234993c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:59.221910 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117c2c4-72b4-4cd4-bf48-08eed234993c None admin] PATH_INFO: `/v3/projects/043f6c66a74d445289d3f0bf92b62c14` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:59.223054 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b117c2c4-72b4-4cd4-bf48-08eed234993c None admin] RBAC: Authorizing `identity:get_project(project_id=043f6c66a74d445289d3f0bf92b62c14)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:59.224499 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b117c2c4-72b4-4cd4-bf48-08eed234993c None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:59.227228 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 566/1145] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:46:59 2022] GET /identity/v3/projects/043f6c66a74d445289d3f0bf92b62c14 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:46:59.233224 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1404f1d-512f-4bf7-9688-fb4cd6e6680e None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:46:59.331826 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1404f1d-512f-4bf7-9688-fb4cd6e6680e None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:46:59.350777 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:46:59.365370 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf0e52-bbfd-41ef-b5f3-75d1fea0e8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:46:59.366022 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf0e52-bbfd-41ef-b5f3-75d1fea0e8e0 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:46:59.366307 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf0e52-bbfd-41ef-b5f3-75d1fea0e8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:46:59.366584 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf0e52-bbfd-41ef-b5f3-75d1fea0e8e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:46:59.367416 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf0e52-bbfd-41ef-b5f3-75d1fea0e8e0 None admin] RBAC: Adding query filter params (role.id=c486e164840b41a59fd118dece2ce572, scope.project.id=043f6c66a74d445289d3f0bf92b62c14, user.id=af04d4344ff04c8081f114286d0ef1a6) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:46:59.367784 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf0e52-bbfd-41ef-b5f3-75d1fea0e8e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:46:59.369217 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf0e52-bbfd-41ef-b5f3-75d1fea0e8e0 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:46:59.374555 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 580/1146] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:46:59 2022] GET /identity/v3/role_assignments?user.id=af04d4344ff04c8081f114286d0ef1a6&scope.project.id=043f6c66a74d445289d3f0bf92b62c14&role.id=c486e164840b41a59fd118dece2ce572 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:47:01.550785 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba1283-bad7-490d-b51b-9107302ecc56 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:01.551340 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba1283-bad7-490d-b51b-9107302ecc56 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:01.551340 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba1283-bad7-490d-b51b-9107302ecc56 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:01.552712 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 567/1147] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:47:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:47:01.557853 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60a531-ac65-4468-9b84-68d4d13ef71b None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:01.558282 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60a531-ac65-4468-9b84-68d4d13ef71b None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:01.558410 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60a531-ac65-4468-9b84-68d4d13ef71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:01.574679 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-dd60a531-ac65-4468-9b84-68d4d13ef71b None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:47:01.575882 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-dd60a531-ac65-4468-9b84-68d4d13ef71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:47:01.641591 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 581/1148] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:47:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:47:01.664716 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba1283-bad7-490d-b51b-9107302ecc56 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:47:01.667595 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:47:01.762900 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba1283-bad7-490d-b51b-9107302ecc56 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:47:01.795655 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2021ec-64db-4c9a-b023-c0c000716700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:47:01.796424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2021ec-64db-4c9a-b023-c0c000716700 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:01.797237 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2021ec-64db-4c9a-b023-c0c000716700 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:01.797512 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2021ec-64db-4c9a-b023-c0c000716700 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:01.807283 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2021ec-64db-4c9a-b023-c0c000716700 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:47:01.815314 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-2a2021ec-64db-4c9a-b023-c0c000716700 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:47:01.815314 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:47:01.815314 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:47:01.815314 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:47:01.815314 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:47:01.815314 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:47:01.815314 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:47:01.815314 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:47:01.815314 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:47:01.815314 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:47:01.815314 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:47:01.815314 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:47:01.815314 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:47:01.815314 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:47:01.815314 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:47:01.815314 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:47:01.816425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:47:01.816425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:47:01.816425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:47:01.816425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:47:01.816425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:47:01.816425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:47:01.816425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:47:01.816425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:47:01.816425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:47:01.816425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:47:01.816425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:47:01.816425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:47:01.816425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:47:01.816425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:47:01.816425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:47:01.816425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:47:01.817574 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:47:01.817574 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:47:01.817574 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:47:01.817574 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:47:01.817574 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:47:01.817574 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:47:01.817574 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:47:01.817574 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:47:01.817574 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:47:01.817574 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:47:01.817574 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:47:01.817574 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:47:01.817574 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 568/1149] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 3 11:47:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:47:01.822324 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60a531-ac65-4468-9b84-68d4d13ef71b None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:47:01.923630 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60a531-ac65-4468-9b84-68d4d13ef71b None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:47:01.937074 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:47:01.957434 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c84dd5-61b0-412b-8cae-d9b22f8380c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:47:01.958094 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c84dd5-61b0-412b-8cae-d9b22f8380c0 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:01.958377 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c84dd5-61b0-412b-8cae-d9b22f8380c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:01.958650 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c84dd5-61b0-412b-8cae-d9b22f8380c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:01.959388 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c84dd5-61b0-412b-8cae-d9b22f8380c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:47:01.959793 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c84dd5-61b0-412b-8cae-d9b22f8380c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:47:01.961156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c84dd5-61b0-412b-8cae-d9b22f8380c0 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:47:01.969558 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 582/1150] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:47:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:47:01.975344 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2021ec-64db-4c9a-b023-c0c000716700 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:47:02.035072 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:47:02.072122 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2021ec-64db-4c9a-b023-c0c000716700 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:47:02.104151 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b901b-a650-4a59-a2c5-d9cb07f02860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:47:02.104992 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b901b-a650-4a59-a2c5-d9cb07f02860 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:02.105272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b901b-a650-4a59-a2c5-d9cb07f02860 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:02.105546 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b901b-a650-4a59-a2c5-d9cb07f02860 None admin] PATH_INFO: `/v3/users/af04d4344ff04c8081f114286d0ef1a6` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:02.106711 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3b901b-a650-4a59-a2c5-d9cb07f02860 None admin] RBAC: Authorizing `identity:get_user(user_id=af04d4344ff04c8081f114286d0ef1a6)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:47:02.108171 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3b901b-a650-4a59-a2c5-d9cb07f02860 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:47:02.110329 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 569/1151] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:47:01 2022] GET /identity/v3/users/af04d4344ff04c8081f114286d0ef1a6 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:47:02.115920 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c84dd5-61b0-412b-8cae-d9b22f8380c0 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:47:02.212166 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c84dd5-61b0-412b-8cae-d9b22f8380c0 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:47:02.254617 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c8978-9cfb-4cab-83a8-8441aae80842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:47:02.255464 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c8978-9cfb-4cab-83a8-8441aae80842 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:02.255780 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c8978-9cfb-4cab-83a8-8441aae80842 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:02.256058 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c8978-9cfb-4cab-83a8-8441aae80842 None admin] PATH_INFO: `/v3/projects/043f6c66a74d445289d3f0bf92b62c14` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:02.257227 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c8978-9cfb-4cab-83a8-8441aae80842 None admin] RBAC: Authorizing `identity:get_project(project_id=043f6c66a74d445289d3f0bf92b62c14)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:47:02.258652 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c8978-9cfb-4cab-83a8-8441aae80842 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:47:02.260347 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 583/1152] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:47:02 2022] GET /identity/v3/projects/043f6c66a74d445289d3f0bf92b62c14 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:47:02.266055 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b901b-a650-4a59-a2c5-d9cb07f02860 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:47:02.363436 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b901b-a650-4a59-a2c5-d9cb07f02860 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:47:02.390013 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:47:02.396380 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81f782-8d3b-4bf6-9b2b-eb8ec5302f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:47:02.397245 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81f782-8d3b-4bf6-9b2b-eb8ec5302f1d None admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:02.397528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81f782-8d3b-4bf6-9b2b-eb8ec5302f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:02.397804 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81f782-8d3b-4bf6-9b2b-eb8ec5302f1d None admin] PATH_INFO: `/v3/projects/043f6c66a74d445289d3f0bf92b62c14/users/af04d4344ff04c8081f114286d0ef1a6/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:02.399777 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc81f782-8d3b-4bf6-9b2b-eb8ec5302f1d None admin] RBAC: Authorizing `identity:create_grant(project_id=043f6c66a74d445289d3f0bf92b62c14, user_id=af04d4344ff04c8081f114286d0ef1a6, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:47:02.401197 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc81f782-8d3b-4bf6-9b2b-eb8ec5302f1d None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:47:02.414492 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 570/1153] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Jun 3 11:47:02 2022] PUT /identity/v3/projects/043f6c66a74d445289d3f0bf92b62c14/users/af04d4344ff04c8081f114286d0ef1a6/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:47:04.588313 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a5943-cad8-49c5-ac0f-09aca431578e None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:04.588863 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a5943-cad8-49c5-ac0f-09aca431578e None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:04.588863 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a5943-cad8-49c5-ac0f-09aca431578e None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:04.590217 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 584/1154] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:47:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:47:04.597826 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c35bc-a91f-4bb2-b7bc-910d907bbe67 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:04.598243 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c35bc-a91f-4bb2-b7bc-910d907bbe67 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:04.598380 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c35bc-a91f-4bb2-b7bc-910d907bbe67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:04.615306 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-147c35bc-a91f-4bb2-b7bc-910d907bbe67 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:47:04.616523 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-147c35bc-a91f-4bb2-b7bc-910d907bbe67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:47:04.680930 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 571/1155] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:47:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:47:04.704615 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a5943-cad8-49c5-ac0f-09aca431578e None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:47:04.750425 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:47:04.803932 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a5943-cad8-49c5-ac0f-09aca431578e None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:47:04.836032 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8adb7-4c9d-41fb-a28d-600b5be83bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:47:04.836803 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8adb7-4c9d-41fb-a28d-600b5be83bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:04.837085 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8adb7-4c9d-41fb-a28d-600b5be83bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:04.837359 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8adb7-4c9d-41fb-a28d-600b5be83bd9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:04.847627 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad8adb7-4c9d-41fb-a28d-600b5be83bd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:47:04.855058 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-4ad8adb7-4c9d-41fb-a28d-600b5be83bd9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:47:04.855058 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:47:04.855058 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:47:04.855058 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:47:04.855058 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:47:04.855058 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:47:04.855058 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:47:04.855058 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:47:04.855058 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:47:04.855058 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:47:04.855058 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:47:04.855058 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:47:04.855058 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:47:04.855058 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:47:04.855058 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:47:04.855058 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:47:04.856218 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:47:04.856218 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:47:04.856218 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:47:04.856218 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:47:04.856218 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:47:04.856218 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:47:04.856218 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:47:04.856218 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:47:04.856218 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:47:04.856218 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:47:04.856218 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:47:04.856218 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:47:04.856218 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:47:04.856218 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:47:04.856218 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:47:04.856218 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:47:04.857277 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:47:04.857277 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:47:04.857277 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:47:04.857277 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:47:04.857277 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:47:04.857277 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:47:04.857277 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:47:04.857277 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:47:04.857277 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:47:04.857277 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:47:04.857277 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:47:04.857277 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:47:04.857277 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 585/1156] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 3 11:47:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:47:04.862537 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c35bc-a91f-4bb2-b7bc-910d907bbe67 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:47:04.959576 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c35bc-a91f-4bb2-b7bc-910d907bbe67 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:47:04.979001 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:47:04.993618 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c37ac-526d-4625-a0ef-8cfce2dd4945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:47:04.994271 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c37ac-526d-4625-a0ef-8cfce2dd4945 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:04.994551 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c37ac-526d-4625-a0ef-8cfce2dd4945 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:04.994824 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c37ac-526d-4625-a0ef-8cfce2dd4945 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:04.995596 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1c37ac-526d-4625-a0ef-8cfce2dd4945 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:47:04.995906 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1c37ac-526d-4625-a0ef-8cfce2dd4945 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:47:04.997270 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1c37ac-526d-4625-a0ef-8cfce2dd4945 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:47:05.005130 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 572/1157] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:47:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:47:05.010829 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8adb7-4c9d-41fb-a28d-600b5be83bd9 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:47:05.106745 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8adb7-4c9d-41fb-a28d-600b5be83bd9 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:47:05.109526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:47:05.139935 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab379338-8162-4adf-a657-cee6e2abcc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:47:05.140782 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab379338-8162-4adf-a657-cee6e2abcc9a None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:05.141062 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab379338-8162-4adf-a657-cee6e2abcc9a None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:05.141330 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab379338-8162-4adf-a657-cee6e2abcc9a None admin] PATH_INFO: `/v3/users/af04d4344ff04c8081f114286d0ef1a6` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:05.142504 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab379338-8162-4adf-a657-cee6e2abcc9a None admin] RBAC: Authorizing `identity:get_user(user_id=af04d4344ff04c8081f114286d0ef1a6)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:47:05.143963 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab379338-8162-4adf-a657-cee6e2abcc9a None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:47:05.145547 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 586/1158] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:47:05 2022] GET /identity/v3/users/af04d4344ff04c8081f114286d0ef1a6 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:47:05.151080 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c37ac-526d-4625-a0ef-8cfce2dd4945 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:47:05.248533 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c37ac-526d-4625-a0ef-8cfce2dd4945 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:47:05.281536 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8132984d-c355-4613-8b94-c08c9d9107f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:47:05.282169 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132984d-c355-4613-8b94-c08c9d9107f9 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:05.282450 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132984d-c355-4613-8b94-c08c9d9107f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:05.282723 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132984d-c355-4613-8b94-c08c9d9107f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:05.329628 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:47:05.347902 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8132984d-c355-4613-8b94-c08c9d9107f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:47:05.349334 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8132984d-c355-4613-8b94-c08c9d9107f9 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:47:05.444114 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 573/1159] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:47:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 11:47:05.449812 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab379338-8162-4adf-a657-cee6e2abcc9a None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:47:05.544679 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab379338-8162-4adf-a657-cee6e2abcc9a None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:47:05.577741 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06106b6-baef-4943-92f4-192aa710cfc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:47:05.578580 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06106b6-baef-4943-92f4-192aa710cfc9 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:05.578861 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06106b6-baef-4943-92f4-192aa710cfc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:05.579134 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06106b6-baef-4943-92f4-192aa710cfc9 None admin] PATH_INFO: `/v3/projects/043f6c66a74d445289d3f0bf92b62c14` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:05.580326 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06106b6-baef-4943-92f4-192aa710cfc9 None admin] RBAC: Authorizing `identity:get_project(project_id=043f6c66a74d445289d3f0bf92b62c14)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:47:05.581749 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06106b6-baef-4943-92f4-192aa710cfc9 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:47:05.583384 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 587/1160] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:47:05 2022] GET /identity/v3/projects/043f6c66a74d445289d3f0bf92b62c14 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:47:05.589162 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8132984d-c355-4613-8b94-c08c9d9107f9 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:47:05.668586 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:47:05.686707 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8132984d-c355-4613-8b94-c08c9d9107f9 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:47:05.719880 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d9e25-8880-4854-923c-c336630d26d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:47:05.720463 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d9e25-8880-4854-923c-c336630d26d0 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:05.720746 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d9e25-8880-4854-923c-c336630d26d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:05.721023 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d9e25-8880-4854-923c-c336630d26d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:05.721845 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d9e25-8880-4854-923c-c336630d26d0 None admin] RBAC: Adding query filter params (role.id=c486e164840b41a59fd118dece2ce572, scope.project.id=043f6c66a74d445289d3f0bf92b62c14, user.id=af04d4344ff04c8081f114286d0ef1a6) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:47:05.722159 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d9e25-8880-4854-923c-c336630d26d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:47:05.723596 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d9e25-8880-4854-923c-c336630d26d0 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:47:05.729239 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 574/1161] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:47:05 2022] GET /identity/v3/role_assignments?user.id=af04d4344ff04c8081f114286d0ef1a6&scope.project.id=043f6c66a74d445289d3f0bf92b62c14&role.id=c486e164840b41a59fd118dece2ce572 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:47:07.951411 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14455cfa-1798-450a-abb5-4887ec2762d0 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:07.951935 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14455cfa-1798-450a-abb5-4887ec2762d0 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:07.952031 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14455cfa-1798-450a-abb5-4887ec2762d0 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:07.953920 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 588/1162] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:47:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:47:07.959041 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5be79d-9d45-4203-a585-f228636bd702 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:07.959430 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5be79d-9d45-4203-a585-f228636bd702 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:07.959623 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5be79d-9d45-4203-a585-f228636bd702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:07.975977 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-ab5be79d-9d45-4203-a585-f228636bd702 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:47:07.977148 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-ab5be79d-9d45-4203-a585-f228636bd702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:47:08.041521 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 575/1163] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:47:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:47:08.063727 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14455cfa-1798-450a-abb5-4887ec2762d0 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:47:08.105103 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:47:08.164598 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14455cfa-1798-450a-abb5-4887ec2762d0 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:47:08.197654 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e7254-4155-4ce5-969f-33084470ae3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:47:08.198279 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e7254-4155-4ce5-969f-33084470ae3f None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:08.198559 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e7254-4155-4ce5-969f-33084470ae3f None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:08.198829 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e7254-4155-4ce5-969f-33084470ae3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:08.262793 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243e7254-4155-4ce5-969f-33084470ae3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:47:08.264271 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243e7254-4155-4ce5-969f-33084470ae3f None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:47:08.303539 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:47:08.360269 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 589/1164] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:47:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 11:47:08.366205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5be79d-9d45-4203-a585-f228636bd702 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:47:08.440005 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:47:08.461583 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5be79d-9d45-4203-a585-f228636bd702 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:47:08.494449 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d4be8-4717-4b1a-8d1e-5019cd0ea3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:47:08.495229 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d4be8-4717-4b1a-8d1e-5019cd0ea3b1 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:08.495524 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d4be8-4717-4b1a-8d1e-5019cd0ea3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:08.495817 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d4be8-4717-4b1a-8d1e-5019cd0ea3b1 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:08.502800 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608d4be8-4717-4b1a-8d1e-5019cd0ea3b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:47:08.504313 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608d4be8-4717-4b1a-8d1e-5019cd0ea3b1 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:47:08.518036 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-608d4be8-4717-4b1a-8d1e-5019cd0ea3b1 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 03 11:47:08.518036 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:47:08.518036 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 03 11:47:08.518036 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 03 11:47:08.518036 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 11:47:08.518036 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 11:47:08.518036 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 11:47:08.518036 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 11:47:08.518036 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 03 11:47:08.518036 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:47:08.518036 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 11:47:08.518036 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:47:08.518036 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:47:08.518036 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:47:08.518036 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:47:08.518036 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:47:08.518036 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:47:08.519311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:47:08.519311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:47:08.519311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:47:08.519311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:47:08.519311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:47:08.519311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:47:08.519311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:47:08.519311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:47:08.519311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:47:08.519311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:47:08.519311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:47:08.519311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:47:08.519311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:47:08.519311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:47:08.519311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:47:08.519311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:47:08.520304 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:47:08.520304 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:47:08.520304 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:47:08.520304 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:47:08.520304 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:47:08.520304 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:47:08.520304 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:47:08.520304 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:47:08.520304 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:47:08.520304 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:47:08.520304 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 03 11:47:08.520304 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:47:08.520304 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 03 11:47:08.520304 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:47:08.520304 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 576/1165] 10.222.0.15 () {56 vars in 1117 bytes} [Fri Jun 3 11:47:08 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:47:08.524978 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e7254-4155-4ce5-969f-33084470ae3f None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:47:08.619180 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e7254-4155-4ce5-969f-33084470ae3f None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:47:08.651496 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24df71e-b630-4e89-b8ab-82ecf29f76a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:47:08.652422 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24df71e-b630-4e89-b8ab-82ecf29f76a6 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:08.652706 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24df71e-b630-4e89-b8ab-82ecf29f76a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:08.652979 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24df71e-b630-4e89-b8ab-82ecf29f76a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:08.653694 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24df71e-b630-4e89-b8ab-82ecf29f76a6 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:47:08.654003 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24df71e-b630-4e89-b8ab-82ecf29f76a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:47:08.655355 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24df71e-b630-4e89-b8ab-82ecf29f76a6 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:47:08.662308 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 590/1166] 10.222.0.15 () {56 vars in 1115 bytes} [Fri Jun 3 11:47:08 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:47:10.852403 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb601cf-b39e-4db2-8413-774493a1d5ee None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:10.852961 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb601cf-b39e-4db2-8413-774493a1d5ee None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:10.852961 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb601cf-b39e-4db2-8413-774493a1d5ee None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:10.854298 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 577/1167] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:47:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:47:10.859965 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328b1ab-3451-4bc3-b7f4-30fbd0adc2b6 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:10.860353 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328b1ab-3451-4bc3-b7f4-30fbd0adc2b6 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:10.860527 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328b1ab-3451-4bc3-b7f4-30fbd0adc2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:10.866457 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:47:10.877734 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-5328b1ab-3451-4bc3-b7f4-30fbd0adc2b6 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:47:10.878932 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-5328b1ab-3451-4bc3-b7f4-30fbd0adc2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:47:10.943726 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 591/1168] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:47:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:47:10.966128 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb601cf-b39e-4db2-8413-774493a1d5ee None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:47:11.065252 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb601cf-b39e-4db2-8413-774493a1d5ee None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:47:11.097507 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca85a2e-d0fe-48b9-aee4-7dd30740df00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:47:11.098143 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca85a2e-d0fe-48b9-aee4-7dd30740df00 None admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:11.098425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca85a2e-d0fe-48b9-aee4-7dd30740df00 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:11.098699 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca85a2e-d0fe-48b9-aee4-7dd30740df00 None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:11.099417 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca85a2e-d0fe-48b9-aee4-7dd30740df00 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:47:11.100803 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca85a2e-d0fe-48b9-aee4-7dd30740df00 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:47:11.104176 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:47:11.116139 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 578/1169] 10.222.0.15 () {60 vars in 1138 bytes} [Fri Jun 3 11:47:10 2022] POST /identity/v3/domains => generated 267 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:47:13.345656 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddda6dd-a0c6-42c5-ac3d-0ebeb5cac703 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:13.346189 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddda6dd-a0c6-42c5-ac3d-0ebeb5cac703 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:13.346291 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddda6dd-a0c6-42c5-ac3d-0ebeb5cac703 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:13.347625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 592/1170] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:47:13.352842 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa620e-6588-4a7e-aeab-92838597f03f None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:13.353229 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa620e-6588-4a7e-aeab-92838597f03f None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:13.353402 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa620e-6588-4a7e-aeab-92838597f03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:13.370305 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-11fa620e-6588-4a7e-aeab-92838597f03f None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:47:13.371470 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-11fa620e-6588-4a7e-aeab-92838597f03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:47:13.435661 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 579/1171] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:47:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:47:13.458484 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddda6dd-a0c6-42c5-ac3d-0ebeb5cac703 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:47:13.557643 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddda6dd-a0c6-42c5-ac3d-0ebeb5cac703 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:47:13.590560 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e97b62-e739-4a4a-b08a-bb108e1adac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:47:13.591399 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e97b62-e739-4a4a-b08a-bb108e1adac0 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:13.591716 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e97b62-e739-4a4a-b08a-bb108e1adac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:13.591995 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e97b62-e739-4a4a-b08a-bb108e1adac0 None admin] PATH_INFO: `/v3/domains/8447f6adf97f4f1795a5211827e53d29` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:13.594451 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:47:13.603525 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e97b62-e739-4a4a-b08a-bb108e1adac0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=8447f6adf97f4f1795a5211827e53d29)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:47:13.604917 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e97b62-e739-4a4a-b08a-bb108e1adac0 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:47:13.606518 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 593/1172] 10.222.0.15 () {56 vars in 1183 bytes} [Fri Jun 3 11:47:13 2022] GET /identity/v3/domains/8447f6adf97f4f1795a5211827e53d29 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:47:13.612117 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa620e-6588-4a7e-aeab-92838597f03f None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:47:13.708278 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa620e-6588-4a7e-aeab-92838597f03f None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:47:13.733155 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:47:13.741619 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ea5d9-49ef-4a4d-b459-4c4f80a3da44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:47:13.742268 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ea5d9-49ef-4a4d-b459-4c4f80a3da44 None admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:13.742551 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ea5d9-49ef-4a4d-b459-4c4f80a3da44 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:13.742826 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ea5d9-49ef-4a4d-b459-4c4f80a3da44 None admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:13.743555 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884ea5d9-49ef-4a4d-b459-4c4f80a3da44 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:47:13.744973 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884ea5d9-49ef-4a4d-b459-4c4f80a3da44 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:47:13.769071 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 580/1173] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Jun 3 11:47:13 2022] POST /identity/v3/projects => generated 361 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:47:15.993974 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8caf1-60f3-468d-9942-94544a6edfbe None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:15.994480 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8caf1-60f3-468d-9942-94544a6edfbe None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:15.994582 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8caf1-60f3-468d-9942-94544a6edfbe None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:15.996023 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 594/1174] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:47:16.001678 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062354f-2816-4629-a552-5c837d4618f1 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:16.002116 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062354f-2816-4629-a552-5c837d4618f1 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:16.002245 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062354f-2816-4629-a552-5c837d4618f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:16.018826 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-4062354f-2816-4629-a552-5c837d4618f1 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:47:16.020048 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-4062354f-2816-4629-a552-5c837d4618f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:47:16.084280 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 581/1175] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:47:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:47:16.108211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8caf1-60f3-468d-9942-94544a6edfbe None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:47:16.205820 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8caf1-60f3-468d-9942-94544a6edfbe None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:47:16.238054 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e6bda9-f085-49a9-a5a5-03d2f528bff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:47:16.238885 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6bda9-f085-49a9-a5a5-03d2f528bff8 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:16.239164 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6bda9-f085-49a9-a5a5-03d2f528bff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:16.239436 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6bda9-f085-49a9-a5a5-03d2f528bff8 None admin] PATH_INFO: `/v3/domains/8447f6adf97f4f1795a5211827e53d29` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:16.240611 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e6bda9-f085-49a9-a5a5-03d2f528bff8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=8447f6adf97f4f1795a5211827e53d29)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:47:16.242040 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e6bda9-f085-49a9-a5a5-03d2f528bff8 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:47:16.243613 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 595/1176] 10.222.0.15 () {56 vars in 1183 bytes} [Fri Jun 3 11:47:16 2022] GET /identity/v3/domains/8447f6adf97f4f1795a5211827e53d29 => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:47:16.249196 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062354f-2816-4629-a552-5c837d4618f1 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:47:16.344493 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062354f-2816-4629-a552-5c837d4618f1 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:47:16.353168 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:47:16.378707 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9abcf-d2b9-4e5c-a511-b655ff87d0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:47:16.379352 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9abcf-d2b9-4e5c-a511-b655ff87d0fd None admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:16.379660 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9abcf-d2b9-4e5c-a511-b655ff87d0fd None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:16.379936 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9abcf-d2b9-4e5c-a511-b655ff87d0fd None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:16.380621 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de9abcf-d2b9-4e5c-a511-b655ff87d0fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:47:16.382026 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de9abcf-d2b9-4e5c-a511-b655ff87d0fd None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:47:16.401391 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 582/1177] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Jun 3 11:47:16 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:47:18.637575 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7ffe0-2f67-423d-bfba-45aff1de8f47 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:18.638142 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7ffe0-2f67-423d-bfba-45aff1de8f47 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:18.638142 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7ffe0-2f67-423d-bfba-45aff1de8f47 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:18.639479 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 596/1178] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:47:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:47:18.644818 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037408b-42bb-4c13-a0fb-cbe9c9edce84 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:18.645208 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037408b-42bb-4c13-a0fb-cbe9c9edce84 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:18.645380 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037408b-42bb-4c13-a0fb-cbe9c9edce84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:18.663103 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-e037408b-42bb-4c13-a0fb-cbe9c9edce84 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:47:18.664305 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-e037408b-42bb-4c13-a0fb-cbe9c9edce84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:47:18.728762 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 583/1179] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:47:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:47:18.752022 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7ffe0-2f67-423d-bfba-45aff1de8f47 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:47:18.812494 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:47:18.851373 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7ffe0-2f67-423d-bfba-45aff1de8f47 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:47:18.882605 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1af998-df59-4b45-9a4d-4bdc27942a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:47:18.883375 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1af998-df59-4b45-9a4d-4bdc27942a90 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:18.883684 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1af998-df59-4b45-9a4d-4bdc27942a90 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:18.883956 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1af998-df59-4b45-9a4d-4bdc27942a90 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:18.894839 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1af998-df59-4b45-9a4d-4bdc27942a90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:47:18.902527 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-ec1af998-df59-4b45-9a4d-4bdc27942a90 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:47:18.902527 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:47:18.902527 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:47:18.902527 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:47:18.902527 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:47:18.902527 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:47:18.902527 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:47:18.902527 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:47:18.902527 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:47:18.902527 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:47:18.902527 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:47:18.902527 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:47:18.902527 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:47:18.902527 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:47:18.902527 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:47:18.902527 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:47:18.903692 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:47:18.903692 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:47:18.903692 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:47:18.903692 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:47:18.903692 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:47:18.903692 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:47:18.903692 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:47:18.903692 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:47:18.903692 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:47:18.903692 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:47:18.903692 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:47:18.903692 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:47:18.903692 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:47:18.903692 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:47:18.903692 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:47:18.903692 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:47:18.904752 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:47:18.904752 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:47:18.904752 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:47:18.904752 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:47:18.904752 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:47:18.904752 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:47:18.904752 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:47:18.904752 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:47:18.904752 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:47:18.904752 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:47:18.904752 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:47:18.904752 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:47:18.904752 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 597/1180] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 3 11:47:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:47:18.910301 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e037408b-42bb-4c13-a0fb-cbe9c9edce84 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:47:18.997528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:47:19.004790 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e037408b-42bb-4c13-a0fb-cbe9c9edce84 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:47:19.038332 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35ab2a-748f-420f-9e7d-1c299f2c57e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:47:19.038973 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35ab2a-748f-420f-9e7d-1c299f2c57e0 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:19.039252 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35ab2a-748f-420f-9e7d-1c299f2c57e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:19.039544 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35ab2a-748f-420f-9e7d-1c299f2c57e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:19.040306 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35ab2a-748f-420f-9e7d-1c299f2c57e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:47:19.040608 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35ab2a-748f-420f-9e7d-1c299f2c57e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:47:19.041967 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35ab2a-748f-420f-9e7d-1c299f2c57e0 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:47:19.049743 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 584/1181] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:47:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:47:19.055333 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1af998-df59-4b45-9a4d-4bdc27942a90 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:47:19.151302 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1af998-df59-4b45-9a4d-4bdc27942a90 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:47:19.173416 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:47:19.184861 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9056bfbf-1d6f-403e-afe7-cd3d24faf5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:47:19.185715 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056bfbf-1d6f-403e-afe7-cd3d24faf5ec None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:19.185996 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056bfbf-1d6f-403e-afe7-cd3d24faf5ec None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:19.186269 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056bfbf-1d6f-403e-afe7-cd3d24faf5ec None admin] PATH_INFO: `/v3/users/6bd23d0560534884a5b5816d72a67780` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:19.199256 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9056bfbf-1d6f-403e-afe7-cd3d24faf5ec None admin] RBAC: Authorizing `identity:get_user(user_id=6bd23d0560534884a5b5816d72a67780)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:47:19.200732 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9056bfbf-1d6f-403e-afe7-cd3d24faf5ec None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:47:19.202866 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 598/1182] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:47:19 2022] GET /identity/v3/users/6bd23d0560534884a5b5816d72a67780 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:47:19.208620 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35ab2a-748f-420f-9e7d-1c299f2c57e0 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:47:19.304531 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35ab2a-748f-420f-9e7d-1c299f2c57e0 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:47:19.337715 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037ac31-8116-48a3-bf32-b2a6aedc44a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:47:19.338360 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037ac31-8116-48a3-bf32-b2a6aedc44a2 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:19.338638 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037ac31-8116-48a3-bf32-b2a6aedc44a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:19.338914 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037ac31-8116-48a3-bf32-b2a6aedc44a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:19.362480 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:47:19.404722 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037ac31-8116-48a3-bf32-b2a6aedc44a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:47:19.406135 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037ac31-8116-48a3-bf32-b2a6aedc44a2 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:47:19.500210 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 585/1183] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:47:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 11:47:19.505984 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9056bfbf-1d6f-403e-afe7-cd3d24faf5ec None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:47:19.603380 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9056bfbf-1d6f-403e-afe7-cd3d24faf5ec None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:47:19.636432 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc53db-a461-463a-ab0f-715d3b1bae75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:47:19.637276 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc53db-a461-463a-ab0f-715d3b1bae75 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:19.637561 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc53db-a461-463a-ab0f-715d3b1bae75 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:19.637834 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc53db-a461-463a-ab0f-715d3b1bae75 None admin] PATH_INFO: `/v3/projects/5a096ca8193f47e4baec0cd8bf22ed70` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:19.638994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc53db-a461-463a-ab0f-715d3b1bae75 None admin] RBAC: Authorizing `identity:get_project(project_id=5a096ca8193f47e4baec0cd8bf22ed70)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:47:19.640487 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc53db-a461-463a-ab0f-715d3b1bae75 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:47:19.642123 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 599/1184] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:47:19 2022] GET /identity/v3/projects/5a096ca8193f47e4baec0cd8bf22ed70 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:47:19.648162 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037ac31-8116-48a3-bf32-b2a6aedc44a2 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:47:19.702657 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:47:19.744407 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037ac31-8116-48a3-bf32-b2a6aedc44a2 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:47:19.778276 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae290c0-b05f-4068-86be-f96e5785d26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:47:19.778907 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae290c0-b05f-4068-86be-f96e5785d26e None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:19.779191 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae290c0-b05f-4068-86be-f96e5785d26e None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:19.779472 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae290c0-b05f-4068-86be-f96e5785d26e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:19.780322 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae290c0-b05f-4068-86be-f96e5785d26e None admin] RBAC: Adding query filter params (role.id=c486e164840b41a59fd118dece2ce572, scope.project.id=5a096ca8193f47e4baec0cd8bf22ed70, user.id=6bd23d0560534884a5b5816d72a67780) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:47:19.780659 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae290c0-b05f-4068-86be-f96e5785d26e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:47:19.782074 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae290c0-b05f-4068-86be-f96e5785d26e None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:47:19.787337 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 586/1185] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:47:19 2022] GET /identity/v3/role_assignments?user.id=6bd23d0560534884a5b5816d72a67780&scope.project.id=5a096ca8193f47e4baec0cd8bf22ed70&role.id=c486e164840b41a59fd118dece2ce572 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:47:21.994889 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20119f-bda4-4c91-af36-60e262a5051b None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:21.995387 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20119f-bda4-4c91-af36-60e262a5051b None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:21.995486 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20119f-bda4-4c91-af36-60e262a5051b None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:21.996825 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 600/1186] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:47:22.001995 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42150657-2b47-4e37-b347-f5d947f8e3c3 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:22.002400 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42150657-2b47-4e37-b347-f5d947f8e3c3 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:22.002545 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42150657-2b47-4e37-b347-f5d947f8e3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:22.019283 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-42150657-2b47-4e37-b347-f5d947f8e3c3 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:47:22.020473 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-42150657-2b47-4e37-b347-f5d947f8e3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:47:22.084430 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 587/1187] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:47:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:47:22.107329 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20119f-bda4-4c91-af36-60e262a5051b None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:47:22.156257 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:47:22.205956 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20119f-bda4-4c91-af36-60e262a5051b None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:47:22.237751 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c359d-79f3-41b9-8edf-31c811c4024e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:47:22.238520 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c359d-79f3-41b9-8edf-31c811c4024e None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:22.238808 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c359d-79f3-41b9-8edf-31c811c4024e None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:22.239084 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c359d-79f3-41b9-8edf-31c811c4024e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:22.248718 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388c359d-79f3-41b9-8edf-31c811c4024e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:47:22.256761 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-388c359d-79f3-41b9-8edf-31c811c4024e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:47:22.256761 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:47:22.256761 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:47:22.256761 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:47:22.256761 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:47:22.256761 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:47:22.256761 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:47:22.256761 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:47:22.256761 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:47:22.256761 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:47:22.256761 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:47:22.256761 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:47:22.256761 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:47:22.256761 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:47:22.256761 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:47:22.256761 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:47:22.257762 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:47:22.257762 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:47:22.257762 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:47:22.257762 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:47:22.257762 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:47:22.257762 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:47:22.257762 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:47:22.257762 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:47:22.257762 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:47:22.257762 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:47:22.257762 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:47:22.257762 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:47:22.257762 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:47:22.257762 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:47:22.257762 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:47:22.257762 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:47:22.258807 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:47:22.258807 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:47:22.258807 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:47:22.258807 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:47:22.258807 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:47:22.258807 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:47:22.258807 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:47:22.258807 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:47:22.258807 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:47:22.258807 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:47:22.258807 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:47:22.258807 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:47:22.258807 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 601/1188] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 3 11:47:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:47:22.263747 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42150657-2b47-4e37-b347-f5d947f8e3c3 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:47:22.311181 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:47:22.359340 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42150657-2b47-4e37-b347-f5d947f8e3c3 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:47:22.392040 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e0b3a-76e8-4918-abd5-615fb30686d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:47:22.392682 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e0b3a-76e8-4918-abd5-615fb30686d4 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:22.392960 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e0b3a-76e8-4918-abd5-615fb30686d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:22.393229 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e0b3a-76e8-4918-abd5-615fb30686d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:22.393958 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e0b3a-76e8-4918-abd5-615fb30686d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:47:22.394260 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e0b3a-76e8-4918-abd5-615fb30686d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:47:22.395647 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e0b3a-76e8-4918-abd5-615fb30686d4 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:47:22.403570 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 588/1189] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:47:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:47:22.409260 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c359d-79f3-41b9-8edf-31c811c4024e None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:47:22.505476 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c359d-79f3-41b9-8edf-31c811c4024e None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:47:22.513821 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:47:22.539060 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f939d2b-055b-4804-bd28-de56d811680f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:47:22.539936 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f939d2b-055b-4804-bd28-de56d811680f None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:22.540221 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f939d2b-055b-4804-bd28-de56d811680f None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:22.540496 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f939d2b-055b-4804-bd28-de56d811680f None admin] PATH_INFO: `/v3/users/6bd23d0560534884a5b5816d72a67780` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:22.541669 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f939d2b-055b-4804-bd28-de56d811680f None admin] RBAC: Authorizing `identity:get_user(user_id=6bd23d0560534884a5b5816d72a67780)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:47:22.543090 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f939d2b-055b-4804-bd28-de56d811680f None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:47:22.544702 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 602/1190] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:47:22 2022] GET /identity/v3/users/6bd23d0560534884a5b5816d72a67780 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:47:22.550877 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e0b3a-76e8-4918-abd5-615fb30686d4 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:47:22.646891 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e0b3a-76e8-4918-abd5-615fb30686d4 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:47:22.659109 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:47:22.680618 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3e995-5757-4fef-ae04-27d721785bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:47:22.681381 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3e995-5757-4fef-ae04-27d721785bca None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:22.681656 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3e995-5757-4fef-ae04-27d721785bca None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:22.681926 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3e995-5757-4fef-ae04-27d721785bca None admin] PATH_INFO: `/v3/projects/5a096ca8193f47e4baec0cd8bf22ed70` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:22.683079 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c3e995-5757-4fef-ae04-27d721785bca None admin] RBAC: Authorizing `identity:get_project(project_id=5a096ca8193f47e4baec0cd8bf22ed70)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:47:22.684515 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c3e995-5757-4fef-ae04-27d721785bca None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:47:22.686142 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 589/1191] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:47:22 2022] GET /identity/v3/projects/5a096ca8193f47e4baec0cd8bf22ed70 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:47:22.692551 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f939d2b-055b-4804-bd28-de56d811680f None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:47:22.791670 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f939d2b-055b-4804-bd28-de56d811680f None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:47:22.824555 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85512dc8-14f2-4242-94af-9f53b3d48202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:47:22.825419 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85512dc8-14f2-4242-94af-9f53b3d48202 None admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:22.825699 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85512dc8-14f2-4242-94af-9f53b3d48202 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:22.825971 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85512dc8-14f2-4242-94af-9f53b3d48202 None admin] PATH_INFO: `/v3/projects/5a096ca8193f47e4baec0cd8bf22ed70/users/6bd23d0560534884a5b5816d72a67780/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:22.827956 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85512dc8-14f2-4242-94af-9f53b3d48202 None admin] RBAC: Authorizing `identity:create_grant(project_id=5a096ca8193f47e4baec0cd8bf22ed70, user_id=6bd23d0560534884a5b5816d72a67780, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:47:22.829385 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85512dc8-14f2-4242-94af-9f53b3d48202 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:47:22.841665 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 603/1192] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Jun 3 11:47:22 2022] PUT /identity/v3/projects/5a096ca8193f47e4baec0cd8bf22ed70/users/6bd23d0560534884a5b5816d72a67780/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:47:25.021463 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20d075-8454-4d64-bc52-2fd799bf02f7 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:25.021998 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20d075-8454-4d64-bc52-2fd799bf02f7 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:25.021998 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20d075-8454-4d64-bc52-2fd799bf02f7 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:25.023354 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 590/1193] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:47:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:47:25.028763 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6dd325-4e61-46b2-ae19-00ff5ac6d8b3 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:25.029178 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6dd325-4e61-46b2-ae19-00ff5ac6d8b3 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:25.029325 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6dd325-4e61-46b2-ae19-00ff5ac6d8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:25.046356 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-ab6dd325-4e61-46b2-ae19-00ff5ac6d8b3 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:47:25.047579 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-ab6dd325-4e61-46b2-ae19-00ff5ac6d8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:47:25.075018 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:47:25.111996 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 604/1194] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:47:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 03 11:47:25.134886 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20d075-8454-4d64-bc52-2fd799bf02f7 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:47:25.234516 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20d075-8454-4d64-bc52-2fd799bf02f7 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:47:25.269879 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f5b00-c13b-4684-9dde-7cdc460304a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:47:25.270642 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f5b00-c13b-4684-9dde-7cdc460304a1 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:25.270917 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f5b00-c13b-4684-9dde-7cdc460304a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:25.271185 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f5b00-c13b-4684-9dde-7cdc460304a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:25.281045 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f5b00-c13b-4684-9dde-7cdc460304a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:47:25.288576 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-0f7f5b00-c13b-4684-9dde-7cdc460304a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:47:25.288576 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:47:25.288576 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:47:25.288576 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:47:25.288576 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:47:25.288576 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:47:25.288576 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:47:25.288576 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:47:25.288576 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:47:25.288576 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:47:25.288576 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:47:25.288576 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:47:25.288576 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:47:25.288576 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:47:25.288576 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:47:25.288576 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:47:25.289650 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:47:25.289650 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:47:25.289650 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:47:25.289650 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:47:25.289650 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:47:25.289650 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:47:25.289650 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:47:25.289650 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:47:25.289650 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:47:25.289650 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:47:25.289650 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:47:25.289650 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:47:25.289650 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:47:25.289650 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:47:25.289650 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:47:25.289650 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:47:25.290711 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:47:25.290711 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:47:25.290711 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:47:25.290711 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:47:25.290711 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:47:25.290711 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:47:25.290711 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:47:25.290711 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:47:25.290711 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:47:25.290711 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:47:25.290711 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:47:25.290711 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:47:25.294501 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 591/1195] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 3 11:47:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:47:25.295410 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6dd325-4e61-46b2-ae19-00ff5ac6d8b3 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:47:25.391195 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6dd325-4e61-46b2-ae19-00ff5ac6d8b3 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:47:25.423400 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7646ab6-6944-4cec-8bb0-971cd26ebf45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:47:25.424086 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7646ab6-6944-4cec-8bb0-971cd26ebf45 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:25.424370 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7646ab6-6944-4cec-8bb0-971cd26ebf45 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:25.424647 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7646ab6-6944-4cec-8bb0-971cd26ebf45 None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:25.425385 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7646ab6-6944-4cec-8bb0-971cd26ebf45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:47:25.425690 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7646ab6-6944-4cec-8bb0-971cd26ebf45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:47:25.427054 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7646ab6-6944-4cec-8bb0-971cd26ebf45 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:47:25.434826 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 605/1196] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:47:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:47:25.440916 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f5b00-c13b-4684-9dde-7cdc460304a1 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:47:25.481186 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:47:25.538960 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f5b00-c13b-4684-9dde-7cdc460304a1 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:47:25.574676 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1456e6f-5611-4c85-b47b-a93a50e6c98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:47:25.575544 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1456e6f-5611-4c85-b47b-a93a50e6c98e None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:25.575829 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1456e6f-5611-4c85-b47b-a93a50e6c98e None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:25.576099 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1456e6f-5611-4c85-b47b-a93a50e6c98e None admin] PATH_INFO: `/v3/users/6bd23d0560534884a5b5816d72a67780` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:25.577278 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1456e6f-5611-4c85-b47b-a93a50e6c98e None admin] RBAC: Authorizing `identity:get_user(user_id=6bd23d0560534884a5b5816d72a67780)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:47:25.578678 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1456e6f-5611-4c85-b47b-a93a50e6c98e None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:47:25.580274 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 592/1197] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Jun 3 11:47:25 2022] GET /identity/v3/users/6bd23d0560534884a5b5816d72a67780 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:47:25.585869 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7646ab6-6944-4cec-8bb0-971cd26ebf45 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:47:25.613854 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:47:25.683244 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7646ab6-6944-4cec-8bb0-971cd26ebf45 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:47:25.715964 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f04100-29e4-4d26-bafd-1913a3bd52aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:47:25.716593 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f04100-29e4-4d26-bafd-1913a3bd52aa None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:25.716880 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f04100-29e4-4d26-bafd-1913a3bd52aa None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:25.717150 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f04100-29e4-4d26-bafd-1913a3bd52aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:25.781645 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f04100-29e4-4d26-bafd-1913a3bd52aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:47:25.783079 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f04100-29e4-4d26-bafd-1913a3bd52aa None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:47:25.809701 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:47:25.879060 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 606/1198] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:47:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 11:47:25.885043 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1456e6f-5611-4c85-b47b-a93a50e6c98e None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:47:25.981742 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1456e6f-5611-4c85-b47b-a93a50e6c98e None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:47:25.990899 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:47:26.014940 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da926d51-4dd2-4964-8b19-581714d9dd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:47:26.015812 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da926d51-4dd2-4964-8b19-581714d9dd3f None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:26.016100 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da926d51-4dd2-4964-8b19-581714d9dd3f None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:26.016379 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da926d51-4dd2-4964-8b19-581714d9dd3f None admin] PATH_INFO: `/v3/projects/5a096ca8193f47e4baec0cd8bf22ed70` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:26.017548 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da926d51-4dd2-4964-8b19-581714d9dd3f None admin] RBAC: Authorizing `identity:get_project(project_id=5a096ca8193f47e4baec0cd8bf22ed70)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:47:26.018989 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da926d51-4dd2-4964-8b19-581714d9dd3f None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:47:26.020789 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 593/1199] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Jun 3 11:47:25 2022] GET /identity/v3/projects/5a096ca8193f47e4baec0cd8bf22ed70 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:47:26.027111 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f04100-29e4-4d26-bafd-1913a3bd52aa None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:47:26.121438 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f04100-29e4-4d26-bafd-1913a3bd52aa None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:47:26.146757 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:47:26.154865 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020aefc-9810-47f6-84eb-f1fe0c221a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:47:26.156061 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020aefc-9810-47f6-84eb-f1fe0c221a6d None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:47:26.156340 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020aefc-9810-47f6-84eb-f1fe0c221a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:47:26.156611 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020aefc-9810-47f6-84eb-f1fe0c221a6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:47:26.157431 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f020aefc-9810-47f6-84eb-f1fe0c221a6d None admin] RBAC: Adding query filter params (role.id=c486e164840b41a59fd118dece2ce572, scope.project.id=5a096ca8193f47e4baec0cd8bf22ed70, user.id=6bd23d0560534884a5b5816d72a67780) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:47:26.157735 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f020aefc-9810-47f6-84eb-f1fe0c221a6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:47:26.159140 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f020aefc-9810-47f6-84eb-f1fe0c221a6d None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:47:26.164761 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 607/1200] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:47:26 2022] GET /identity/v3/role_assignments?user.id=6bd23d0560534884a5b5816d72a67780&scope.project.id=5a096ca8193f47e4baec0cd8bf22ed70&role.id=c486e164840b41a59fd118dece2ce572 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:47:36.010814 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=12 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:47:36.162317 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=4 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:26.902800 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95076dba-1c58-4c53-81d6-aeb443bc84bc None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:26.903937 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95076dba-1c58-4c53-81d6-aeb443bc84bc None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:26.903937 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95076dba-1c58-4c53-81d6-aeb443bc84bc None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:26.907346 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 594/1201] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:48:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:48:26.917656 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca2df5-b1a4-4b08-a1e6-2c91ae4a9ab4 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:26.918192 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca2df5-b1a4-4b08-a1e6-2c91ae4a9ab4 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:26.918281 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca2df5-b1a4-4b08-a1e6-2c91ae4a9ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:26.939002 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-5dca2df5-b1a4-4b08-a1e6-2c91ae4a9ab4 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:48:26.940241 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-5dca2df5-b1a4-4b08-a1e6-2c91ae4a9ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:48:27.034143 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 608/1202] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:48:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:48:27.061193 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95076dba-1c58-4c53-81d6-aeb443bc84bc None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:27.186642 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95076dba-1c58-4c53-81d6-aeb443bc84bc None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:27.230736 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de18f9d-6e96-49bd-a0ad-b6d5884322c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:27.231586 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de18f9d-6e96-49bd-a0ad-b6d5884322c8 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:27.231876 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de18f9d-6e96-49bd-a0ad-b6d5884322c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:27.232154 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de18f9d-6e96-49bd-a0ad-b6d5884322c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:27.243065 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de18f9d-6e96-49bd-a0ad-b6d5884322c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:27.244602 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de18f9d-6e96-49bd-a0ad-b6d5884322c8 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:27.269232 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-3de18f9d-6e96-49bd-a0ad-b6d5884322c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:48:27.269232 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:48:27.269232 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:48:27.269232 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:48:27.269232 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:48:27.269232 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:48:27.269232 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:48:27.269232 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:48:27.269232 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:48:27.269232 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:48:27.269232 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:48:27.269232 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:48:27.269232 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:48:27.269232 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:48:27.269232 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:48:27.270507 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:48:27.270507 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:48:27.270507 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:48:27.270507 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:48:27.270507 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:48:27.270507 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:48:27.270507 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:48:27.270507 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:48:27.270507 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:48:27.270507 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:48:27.270507 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:48:27.270507 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:48:27.270507 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:48:27.270507 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:48:27.270507 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:48:27.270507 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:48:27.270507 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:48:27.271947 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:48:27.271947 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:48:27.271947 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:48:27.271947 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:48:27.271947 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 595/1203] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:48:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:48:27.278130 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca2df5-b1a4-4b08-a1e6-2c91ae4a9ab4 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:27.413315 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca2df5-b1a4-4b08-a1e6-2c91ae4a9ab4 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:27.451775 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:27.459639 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c27091-4a89-4504-849b-e9a7abb80ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:27.460372 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c27091-4a89-4504-849b-e9a7abb80ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:27.460766 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c27091-4a89-4504-849b-e9a7abb80ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:27.461165 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c27091-4a89-4504-849b-e9a7abb80ad8 None admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:27.461985 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c27091-4a89-4504-849b-e9a7abb80ad8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:48:27.462320 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c27091-4a89-4504-849b-e9a7abb80ad8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:27.464009 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c27091-4a89-4504-849b-e9a7abb80ad8 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:27.477226 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 609/1204] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:48:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:48:27.483890 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de18f9d-6e96-49bd-a0ad-b6d5884322c8 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:27.550428 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:27.630042 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de18f9d-6e96-49bd-a0ad-b6d5884322c8 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:27.683558 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a9e09-9584-453b-8780-76d542c98124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:27.683558 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a9e09-9584-453b-8780-76d542c98124 None admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:27.683558 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a9e09-9584-453b-8780-76d542c98124 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:27.683558 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a9e09-9584-453b-8780-76d542c98124 None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:27.684075 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a9e09-9584-453b-8780-76d542c98124 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:27.684158 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a9e09-9584-453b-8780-76d542c98124 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:27.720129 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 596/1205] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Jun 3 11:48:27 2022] POST /identity/v3/users => generated 251 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 11:48:30.222177 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f7af8-9c97-4f7e-9a2a-679becf56769 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:30.222712 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f7af8-9c97-4f7e-9a2a-679becf56769 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:30.222712 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f7af8-9c97-4f7e-9a2a-679becf56769 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:30.224100 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 610/1206] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:48:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:48:30.230062 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955d650-5d47-4be2-b2e2-a43ea40f7721 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:30.230530 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955d650-5d47-4be2-b2e2-a43ea40f7721 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:30.230774 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955d650-5d47-4be2-b2e2-a43ea40f7721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:30.250460 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-b955d650-5d47-4be2-b2e2-a43ea40f7721 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:48:30.251673 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-b955d650-5d47-4be2-b2e2-a43ea40f7721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:48:30.336187 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 597/1207] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:48:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:48:30.361960 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f7af8-9c97-4f7e-9a2a-679becf56769 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:30.492014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f7af8-9c97-4f7e-9a2a-679becf56769 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:30.526287 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d3797-fe61-40dc-8d18-c74e6daf9a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:30.527088 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d3797-fe61-40dc-8d18-c74e6daf9a17 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:30.527664 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d3797-fe61-40dc-8d18-c74e6daf9a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:30.527942 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d3797-fe61-40dc-8d18-c74e6daf9a17 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:30.539737 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d3797-fe61-40dc-8d18-c74e6daf9a17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:48:30.547987 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-179d3797-fe61-40dc-8d18-c74e6daf9a17 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 11:48:30.547987 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:48:30.547987 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:48:30.547987 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:48:30.547987 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:48:30.547987 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:48:30.547987 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:48:30.547987 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:48:30.547987 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:48:30.547987 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:48:30.547987 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:48:30.547987 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:48:30.547987 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:48:30.547987 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:48:30.547987 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:48:30.547987 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:48:30.548953 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:48:30.548953 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:48:30.548953 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:48:30.548953 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:48:30.548953 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:48:30.548953 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:48:30.548953 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:48:30.548953 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:48:30.548953 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:48:30.548953 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:48:30.548953 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:48:30.548953 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:48:30.548953 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:48:30.548953 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:48:30.548953 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:48:30.548953 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:48:30.549970 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:48:30.549970 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:48:30.549970 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:48:30.549970 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:48:30.549970 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:48:30.549970 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:48:30.549970 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:48:30.549970 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:48:30.549970 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:48:30.549970 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:48:30.549970 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 11:48:30.549970 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:48:30.549970 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 611/1208] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Jun 3 11:48:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:48:30.555345 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955d650-5d47-4be2-b2e2-a43ea40f7721 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:30.602825 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:30.672431 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955d650-5d47-4be2-b2e2-a43ea40f7721 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:30.709347 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c507d9-7522-4be2-9cf5-26e7b39d952a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:30.710073 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c507d9-7522-4be2-9cf5-26e7b39d952a None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:30.710358 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c507d9-7522-4be2-9cf5-26e7b39d952a None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:30.710654 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c507d9-7522-4be2-9cf5-26e7b39d952a None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:30.711484 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c507d9-7522-4be2-9cf5-26e7b39d952a None admin] RBAC: Adding query filter params (name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:48:30.711892 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c507d9-7522-4be2-9cf5-26e7b39d952a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:30.713281 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c507d9-7522-4be2-9cf5-26e7b39d952a None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:30.723986 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 598/1209] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Jun 3 11:48:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:48:30.730399 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d3797-fe61-40dc-8d18-c74e6daf9a17 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:30.787330 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:30.848507 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d3797-fe61-40dc-8d18-c74e6daf9a17 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:30.897568 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50506e86-1627-4d14-a6b0-f417c786622f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:30.897568 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50506e86-1627-4d14-a6b0-f417c786622f None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:30.897890 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50506e86-1627-4d14-a6b0-f417c786622f None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:30.898126 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50506e86-1627-4d14-a6b0-f417c786622f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:30.910465 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50506e86-1627-4d14-a6b0-f417c786622f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:30.912034 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50506e86-1627-4d14-a6b0-f417c786622f None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:30.930595 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-50506e86-1627-4d14-a6b0-f417c786622f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:48:30.930595 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:48:30.930595 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:48:30.930595 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:48:30.930595 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:48:30.930595 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:48:30.930595 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:48:30.930595 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:48:30.930595 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:48:30.930595 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:48:30.930595 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:48:30.930595 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:48:30.930595 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:48:30.930595 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:48:30.930595 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:48:30.931899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:48:30.931899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:48:30.931899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:48:30.931899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:48:30.931899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:48:30.931899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:48:30.931899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:48:30.931899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:48:30.931899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:48:30.931899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:48:30.931899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:48:30.931899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:48:30.931899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:48:30.931899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:48:30.931899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:48:30.931899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:48:30.931899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:48:30.933375 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:48:30.933375 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:48:30.933375 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:48:30.933375 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:48:30.933375 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 612/1210] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:48:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:48:30.937818 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c507d9-7522-4be2-9cf5-26e7b39d952a None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:31.056200 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:31.059631 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c507d9-7522-4be2-9cf5-26e7b39d952a None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:31.105550 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee53cf36-94ca-42e7-8d34-afe5b0c72027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:31.106388 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53cf36-94ca-42e7-8d34-afe5b0c72027 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:31.106631 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53cf36-94ca-42e7-8d34-afe5b0c72027 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:31.106944 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53cf36-94ca-42e7-8d34-afe5b0c72027 None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:31.107835 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee53cf36-94ca-42e7-8d34-afe5b0c72027 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:48:31.108151 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee53cf36-94ca-42e7-8d34-afe5b0c72027 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:31.109509 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee53cf36-94ca-42e7-8d34-afe5b0c72027 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:31.121867 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 599/1211] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:48:31.127606 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50506e86-1627-4d14-a6b0-f417c786622f None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:31.244373 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50506e86-1627-4d14-a6b0-f417c786622f None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:31.246142 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:31.285262 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af800ce6-a066-4b47-8bdf-b53aa1a68091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:31.286073 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af800ce6-a066-4b47-8bdf-b53aa1a68091 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:31.286418 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af800ce6-a066-4b47-8bdf-b53aa1a68091 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:31.286633 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af800ce6-a066-4b47-8bdf-b53aa1a68091 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:31.300657 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af800ce6-a066-4b47-8bdf-b53aa1a68091 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:31.302529 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af800ce6-a066-4b47-8bdf-b53aa1a68091 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:31.320437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-af800ce6-a066-4b47-8bdf-b53aa1a68091 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 03 11:48:31.320437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:48:31.320437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:48:31.320437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:48:31.320437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:48:31.320437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:48:31.320437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:48:31.320437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:48:31.320437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:48:31.320437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:48:31.320437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:48:31.320437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:48:31.320437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 11:48:31.320437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 11:48:31.320437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 11:48:31.320437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 11:48:31.321625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:48:31.321625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:48:31.321625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 11:48:31.321625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:48:31.321625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 11:48:31.321625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:48:31.321625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:48:31.321625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:48:31.321625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:48:31.321625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:48:31.321625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:48:31.321625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:48:31.321625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:48:31.321625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:48:31.321625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:48:31.321625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:48:31.321625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:48:31.321625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:48:31.322844 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:48:31.322844 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:48:31.322844 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 11:48:31.322844 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 11:48:31.322844 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 11:48:31.322844 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 11:48:31.322844 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 11:48:31.322844 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 11:48:31.322844 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 03 11:48:31.322844 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:48:31.322844 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 613/1212] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:48:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:48:31.328294 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee53cf36-94ca-42e7-8d34-afe5b0c72027 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:31.447848 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee53cf36-94ca-42e7-8d34-afe5b0c72027 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:31.486281 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540254e8-5987-4a9f-ad51-bfe34c2a3d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:31.487337 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540254e8-5987-4a9f-ad51-bfe34c2a3d08 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:31.487337 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540254e8-5987-4a9f-ad51-bfe34c2a3d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:31.487557 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540254e8-5987-4a9f-ad51-bfe34c2a3d08 None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:31.488528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540254e8-5987-4a9f-ad51-bfe34c2a3d08 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:48:31.488813 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540254e8-5987-4a9f-ad51-bfe34c2a3d08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:31.490252 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540254e8-5987-4a9f-ad51-bfe34c2a3d08 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:31.514752 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 600/1213] 10.222.0.15 () {56 vars in 1143 bytes} [Fri Jun 3 11:48:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:48:31.520830 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af800ce6-a066-4b47-8bdf-b53aa1a68091 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:31.639203 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af800ce6-a066-4b47-8bdf-b53aa1a68091 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:31.680785 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2077ac2-359f-4e8b-b3b6-c4b9d2fb4946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:31.682054 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2077ac2-359f-4e8b-b3b6-c4b9d2fb4946 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:31.682054 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2077ac2-359f-4e8b-b3b6-c4b9d2fb4946 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:31.682286 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2077ac2-359f-4e8b-b3b6-c4b9d2fb4946 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:31.721321 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:31.782762 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2077ac2-359f-4e8b-b3b6-c4b9d2fb4946 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:31.784502 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2077ac2-359f-4e8b-b3b6-c4b9d2fb4946 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:31.927417 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 614/1214] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:48:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 03 11:48:31.928867 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540254e8-5987-4a9f-ad51-bfe34c2a3d08 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:31.949757 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:32.053108 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540254e8-5987-4a9f-ad51-bfe34c2a3d08 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:32.088836 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808fba12-1fec-474b-980b-ad59ccc84aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:32.089836 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808fba12-1fec-474b-980b-ad59ccc84aff None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:32.090239 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808fba12-1fec-474b-980b-ad59ccc84aff None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:32.090584 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808fba12-1fec-474b-980b-ad59ccc84aff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:32.102611 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808fba12-1fec-474b-980b-ad59ccc84aff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:32.104116 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808fba12-1fec-474b-980b-ad59ccc84aff None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:32.124679 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-808fba12-1fec-474b-980b-ad59ccc84aff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:48:32.124679 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:48:32.124679 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:48:32.124679 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:48:32.124679 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:48:32.124679 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:48:32.124679 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:48:32.124679 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:48:32.124679 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:48:32.124679 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:48:32.124679 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:48:32.124679 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:48:32.124679 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:48:32.124679 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:48:32.124679 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:48:32.125764 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:48:32.125764 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:48:32.125764 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:48:32.125764 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:48:32.125764 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:48:32.125764 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:48:32.125764 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:48:32.125764 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:48:32.125764 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:48:32.125764 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:48:32.125764 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:48:32.125764 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:48:32.125764 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:48:32.125764 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:48:32.125764 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:48:32.125764 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:48:32.125764 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:48:32.128451 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:48:32.128451 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:48:32.128451 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:48:32.128451 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:48:32.128451 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 601/1215] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:48:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:48:32.131818 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2077ac2-359f-4e8b-b3b6-c4b9d2fb4946 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:32.198354 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:32.238921 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2077ac2-359f-4e8b-b3b6-c4b9d2fb4946 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:32.276327 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce21d3-833b-4ee2-9cc3-921cb805f7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:32.277004 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce21d3-833b-4ee2-9cc3-921cb805f7aa None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:32.279009 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce21d3-833b-4ee2-9cc3-921cb805f7aa None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:32.279009 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce21d3-833b-4ee2-9cc3-921cb805f7aa None admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:32.279945 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce21d3-833b-4ee2-9cc3-921cb805f7aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:48:32.280275 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce21d3-833b-4ee2-9cc3-921cb805f7aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:32.281649 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce21d3-833b-4ee2-9cc3-921cb805f7aa None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:32.293462 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 615/1216] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:48:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:48:32.299325 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808fba12-1fec-474b-980b-ad59ccc84aff None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:32.384109 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:32.418164 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808fba12-1fec-474b-980b-ad59ccc84aff None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:32.458481 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd379ac7-f4cf-4e14-99b3-b00fa3d980f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:32.458481 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd379ac7-f4cf-4e14-99b3-b00fa3d980f8 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:32.458765 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd379ac7-f4cf-4e14-99b3-b00fa3d980f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:32.458912 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd379ac7-f4cf-4e14-99b3-b00fa3d980f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:32.465768 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd379ac7-f4cf-4e14-99b3-b00fa3d980f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:32.467746 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd379ac7-f4cf-4e14-99b3-b00fa3d980f8 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:32.481589 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-dd379ac7-f4cf-4e14-99b3-b00fa3d980f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:48:32.481589 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:48:32.481589 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:48:32.481589 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:48:32.481589 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:48:32.481589 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:48:32.481589 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:48:32.481589 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:48:32.481589 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:48:32.481589 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:48:32.481589 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:48:32.481589 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:48:32.481589 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 11:48:32.481589 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 11:48:32.481589 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 11:48:32.482656 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 11:48:32.482656 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:48:32.482656 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:48:32.482656 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:48:32.482656 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:48:32.482656 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:48:32.482656 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:48:32.482656 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:48:32.482656 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:48:32.482656 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:48:32.482656 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:48:32.482656 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:48:32.482656 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:48:32.482656 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:48:32.482656 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:48:32.482656 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:48:32.482656 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:48:32.483606 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 11:48:32.483606 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 11:48:32.483606 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 11:48:32.483606 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 11:48:32.483606 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 11:48:32.483606 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 11:48:32.483606 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:48:32.483606 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:48:32.483606 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 602/1217] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:48:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:48:32.488638 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce21d3-833b-4ee2-9cc3-921cb805f7aa None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:32.600260 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce21d3-833b-4ee2-9cc3-921cb805f7aa None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:32.624828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:32.638494 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa35c83-21e4-4055-87be-33410142607e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:32.639409 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa35c83-21e4-4055-87be-33410142607e None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:32.639813 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa35c83-21e4-4055-87be-33410142607e None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:32.640312 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa35c83-21e4-4055-87be-33410142607e None admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:32.641337 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa35c83-21e4-4055-87be-33410142607e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:48:32.641755 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa35c83-21e4-4055-87be-33410142607e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:32.643518 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa35c83-21e4-4055-87be-33410142607e None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:32.663228 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 616/1218] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 3 11:48:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:48:32.664352 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd379ac7-f4cf-4e14-99b3-b00fa3d980f8 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:32.781792 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd379ac7-f4cf-4e14-99b3-b00fa3d980f8 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:32.815735 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:32.822709 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e676e5ac-22ae-4715-9ec0-0ee7f7f851e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:32.823406 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676e5ac-22ae-4715-9ec0-0ee7f7f851e3 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:32.823722 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676e5ac-22ae-4715-9ec0-0ee7f7f851e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:32.824010 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676e5ac-22ae-4715-9ec0-0ee7f7f851e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:32.824850 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e676e5ac-22ae-4715-9ec0-0ee7f7f851e3 None admin] RBAC: Adding query filter params (role.id=41158ae54c7a437284af718034e9b354, scope.project.id=cff223ee05524cf4bf3591fc5a39559e, user.id=eb5a91437dd64e2491ce41b4d12d4835) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:48:32.825191 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e676e5ac-22ae-4715-9ec0-0ee7f7f851e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:32.826650 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e676e5ac-22ae-4715-9ec0-0ee7f7f851e3 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:32.837621 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 603/1219] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:48:32 2022] GET /identity/v3/role_assignments?user.id=eb5a91437dd64e2491ce41b4d12d4835&scope.project.id=cff223ee05524cf4bf3591fc5a39559e&role.id=41158ae54c7a437284af718034e9b354 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:48:35.188190 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa554a-61d7-49b9-a65c-36f654059697 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:35.188725 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa554a-61d7-49b9-a65c-36f654059697 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:35.188725 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa554a-61d7-49b9-a65c-36f654059697 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:35.190181 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 617/1220] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:48:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:48:35.195452 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadabb09-f369-47cb-8159-356d898fdb2d None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:35.195931 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadabb09-f369-47cb-8159-356d898fdb2d None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:35.196132 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadabb09-f369-47cb-8159-356d898fdb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:35.213375 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-cadabb09-f369-47cb-8159-356d898fdb2d None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:48:35.214593 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-cadabb09-f369-47cb-8159-356d898fdb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:48:35.290299 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 604/1221] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:48:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:48:35.313671 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa554a-61d7-49b9-a65c-36f654059697 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:35.425778 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa554a-61d7-49b9-a65c-36f654059697 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:35.461454 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e167b90-1a96-4a65-8063-e02eec025016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:35.462171 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e167b90-1a96-4a65-8063-e02eec025016 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:35.462469 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e167b90-1a96-4a65-8063-e02eec025016 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:35.462749 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e167b90-1a96-4a65-8063-e02eec025016 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:35.475471 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e167b90-1a96-4a65-8063-e02eec025016 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:48:35.484101 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-5e167b90-1a96-4a65-8063-e02eec025016 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 11:48:35.484101 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:48:35.484101 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:48:35.484101 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:48:35.484101 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:48:35.484101 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:48:35.484101 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:48:35.484101 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:48:35.484101 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:48:35.484101 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:48:35.484101 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:48:35.484101 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:48:35.484101 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:48:35.484101 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:48:35.484101 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:48:35.484101 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:48:35.485129 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:48:35.485129 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:48:35.485129 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:48:35.485129 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:48:35.485129 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:48:35.485129 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:48:35.485129 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:48:35.485129 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:48:35.485129 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:48:35.485129 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:48:35.485129 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:48:35.485129 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:48:35.485129 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:48:35.485129 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:48:35.485129 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:48:35.485129 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:48:35.485972 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:48:35.485972 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:48:35.485972 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:48:35.485972 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:48:35.485972 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:48:35.485972 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:48:35.485972 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:48:35.485972 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:48:35.485972 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:48:35.485972 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:48:35.485972 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 11:48:35.485972 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:48:35.490383 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 618/1222] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Jun 3 11:48:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:48:35.491271 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadabb09-f369-47cb-8159-356d898fdb2d None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:35.599848 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadabb09-f369-47cb-8159-356d898fdb2d None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:35.627144 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:35.639310 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b672cc-1ab0-49f1-bc8e-43e70a0ce3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:35.640037 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b672cc-1ab0-49f1-bc8e-43e70a0ce3a7 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:35.640323 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b672cc-1ab0-49f1-bc8e-43e70a0ce3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:35.640600 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b672cc-1ab0-49f1-bc8e-43e70a0ce3a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:35.641353 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b672cc-1ab0-49f1-bc8e-43e70a0ce3a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:48:35.641658 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b672cc-1ab0-49f1-bc8e-43e70a0ce3a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:35.643034 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b672cc-1ab0-49f1-bc8e-43e70a0ce3a7 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:35.651866 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 605/1223] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Jun 3 11:48:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:48:35.657791 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e167b90-1a96-4a65-8063-e02eec025016 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:35.707602 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:35.772386 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e167b90-1a96-4a65-8063-e02eec025016 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:35.810156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98336b9-f8e5-47ac-9e0c-3de6ef75297f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:35.810938 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98336b9-f8e5-47ac-9e0c-3de6ef75297f None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:35.811226 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98336b9-f8e5-47ac-9e0c-3de6ef75297f None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:35.811525 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98336b9-f8e5-47ac-9e0c-3de6ef75297f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:35.823008 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98336b9-f8e5-47ac-9e0c-3de6ef75297f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:35.824564 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98336b9-f8e5-47ac-9e0c-3de6ef75297f None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:35.843716 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-a98336b9-f8e5-47ac-9e0c-3de6ef75297f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:48:35.843716 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:48:35.843716 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:48:35.843716 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:48:35.843716 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:48:35.843716 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:48:35.843716 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:48:35.843716 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:48:35.843716 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:48:35.843716 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:48:35.843716 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:48:35.843716 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:48:35.843716 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:48:35.843716 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:48:35.843716 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:48:35.844908 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:48:35.844908 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:48:35.844908 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:48:35.844908 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:48:35.844908 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:48:35.844908 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:48:35.844908 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:48:35.844908 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:48:35.844908 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:48:35.844908 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:48:35.844908 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:48:35.844908 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:48:35.844908 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:48:35.844908 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:48:35.844908 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:48:35.844908 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:48:35.844908 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:48:35.845834 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:48:35.845834 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:48:35.845834 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:48:35.845834 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:48:35.845834 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 619/1224] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:48:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:48:35.850990 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b672cc-1ab0-49f1-bc8e-43e70a0ce3a7 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:35.963586 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b672cc-1ab0-49f1-bc8e-43e70a0ce3a7 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:36.002910 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19731907-38d7-43d9-9eeb-af8b537ce5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:36.003691 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19731907-38d7-43d9-9eeb-af8b537ce5a5 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:36.003949 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19731907-38d7-43d9-9eeb-af8b537ce5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:36.004237 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19731907-38d7-43d9-9eeb-af8b537ce5a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:36.005044 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19731907-38d7-43d9-9eeb-af8b537ce5a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:48:36.005343 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19731907-38d7-43d9-9eeb-af8b537ce5a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:36.006883 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19731907-38d7-43d9-9eeb-af8b537ce5a5 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:36.022190 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 606/1225] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:48:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:48:36.028489 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98336b9-f8e5-47ac-9e0c-3de6ef75297f None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:36.134222 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:36.141653 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98336b9-f8e5-47ac-9e0c-3de6ef75297f None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:36.177029 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d2e723-4a1c-45f6-b9d5-352a9d702627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:36.177884 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2e723-4a1c-45f6-b9d5-352a9d702627 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:36.178169 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2e723-4a1c-45f6-b9d5-352a9d702627 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:36.178495 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2e723-4a1c-45f6-b9d5-352a9d702627 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:36.186953 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d2e723-4a1c-45f6-b9d5-352a9d702627 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:36.188433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d2e723-4a1c-45f6-b9d5-352a9d702627 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:36.202819 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-f6d2e723-4a1c-45f6-b9d5-352a9d702627 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 03 11:48:36.202819 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:48:36.202819 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:48:36.202819 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:48:36.202819 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:48:36.202819 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:48:36.202819 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:48:36.202819 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:48:36.202819 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:48:36.202819 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:48:36.202819 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:48:36.202819 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:48:36.202819 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 11:48:36.202819 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 11:48:36.202819 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 11:48:36.202819 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 11:48:36.203954 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:48:36.203954 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:48:36.203954 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 11:48:36.203954 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:48:36.203954 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 11:48:36.203954 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:48:36.203954 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:48:36.203954 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:48:36.203954 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:48:36.203954 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:48:36.203954 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:48:36.203954 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:48:36.203954 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:48:36.203954 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:48:36.203954 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:48:36.203954 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:48:36.203954 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:48:36.203954 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:48:36.204915 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:48:36.204915 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:48:36.204915 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 11:48:36.204915 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 11:48:36.204915 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 11:48:36.204915 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 11:48:36.204915 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 11:48:36.204915 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 11:48:36.204915 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 03 11:48:36.204915 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:48:36.204915 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 620/1226] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:48:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:48:36.210139 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19731907-38d7-43d9-9eeb-af8b537ce5a5 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:36.260370 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:36.320260 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19731907-38d7-43d9-9eeb-af8b537ce5a5 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:36.358811 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea9560-3c86-474a-8379-3959577e30ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:36.359548 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea9560-3c86-474a-8379-3959577e30ba None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:36.359841 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea9560-3c86-474a-8379-3959577e30ba None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:36.360134 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea9560-3c86-474a-8379-3959577e30ba None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:36.361059 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea9560-3c86-474a-8379-3959577e30ba None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:48:36.361411 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea9560-3c86-474a-8379-3959577e30ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:36.362907 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea9560-3c86-474a-8379-3959577e30ba None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:36.382365 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 607/1227] 10.222.0.15 () {56 vars in 1143 bytes} [Fri Jun 3 11:48:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:48:36.388740 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d2e723-4a1c-45f6-b9d5-352a9d702627 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:36.493142 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d2e723-4a1c-45f6-b9d5-352a9d702627 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:36.527675 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c46c4-2240-4fcf-9293-06f1528381c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:36.529008 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c46c4-2240-4fcf-9293-06f1528381c3 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:36.529293 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c46c4-2240-4fcf-9293-06f1528381c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:36.529567 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c46c4-2240-4fcf-9293-06f1528381c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:36.540502 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09c46c4-2240-4fcf-9293-06f1528381c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:36.541956 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09c46c4-2240-4fcf-9293-06f1528381c3 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:36.567307 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-e09c46c4-2240-4fcf-9293-06f1528381c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:48:36.567307 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:48:36.567307 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:48:36.567307 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:48:36.567307 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:48:36.567307 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:48:36.567307 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:48:36.567307 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:48:36.567307 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:48:36.567307 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:48:36.567307 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:48:36.567307 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:48:36.567307 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:48:36.567307 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:48:36.567307 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:48:36.568496 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:48:36.568496 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:48:36.568496 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:48:36.568496 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:48:36.568496 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:48:36.568496 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:48:36.568496 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:48:36.568496 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:48:36.568496 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:48:36.568496 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:48:36.568496 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:48:36.568496 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:48:36.568496 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:48:36.568496 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:48:36.568496 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:48:36.568496 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:48:36.568496 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:48:36.569580 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:48:36.569580 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:48:36.569580 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:48:36.569580 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:48:36.569580 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 621/1228] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:48:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:48:36.574544 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea9560-3c86-474a-8379-3959577e30ba None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:36.679741 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea9560-3c86-474a-8379-3959577e30ba None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:36.682099 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:36.723428 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982d0a6-ec89-4d93-b3e9-16c48163e3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:36.724129 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982d0a6-ec89-4d93-b3e9-16c48163e3db None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:36.724414 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982d0a6-ec89-4d93-b3e9-16c48163e3db None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:36.724689 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982d0a6-ec89-4d93-b3e9-16c48163e3db None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:36.725406 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9982d0a6-ec89-4d93-b3e9-16c48163e3db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:48:36.725711 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9982d0a6-ec89-4d93-b3e9-16c48163e3db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:36.727217 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9982d0a6-ec89-4d93-b3e9-16c48163e3db None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:36.741018 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 608/1229] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:48:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:48:36.746772 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c46c4-2240-4fcf-9293-06f1528381c3 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:36.756888 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:36.860526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c46c4-2240-4fcf-9293-06f1528381c3 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:36.895889 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293b931-2e9f-4a91-bc00-79fc0a752354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:36.896692 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293b931-2e9f-4a91-bc00-79fc0a752354 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:36.896982 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293b931-2e9f-4a91-bc00-79fc0a752354 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:36.897256 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293b931-2e9f-4a91-bc00-79fc0a752354 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:36.905234 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d293b931-2e9f-4a91-bc00-79fc0a752354 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:36.906691 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d293b931-2e9f-4a91-bc00-79fc0a752354 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:36.921886 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-d293b931-2e9f-4a91-bc00-79fc0a752354 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:48:36.921886 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:48:36.921886 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:48:36.921886 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:48:36.921886 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:48:36.921886 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:48:36.921886 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:48:36.921886 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:48:36.921886 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:48:36.921886 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:48:36.921886 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:48:36.921886 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:48:36.921886 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 11:48:36.921886 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 11:48:36.921886 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 11:48:36.922994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 11:48:36.922994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:48:36.922994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:48:36.922994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:48:36.922994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:48:36.922994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:48:36.922994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:48:36.922994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:48:36.922994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:48:36.922994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:48:36.922994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:48:36.922994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:48:36.922994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:48:36.922994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:48:36.922994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:48:36.922994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:48:36.922994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:48:36.924506 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 11:48:36.924506 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 11:48:36.924506 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 11:48:36.924506 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 11:48:36.924506 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 11:48:36.924506 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 11:48:36.924506 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:48:36.924506 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:48:36.924506 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 622/1230] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:48:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:48:36.929796 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982d0a6-ec89-4d93-b3e9-16c48163e3db None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:37.045007 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982d0a6-ec89-4d93-b3e9-16c48163e3db None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:37.081418 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24034e4-9cc2-4a2c-bd1d-b24f6c25d99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:37.082066 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24034e4-9cc2-4a2c-bd1d-b24f6c25d99d None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:37.082351 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24034e4-9cc2-4a2c-bd1d-b24f6c25d99d None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:37.082624 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24034e4-9cc2-4a2c-bd1d-b24f6c25d99d None admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:37.083392 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24034e4-9cc2-4a2c-bd1d-b24f6c25d99d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:48:37.083729 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24034e4-9cc2-4a2c-bd1d-b24f6c25d99d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:37.085467 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24034e4-9cc2-4a2c-bd1d-b24f6c25d99d None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:37.224225 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 609/1231] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 3 11:48:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:48:37.230338 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293b931-2e9f-4a91-bc00-79fc0a752354 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:37.303130 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:37.342889 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293b931-2e9f-4a91-bc00-79fc0a752354 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:37.381906 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e898ad7-f6aa-4f1a-83d1-a662d2954bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:37.382913 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e898ad7-f6aa-4f1a-83d1-a662d2954bdd None admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:37.383278 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e898ad7-f6aa-4f1a-83d1-a662d2954bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:37.383669 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e898ad7-f6aa-4f1a-83d1-a662d2954bdd None admin] PATH_INFO: `/v3/projects/cff223ee05524cf4bf3591fc5a39559e/users/eb5a91437dd64e2491ce41b4d12d4835/roles/41158ae54c7a437284af718034e9b354` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:37.401844 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e898ad7-f6aa-4f1a-83d1-a662d2954bdd None admin] RBAC: Authorizing `identity:create_grant(project_id=cff223ee05524cf4bf3591fc5a39559e, user_id=eb5a91437dd64e2491ce41b4d12d4835, role_id=41158ae54c7a437284af718034e9b354)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:37.403756 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e898ad7-f6aa-4f1a-83d1-a662d2954bdd None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:37.417396 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 623/1232] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Jun 3 11:48:37 2022] PUT /identity/v3/projects/cff223ee05524cf4bf3591fc5a39559e/users/eb5a91437dd64e2491ce41b4d12d4835/roles/41158ae54c7a437284af718034e9b354 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:48:39.954164 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966fd01-0f98-4a6c-90ab-2be94c3a9195 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:39.954780 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966fd01-0f98-4a6c-90ab-2be94c3a9195 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:39.954780 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966fd01-0f98-4a6c-90ab-2be94c3a9195 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:39.956100 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 610/1233] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:48:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:48:39.961480 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53eb5f-1757-49e7-a38d-6c105ea15a33 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:39.961896 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53eb5f-1757-49e7-a38d-6c105ea15a33 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:39.962057 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53eb5f-1757-49e7-a38d-6c105ea15a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:39.978493 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-3d53eb5f-1757-49e7-a38d-6c105ea15a33 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:48:39.979730 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-3d53eb5f-1757-49e7-a38d-6c105ea15a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:48:40.052476 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 624/1234] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:48:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:48:40.076538 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966fd01-0f98-4a6c-90ab-2be94c3a9195 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:40.105923 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:40.187523 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966fd01-0f98-4a6c-90ab-2be94c3a9195 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:40.223874 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fdcfc-547c-4188-9979-1ab180eddcec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:40.224656 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fdcfc-547c-4188-9979-1ab180eddcec None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:40.224947 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fdcfc-547c-4188-9979-1ab180eddcec None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:40.225223 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fdcfc-547c-4188-9979-1ab180eddcec None admin] PATH_INFO: `/v3/roles/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:40.236511 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3fdcfc-547c-4188-9979-1ab180eddcec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:48:40.244804 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-1c3fdcfc-547c-4188-9979-1ab180eddcec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 03 11:48:40.244804 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:48:40.244804 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:48:40.244804 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:48:40.244804 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:48:40.244804 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:48:40.244804 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:48:40.244804 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:48:40.244804 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:48:40.244804 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:48:40.244804 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:48:40.244804 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:48:40.244804 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:48:40.244804 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:48:40.244804 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:48:40.244804 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:48:40.245853 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:48:40.245853 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:48:40.245853 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:48:40.245853 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:48:40.245853 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:48:40.245853 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:48:40.245853 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:48:40.245853 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:48:40.245853 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:48:40.245853 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:48:40.245853 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:48:40.245853 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:48:40.245853 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:48:40.245853 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:48:40.245853 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:48:40.245853 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:48:40.247191 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:48:40.247191 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:48:40.247191 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:48:40.247191 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:48:40.247191 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:48:40.247191 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:48:40.247191 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:48:40.247191 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:48:40.247191 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:48:40.247191 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:48:40.247191 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 03 11:48:40.247191 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:48:40.247191 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 611/1235] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Jun 3 11:48:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:48:40.252300 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53eb5f-1757-49e7-a38d-6c105ea15a33 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:40.303369 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:40.359139 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53eb5f-1757-49e7-a38d-6c105ea15a33 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:40.396697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742bf76-e6c0-4707-8d32-33e3b01d25b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:40.397728 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742bf76-e6c0-4707-8d32-33e3b01d25b4 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:40.398052 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742bf76-e6c0-4707-8d32-33e3b01d25b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:40.398332 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742bf76-e6c0-4707-8d32-33e3b01d25b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:40.399169 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3742bf76-e6c0-4707-8d32-33e3b01d25b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:48:40.399528 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3742bf76-e6c0-4707-8d32-33e3b01d25b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:40.401091 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3742bf76-e6c0-4707-8d32-33e3b01d25b4 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:40.411027 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 625/1236] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Jun 3 11:48:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:48:40.416978 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fdcfc-547c-4188-9979-1ab180eddcec None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:40.504432 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:40.521482 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fdcfc-547c-4188-9979-1ab180eddcec None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:40.560173 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e8fd0-7367-4196-a61a-97959b09ed2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:40.560961 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e8fd0-7367-4196-a61a-97959b09ed2a None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:40.561283 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e8fd0-7367-4196-a61a-97959b09ed2a None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:40.561556 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e8fd0-7367-4196-a61a-97959b09ed2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:40.572129 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e8fd0-7367-4196-a61a-97959b09ed2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:40.573887 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e8fd0-7367-4196-a61a-97959b09ed2a None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:40.595386 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-b19e8fd0-7367-4196-a61a-97959b09ed2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:48:40.595386 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:48:40.595386 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:48:40.595386 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:48:40.595386 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:48:40.595386 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:48:40.595386 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:48:40.595386 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:48:40.595386 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:48:40.595386 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:48:40.595386 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:48:40.595386 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:48:40.595386 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:48:40.595386 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:48:40.595386 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:48:40.596505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:48:40.596505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:48:40.596505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:48:40.596505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:48:40.596505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:48:40.596505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:48:40.596505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:48:40.596505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:48:40.596505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:48:40.596505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:48:40.596505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:48:40.596505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:48:40.596505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:48:40.596505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:48:40.596505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:48:40.596505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:48:40.596505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:48:40.597422 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:48:40.597422 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:48:40.597422 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:48:40.597422 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:48:40.597422 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 612/1237] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:48:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:48:40.603045 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742bf76-e6c0-4707-8d32-33e3b01d25b4 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:40.713976 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742bf76-e6c0-4707-8d32-33e3b01d25b4 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:40.726166 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:40.757021 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1f92a-121a-4d15-8278-46116d3730a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:40.758143 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1f92a-121a-4d15-8278-46116d3730a0 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:40.758528 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1f92a-121a-4d15-8278-46116d3730a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:40.758960 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1f92a-121a-4d15-8278-46116d3730a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:40.760674 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e1f92a-121a-4d15-8278-46116d3730a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:48:40.761125 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e1f92a-121a-4d15-8278-46116d3730a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:40.763537 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e1f92a-121a-4d15-8278-46116d3730a0 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:40.776244 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 626/1238] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:48:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:48:40.783105 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e8fd0-7367-4196-a61a-97959b09ed2a None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:40.892987 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e8fd0-7367-4196-a61a-97959b09ed2a None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:40.929843 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb48ec4f-7ac6-4c39-9774-c2a38ba87595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:40.930638 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48ec4f-7ac6-4c39-9774-c2a38ba87595 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:40.930917 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48ec4f-7ac6-4c39-9774-c2a38ba87595 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:40.931185 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48ec4f-7ac6-4c39-9774-c2a38ba87595 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:40.934096 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:40.939461 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb48ec4f-7ac6-4c39-9774-c2a38ba87595 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:40.941176 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb48ec4f-7ac6-4c39-9774-c2a38ba87595 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:40.955730 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-cb48ec4f-7ac6-4c39-9774-c2a38ba87595 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 03 11:48:40.955730 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:48:40.955730 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:48:40.955730 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:48:40.955730 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:48:40.955730 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:48:40.955730 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:48:40.955730 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:48:40.955730 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:48:40.955730 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:48:40.955730 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:48:40.955730 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:48:40.955730 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 11:48:40.955730 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 11:48:40.955730 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 11:48:40.955730 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 11:48:40.957299 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:48:40.957299 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:48:40.957299 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 11:48:40.957299 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:48:40.957299 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 11:48:40.957299 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:48:40.957299 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:48:40.957299 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:48:40.957299 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:48:40.957299 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:48:40.957299 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:48:40.957299 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:48:40.957299 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:48:40.957299 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:48:40.957299 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:48:40.957299 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:48:40.957299 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:48:40.957299 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:48:40.958254 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:48:40.958254 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:48:40.958254 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 11:48:40.958254 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 11:48:40.958254 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 11:48:40.958254 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 11:48:40.958254 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 11:48:40.958254 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 11:48:40.958254 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 03 11:48:40.958254 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:48:40.958254 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 613/1239] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:48:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:48:40.962963 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1f92a-121a-4d15-8278-46116d3730a0 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:41.071314 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1f92a-121a-4d15-8278-46116d3730a0 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:41.105834 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc9e31-5289-4238-8b9a-285c073a9c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:41.107146 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc9e31-5289-4238-8b9a-285c073a9c57 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:41.107429 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc9e31-5289-4238-8b9a-285c073a9c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:41.107731 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc9e31-5289-4238-8b9a-285c073a9c57 None admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:41.108568 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc9e31-5289-4238-8b9a-285c073a9c57 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:48:41.108879 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc9e31-5289-4238-8b9a-285c073a9c57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:41.110316 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc9e31-5289-4238-8b9a-285c073a9c57 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:41.127227 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 627/1240] 10.222.0.15 () {56 vars in 1143 bytes} [Fri Jun 3 11:48:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:48:41.132888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb48ec4f-7ac6-4c39-9774-c2a38ba87595 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:41.242125 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb48ec4f-7ac6-4c39-9774-c2a38ba87595 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:41.280234 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc439b-fa77-4c04-b4b3-5c867590c3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:41.280905 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc439b-fa77-4c04-b4b3-5c867590c3d2 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:41.281181 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc439b-fa77-4c04-b4b3-5c867590c3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:41.281448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc439b-fa77-4c04-b4b3-5c867590c3d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:41.346687 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:41.354451 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc439b-fa77-4c04-b4b3-5c867590c3d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:41.356799 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc439b-fa77-4c04-b4b3-5c867590c3d2 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:41.466546 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 614/1241] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:48:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 11:48:41.472455 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc9e31-5289-4238-8b9a-285c073a9c57 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:41.504222 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:41.585740 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc9e31-5289-4238-8b9a-285c073a9c57 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:41.628350 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8987e-efb2-4817-873e-667babfe3bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:41.629265 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8987e-efb2-4817-873e-667babfe3bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:41.629703 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8987e-efb2-4817-873e-667babfe3bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:41.629981 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8987e-efb2-4817-873e-667babfe3bb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:41.641462 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d8987e-efb2-4817-873e-667babfe3bb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:41.642909 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d8987e-efb2-4817-873e-667babfe3bb4 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:41.664315 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-40d8987e-efb2-4817-873e-667babfe3bb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:48:41.664315 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:48:41.664315 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:48:41.664315 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:48:41.664315 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:48:41.664315 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:48:41.664315 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:48:41.664315 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:48:41.664315 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:48:41.664315 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:48:41.664315 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:48:41.664315 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:48:41.664315 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:48:41.664315 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:48:41.664315 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:48:41.665433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:48:41.665433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:48:41.665433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:48:41.665433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:48:41.665433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:48:41.665433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:48:41.665433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:48:41.665433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:48:41.665433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:48:41.665433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:48:41.665433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:48:41.665433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:48:41.665433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:48:41.665433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:48:41.665433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:48:41.665433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:48:41.665433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:48:41.666561 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:48:41.666561 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:48:41.666561 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:48:41.666561 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:48:41.666561 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 628/1242] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:48:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:48:41.672814 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc439b-fa77-4c04-b4b3-5c867590c3d2 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:41.779966 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:41.787029 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc439b-fa77-4c04-b4b3-5c867590c3d2 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:41.822879 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97693dd5-b25e-43cc-a6db-06fd6c29a124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:41.823684 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97693dd5-b25e-43cc-a6db-06fd6c29a124 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:41.824046 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97693dd5-b25e-43cc-a6db-06fd6c29a124 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:41.824327 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97693dd5-b25e-43cc-a6db-06fd6c29a124 None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:41.825707 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97693dd5-b25e-43cc-a6db-06fd6c29a124 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:48:41.826065 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97693dd5-b25e-43cc-a6db-06fd6c29a124 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:41.827551 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97693dd5-b25e-43cc-a6db-06fd6c29a124 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:41.840934 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 615/1243] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:48:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:48:41.846622 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8987e-efb2-4817-873e-667babfe3bb4 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:41.944308 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:41.963530 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8987e-efb2-4817-873e-667babfe3bb4 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:42.000975 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc99cc-b6f4-4980-a425-5ab8b3548139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:42.001847 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc99cc-b6f4-4980-a425-5ab8b3548139 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:42.002127 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc99cc-b6f4-4980-a425-5ab8b3548139 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:42.002396 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc99cc-b6f4-4980-a425-5ab8b3548139 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:42.010475 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc99cc-b6f4-4980-a425-5ab8b3548139 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:42.012049 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc99cc-b6f4-4980-a425-5ab8b3548139 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:42.027804 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-2bcc99cc-b6f4-4980-a425-5ab8b3548139 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:48:42.027804 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:48:42.027804 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:48:42.027804 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:48:42.027804 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:48:42.027804 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:48:42.027804 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:48:42.027804 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:48:42.027804 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:48:42.027804 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:48:42.027804 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:48:42.027804 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:48:42.027804 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 11:48:42.027804 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 11:48:42.027804 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 11:48:42.029000 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 11:48:42.029000 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:48:42.029000 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:48:42.029000 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:48:42.029000 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:48:42.029000 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:48:42.029000 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:48:42.029000 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:48:42.029000 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:48:42.029000 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:48:42.029000 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:48:42.029000 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:48:42.029000 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:48:42.029000 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:48:42.029000 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:48:42.029000 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:48:42.029000 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:48:42.030183 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 11:48:42.030183 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 11:48:42.030183 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 11:48:42.030183 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 11:48:42.030183 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 11:48:42.030183 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 11:48:42.030183 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:48:42.030183 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:48:42.030183 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 629/1244] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:48:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:48:42.035281 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97693dd5-b25e-43cc-a6db-06fd6c29a124 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:42.141791 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97693dd5-b25e-43cc-a6db-06fd6c29a124 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:42.177520 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496330e-6182-48f8-89e1-a3073ed5a0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:42.178074 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496330e-6182-48f8-89e1-a3073ed5a0a2 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:42.178360 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496330e-6182-48f8-89e1-a3073ed5a0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:42.178636 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496330e-6182-48f8-89e1-a3073ed5a0a2 None admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:42.179414 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f496330e-6182-48f8-89e1-a3073ed5a0a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:48:42.179751 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f496330e-6182-48f8-89e1-a3073ed5a0a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:42.182587 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f496330e-6182-48f8-89e1-a3073ed5a0a2 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:42.195589 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 616/1245] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 3 11:48:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:48:42.201869 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc99cc-b6f4-4980-a425-5ab8b3548139 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:42.314135 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc99cc-b6f4-4980-a425-5ab8b3548139 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:42.350336 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73311b60-d878-412a-8c60-661a70bd6edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:42.350999 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73311b60-d878-412a-8c60-661a70bd6edf None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:42.351288 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73311b60-d878-412a-8c60-661a70bd6edf None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:42.351591 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73311b60-d878-412a-8c60-661a70bd6edf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:42.352429 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73311b60-d878-412a-8c60-661a70bd6edf None admin] RBAC: Adding query filter params (role.id=41158ae54c7a437284af718034e9b354, scope.project.id=cff223ee05524cf4bf3591fc5a39559e, user.id=eb5a91437dd64e2491ce41b4d12d4835) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:48:42.352742 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73311b60-d878-412a-8c60-661a70bd6edf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:42.354472 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73311b60-d878-412a-8c60-661a70bd6edf None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:42.361201 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 630/1246] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:48:42 2022] GET /identity/v3/role_assignments?user.id=eb5a91437dd64e2491ce41b4d12d4835&scope.project.id=cff223ee05524cf4bf3591fc5a39559e&role.id=41158ae54c7a437284af718034e9b354 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:48:44.761293 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfef4b8-038d-451b-9cc5-cf8b3d8fb7f3 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:44.761842 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfef4b8-038d-451b-9cc5-cf8b3d8fb7f3 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:44.761842 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfef4b8-038d-451b-9cc5-cf8b3d8fb7f3 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:44.763943 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 617/1247] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:48:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:48:44.770060 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e1f12-2a01-47f1-b7c8-a70bf5a62fc8 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:44.770573 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e1f12-2a01-47f1-b7c8-a70bf5a62fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:44.770676 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e1f12-2a01-47f1-b7c8-a70bf5a62fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:44.775930 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:44.790546 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-7e2e1f12-2a01-47f1-b7c8-a70bf5a62fc8 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:48:44.791943 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-7e2e1f12-2a01-47f1-b7c8-a70bf5a62fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:48:44.864700 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 631/1248] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:48:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:48:44.889667 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfef4b8-038d-451b-9cc5-cf8b3d8fb7f3 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:44.909705 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:45.003058 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfef4b8-038d-451b-9cc5-cf8b3d8fb7f3 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:45.040607 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55755d71-59a6-4752-8de4-b4667c618adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:45.041315 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55755d71-59a6-4752-8de4-b4667c618adc None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:45.041680 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55755d71-59a6-4752-8de4-b4667c618adc None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:45.041889 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55755d71-59a6-4752-8de4-b4667c618adc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:45.053558 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55755d71-59a6-4752-8de4-b4667c618adc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:48:45.063261 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-55755d71-59a6-4752-8de4-b4667c618adc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:48:45.063261 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:48:45.063261 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:48:45.063261 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:48:45.063261 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:48:45.063261 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:48:45.063261 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:48:45.063261 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:48:45.063261 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:48:45.063261 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:48:45.063261 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:48:45.063261 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:48:45.063261 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:48:45.063261 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:48:45.063261 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:48:45.063261 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:48:45.064528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:48:45.064528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:48:45.064528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:48:45.064528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:48:45.064528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:48:45.064528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:48:45.064528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:48:45.064528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:48:45.064528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:48:45.064528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:48:45.064528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:48:45.064528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:48:45.064528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:48:45.064528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:48:45.064528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:48:45.064528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:48:45.065505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:48:45.065505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:48:45.065505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:48:45.065505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:48:45.065505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:48:45.065505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:48:45.065505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:48:45.065505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:48:45.065505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:48:45.065505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:48:45.065505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:48:45.065505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:48:45.065505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 618/1249] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 3 11:48:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:48:45.071024 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e1f12-2a01-47f1-b7c8-a70bf5a62fc8 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:45.178904 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e1f12-2a01-47f1-b7c8-a70bf5a62fc8 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:45.221918 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:45.229056 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b2f39-8c3e-450d-b3f1-8f751d69dc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:45.229979 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b2f39-8c3e-450d-b3f1-8f751d69dc8e None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:45.230383 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b2f39-8c3e-450d-b3f1-8f751d69dc8e None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:45.230800 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b2f39-8c3e-450d-b3f1-8f751d69dc8e None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:45.232441 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b2f39-8c3e-450d-b3f1-8f751d69dc8e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:48:45.232829 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b2f39-8c3e-450d-b3f1-8f751d69dc8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:45.235003 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b2f39-8c3e-450d-b3f1-8f751d69dc8e None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:45.244496 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 632/1250] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:48:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:48:45.253353 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55755d71-59a6-4752-8de4-b4667c618adc None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:45.335957 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:45.361411 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55755d71-59a6-4752-8de4-b4667c618adc None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:45.400092 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b9ded-440f-496f-a848-12486da5fb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:45.401062 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b9ded-440f-496f-a848-12486da5fb0d None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:45.401401 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b9ded-440f-496f-a848-12486da5fb0d None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:45.401754 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b9ded-440f-496f-a848-12486da5fb0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:45.412875 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b9ded-440f-496f-a848-12486da5fb0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:45.414312 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b9ded-440f-496f-a848-12486da5fb0d None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:45.432388 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-5e3b9ded-440f-496f-a848-12486da5fb0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:48:45.432388 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:48:45.432388 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:48:45.432388 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:48:45.432388 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:48:45.432388 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:48:45.432388 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:48:45.432388 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:48:45.432388 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:48:45.432388 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:48:45.432388 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:48:45.432388 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:48:45.432388 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:48:45.432388 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:48:45.432388 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:48:45.433565 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:48:45.433565 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:48:45.433565 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:48:45.433565 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:48:45.433565 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:48:45.433565 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:48:45.433565 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:48:45.433565 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:48:45.433565 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:48:45.433565 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:48:45.433565 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:48:45.433565 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:48:45.433565 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:48:45.433565 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:48:45.433565 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:48:45.433565 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:48:45.433565 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:48:45.435327 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:48:45.435327 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:48:45.435327 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:48:45.435327 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:48:45.435327 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 619/1251] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:48:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:48:45.440134 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b2f39-8c3e-450d-b3f1-8f751d69dc8e None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:45.551702 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b2f39-8c3e-450d-b3f1-8f751d69dc8e None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:45.584776 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acade86-ecc9-4edb-a2c2-050c97eddfaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:45.585443 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acade86-ecc9-4edb-a2c2-050c97eddfaf None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:45.585733 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acade86-ecc9-4edb-a2c2-050c97eddfaf None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:45.586053 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acade86-ecc9-4edb-a2c2-050c97eddfaf None admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:45.586736 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acade86-ecc9-4edb-a2c2-050c97eddfaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:48:45.587032 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acade86-ecc9-4edb-a2c2-050c97eddfaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:45.588436 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acade86-ecc9-4edb-a2c2-050c97eddfaf None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:45.602816 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 633/1252] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:48:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:48:45.609154 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b9ded-440f-496f-a848-12486da5fb0d None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:45.712619 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b9ded-440f-496f-a848-12486da5fb0d None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:45.745317 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:45.754956 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7d32d-042d-4ecf-8615-574a959ab9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:45.755787 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7d32d-042d-4ecf-8615-574a959ab9d7 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:45.756074 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7d32d-042d-4ecf-8615-574a959ab9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:45.756395 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7d32d-042d-4ecf-8615-574a959ab9d7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:45.764354 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c7d32d-042d-4ecf-8615-574a959ab9d7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:45.765802 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c7d32d-042d-4ecf-8615-574a959ab9d7 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:45.782704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-49c7d32d-042d-4ecf-8615-574a959ab9d7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 03 11:48:45.782704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:48:45.782704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:48:45.782704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:48:45.782704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:48:45.782704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:48:45.782704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:48:45.782704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:48:45.782704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:48:45.782704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:48:45.782704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:48:45.782704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:48:45.782704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 11:48:45.782704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 11:48:45.782704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 11:48:45.782704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 11:48:45.784010 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:48:45.784010 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:48:45.784010 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 11:48:45.784010 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:48:45.784010 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 11:48:45.784010 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:48:45.784010 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:48:45.784010 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:48:45.784010 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:48:45.784010 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:48:45.784010 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:48:45.784010 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:48:45.784010 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:48:45.784010 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:48:45.784010 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:48:45.784010 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:48:45.784010 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:48:45.784010 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:48:45.784985 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:48:45.784985 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:48:45.784985 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 11:48:45.784985 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 11:48:45.784985 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 11:48:45.784985 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 11:48:45.784985 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 11:48:45.784985 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 11:48:45.784985 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 03 11:48:45.784985 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:48:45.784985 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 620/1253] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:48:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 03 11:48:45.790013 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acade86-ecc9-4edb-a2c2-050c97eddfaf None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:45.849449 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:45.899182 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acade86-ecc9-4edb-a2c2-050c97eddfaf None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:45.941584 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c01d7-c847-4dc3-9655-4ee56fe2b939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:45.942262 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c01d7-c847-4dc3-9655-4ee56fe2b939 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:45.942578 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c01d7-c847-4dc3-9655-4ee56fe2b939 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:45.942853 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c01d7-c847-4dc3-9655-4ee56fe2b939 None admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:45.943731 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c01d7-c847-4dc3-9655-4ee56fe2b939 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:48:45.944040 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c01d7-c847-4dc3-9655-4ee56fe2b939 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:45.945477 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c01d7-c847-4dc3-9655-4ee56fe2b939 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:45.965008 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 634/1254] 10.222.0.15 () {56 vars in 1143 bytes} [Fri Jun 3 11:48:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:48:45.971684 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7d32d-042d-4ecf-8615-574a959ab9d7 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:46.087192 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7d32d-042d-4ecf-8615-574a959ab9d7 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:46.128363 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a297ca5d-73f4-498b-b9f8-6a04e21be8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:46.128995 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297ca5d-73f4-498b-b9f8-6a04e21be8b5 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:46.129282 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297ca5d-73f4-498b-b9f8-6a04e21be8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:46.129611 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297ca5d-73f4-498b-b9f8-6a04e21be8b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:46.192604 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:46.207270 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a297ca5d-73f4-498b-b9f8-6a04e21be8b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:46.208847 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a297ca5d-73f4-498b-b9f8-6a04e21be8b5 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:46.316862 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 621/1255] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:48:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 11:48:46.323896 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c01d7-c847-4dc3-9655-4ee56fe2b939 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:46.435441 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c01d7-c847-4dc3-9655-4ee56fe2b939 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:46.451490 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:46.475836 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c76de-56d1-4051-8536-4e07cae77859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:46.476692 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c76de-56d1-4051-8536-4e07cae77859 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:46.476975 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c76de-56d1-4051-8536-4e07cae77859 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:46.477243 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c76de-56d1-4051-8536-4e07cae77859 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:46.489255 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c76de-56d1-4051-8536-4e07cae77859 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:46.490825 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c76de-56d1-4051-8536-4e07cae77859 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:46.509344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-858c76de-56d1-4051-8536-4e07cae77859 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:48:46.509344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:48:46.509344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:48:46.509344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:48:46.509344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:48:46.509344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:48:46.509344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:48:46.509344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:48:46.509344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:48:46.509344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:48:46.509344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:48:46.509344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:48:46.509344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:48:46.509344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:48:46.509344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:48:46.510541 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:48:46.510541 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:48:46.510541 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:48:46.510541 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:48:46.510541 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:48:46.510541 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:48:46.510541 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:48:46.510541 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:48:46.510541 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:48:46.510541 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:48:46.510541 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:48:46.510541 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:48:46.510541 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:48:46.510541 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:48:46.510541 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:48:46.510541 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:48:46.510541 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:48:46.511680 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:48:46.511680 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:48:46.511680 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:48:46.511680 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:48:46.515710 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 635/1256] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:48:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:48:46.517409 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a297ca5d-73f4-498b-b9f8-6a04e21be8b5 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:46.617238 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:46.629666 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a297ca5d-73f4-498b-b9f8-6a04e21be8b5 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:46.666734 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214e492-0400-4eec-9f84-eadb628585a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:46.667696 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214e492-0400-4eec-9f84-eadb628585a7 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:46.667974 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214e492-0400-4eec-9f84-eadb628585a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:46.668245 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214e492-0400-4eec-9f84-eadb628585a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:46.668991 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214e492-0400-4eec-9f84-eadb628585a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:48:46.669287 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214e492-0400-4eec-9f84-eadb628585a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:46.670647 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214e492-0400-4eec-9f84-eadb628585a7 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:46.682006 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 622/1257] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:48:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:48:46.687735 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c76de-56d1-4051-8536-4e07cae77859 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:46.806041 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c76de-56d1-4051-8536-4e07cae77859 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:46.841171 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110c3fc-1dac-4e20-bedc-508107152fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:46.841967 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110c3fc-1dac-4e20-bedc-508107152fd0 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:46.842255 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110c3fc-1dac-4e20-bedc-508107152fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:46.842536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110c3fc-1dac-4e20-bedc-508107152fd0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:46.849450 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1110c3fc-1dac-4e20-bedc-508107152fd0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:46.850909 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1110c3fc-1dac-4e20-bedc-508107152fd0 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:46.864914 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-1110c3fc-1dac-4e20-bedc-508107152fd0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:48:46.864914 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:48:46.864914 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:48:46.864914 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:48:46.864914 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:48:46.864914 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:48:46.864914 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:48:46.864914 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:48:46.864914 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:48:46.864914 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:48:46.864914 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:48:46.864914 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:48:46.864914 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 11:48:46.864914 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 11:48:46.864914 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 11:48:46.865984 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 11:48:46.865984 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:48:46.865984 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:48:46.865984 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:48:46.865984 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:48:46.865984 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:48:46.865984 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:48:46.865984 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:48:46.865984 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:48:46.865984 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:48:46.865984 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:48:46.865984 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:48:46.865984 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:48:46.865984 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:48:46.865984 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:48:46.865984 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:48:46.865984 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:48:46.867030 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 11:48:46.867030 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 11:48:46.867030 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 11:48:46.867030 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 11:48:46.867030 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 11:48:46.867030 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 11:48:46.867030 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:48:46.867030 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:48:46.867030 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 636/1258] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:48:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:48:46.872428 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214e492-0400-4eec-9f84-eadb628585a7 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:46.971258 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214e492-0400-4eec-9f84-eadb628585a7 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:47.003312 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9fc116-b231-4fc8-9eb0-3cd8d299e8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:47.003987 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fc116-b231-4fc8-9eb0-3cd8d299e8cd None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:47.004273 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fc116-b231-4fc8-9eb0-3cd8d299e8cd None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:47.004549 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fc116-b231-4fc8-9eb0-3cd8d299e8cd None admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:47.005324 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9fc116-b231-4fc8-9eb0-3cd8d299e8cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:48:47.005636 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9fc116-b231-4fc8-9eb0-3cd8d299e8cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:47.007064 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9fc116-b231-4fc8-9eb0-3cd8d299e8cd None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:47.019254 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 623/1259] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 3 11:48:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:48:47.025463 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110c3fc-1dac-4e20-bedc-508107152fd0 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:47.051453 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:47.125027 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110c3fc-1dac-4e20-bedc-508107152fd0 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:47.157954 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569b3e7-2fd3-4609-9320-582759e54dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:47.158598 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569b3e7-2fd3-4609-9320-582759e54dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:47.158884 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569b3e7-2fd3-4609-9320-582759e54dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:47.159163 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569b3e7-2fd3-4609-9320-582759e54dd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:47.160027 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d569b3e7-2fd3-4609-9320-582759e54dd4 None admin] RBAC: Adding query filter params (role.id=c486e164840b41a59fd118dece2ce572, scope.project.id=cff223ee05524cf4bf3591fc5a39559e, user.id=eb5a91437dd64e2491ce41b4d12d4835) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:48:47.160342 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d569b3e7-2fd3-4609-9320-582759e54dd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:47.161793 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d569b3e7-2fd3-4609-9320-582759e54dd4 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:47.167118 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 637/1260] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:48:47 2022] GET /identity/v3/role_assignments?user.id=eb5a91437dd64e2491ce41b4d12d4835&scope.project.id=cff223ee05524cf4bf3591fc5a39559e&role.id=c486e164840b41a59fd118dece2ce572 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:48:49.367970 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fb49c-4708-402d-9946-ede865e944d6 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:49.368520 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fb49c-4708-402d-9946-ede865e944d6 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:49.368520 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fb49c-4708-402d-9946-ede865e944d6 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:49.369863 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 624/1261] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:48:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:48:49.374972 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31630e6-e625-4cba-9670-a3415985e400 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:49.375407 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31630e6-e625-4cba-9670-a3415985e400 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:49.375559 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31630e6-e625-4cba-9670-a3415985e400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:49.392016 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-b31630e6-e625-4cba-9670-a3415985e400 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:48:49.393193 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-b31630e6-e625-4cba-9670-a3415985e400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:48:49.458067 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 638/1262] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:48:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:48:49.480367 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fb49c-4708-402d-9946-ede865e944d6 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:49.491516 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:49.579930 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fb49c-4708-402d-9946-ede865e944d6 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:49.612443 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad2f72-3387-4324-a221-fc29de5217c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:49.613207 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad2f72-3387-4324-a221-fc29de5217c6 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:49.613487 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad2f72-3387-4324-a221-fc29de5217c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:49.613757 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad2f72-3387-4324-a221-fc29de5217c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:49.623630 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad2f72-3387-4324-a221-fc29de5217c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:48:49.631089 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-c6ad2f72-3387-4324-a221-fc29de5217c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:48:49.631089 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:48:49.631089 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:48:49.631089 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:48:49.631089 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:48:49.631089 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:48:49.631089 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:48:49.631089 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:48:49.631089 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:48:49.631089 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:48:49.631089 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:48:49.631089 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:48:49.631089 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:48:49.631089 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:48:49.631089 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:48:49.631089 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:48:49.632160 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:48:49.632160 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:48:49.632160 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:48:49.632160 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:48:49.632160 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:48:49.632160 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:48:49.632160 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:48:49.632160 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:48:49.632160 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:48:49.632160 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:48:49.632160 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:48:49.632160 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:48:49.632160 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:48:49.632160 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:48:49.632160 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:48:49.632160 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:48:49.633188 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:48:49.633188 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:48:49.633188 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:48:49.633188 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:48:49.633188 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:48:49.633188 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:48:49.633188 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:48:49.633188 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:48:49.633188 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:48:49.633188 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:48:49.633188 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:48:49.633188 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:48:49.633188 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 625/1263] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 3 11:48:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:48:49.638646 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31630e6-e625-4cba-9670-a3415985e400 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:49.657273 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:49.743759 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31630e6-e625-4cba-9670-a3415985e400 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:49.784481 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e875531c-d827-4ab9-a84e-28183a0f08d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:49.785200 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875531c-d827-4ab9-a84e-28183a0f08d1 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:49.785478 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875531c-d827-4ab9-a84e-28183a0f08d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:49.785775 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875531c-d827-4ab9-a84e-28183a0f08d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:49.786555 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e875531c-d827-4ab9-a84e-28183a0f08d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:48:49.786839 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e875531c-d827-4ab9-a84e-28183a0f08d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:49.788244 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e875531c-d827-4ab9-a84e-28183a0f08d1 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:49.800350 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 639/1264] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:48:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:48:49.806189 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad2f72-3387-4324-a221-fc29de5217c6 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:49.871141 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:49.904757 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad2f72-3387-4324-a221-fc29de5217c6 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:49.943730 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc4a9b-4472-4c9b-8f36-0bf7ff69cd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:49.945072 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc4a9b-4472-4c9b-8f36-0bf7ff69cd1c None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:49.945579 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc4a9b-4472-4c9b-8f36-0bf7ff69cd1c None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:49.946075 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc4a9b-4472-4c9b-8f36-0bf7ff69cd1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:49.957974 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc4a9b-4472-4c9b-8f36-0bf7ff69cd1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:49.959398 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc4a9b-4472-4c9b-8f36-0bf7ff69cd1c None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:49.976257 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-dafc4a9b-4472-4c9b-8f36-0bf7ff69cd1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:48:49.976257 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:48:49.976257 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:48:49.976257 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:48:49.976257 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:48:49.976257 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:48:49.976257 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:48:49.976257 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:48:49.976257 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:48:49.976257 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:48:49.976257 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:48:49.976257 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:48:49.976257 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:48:49.976257 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:48:49.976257 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:48:49.977296 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:48:49.977296 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:48:49.977296 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:48:49.977296 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:48:49.977296 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:48:49.977296 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:48:49.977296 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:48:49.977296 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:48:49.977296 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:48:49.977296 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:48:49.977296 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:48:49.977296 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:48:49.977296 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:48:49.977296 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:48:49.977296 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:48:49.977296 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:48:49.977296 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:48:49.978223 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:48:49.978223 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:48:49.978223 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:48:49.978223 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:48:49.978223 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 626/1265] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:48:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:48:49.983270 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e875531c-d827-4ab9-a84e-28183a0f08d1 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:50.061218 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:50.080208 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e875531c-d827-4ab9-a84e-28183a0f08d1 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:50.111369 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b2602-87fe-46f2-a4fe-9ed9bc8d03da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:50.112035 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b2602-87fe-46f2-a4fe-9ed9bc8d03da None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:50.112315 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b2602-87fe-46f2-a4fe-9ed9bc8d03da None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:50.112584 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b2602-87fe-46f2-a4fe-9ed9bc8d03da None admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:50.113294 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b2602-87fe-46f2-a4fe-9ed9bc8d03da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:48:50.113593 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b2602-87fe-46f2-a4fe-9ed9bc8d03da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:50.114937 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b2602-87fe-46f2-a4fe-9ed9bc8d03da None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:50.126567 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 640/1266] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:48:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:48:50.132044 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc4a9b-4472-4c9b-8f36-0bf7ff69cd1c None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:50.229044 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc4a9b-4472-4c9b-8f36-0bf7ff69cd1c None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:50.248855 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:50.262929 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb0bb9-bc36-4e74-9b95-8f4154da3401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:50.263729 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb0bb9-bc36-4e74-9b95-8f4154da3401 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:50.264007 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb0bb9-bc36-4e74-9b95-8f4154da3401 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:50.264274 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb0bb9-bc36-4e74-9b95-8f4154da3401 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:50.270972 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb0bb9-bc36-4e74-9b95-8f4154da3401 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:50.272416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb0bb9-bc36-4e74-9b95-8f4154da3401 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:50.286607 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-3cfb0bb9-bc36-4e74-9b95-8f4154da3401 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 03 11:48:50.286607 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:48:50.286607 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:48:50.286607 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:48:50.286607 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:48:50.286607 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:48:50.286607 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:48:50.286607 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:48:50.286607 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:48:50.286607 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:48:50.286607 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:48:50.286607 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:48:50.286607 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 11:48:50.286607 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 11:48:50.286607 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 11:48:50.286607 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 11:48:50.287720 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:48:50.287720 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:48:50.287720 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 11:48:50.287720 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:48:50.287720 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 11:48:50.287720 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:48:50.287720 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:48:50.287720 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:48:50.287720 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:48:50.287720 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:48:50.287720 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:48:50.287720 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:48:50.287720 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:48:50.287720 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:48:50.287720 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:48:50.287720 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:48:50.287720 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:48:50.287720 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:48:50.288861 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:48:50.288861 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:48:50.288861 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 11:48:50.288861 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 11:48:50.288861 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 11:48:50.288861 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 11:48:50.288861 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 11:48:50.288861 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 11:48:50.288861 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 03 11:48:50.288861 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:48:50.288861 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 627/1267] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:48:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:48:50.293979 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b2602-87fe-46f2-a4fe-9ed9bc8d03da None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:50.388855 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b2602-87fe-46f2-a4fe-9ed9bc8d03da None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:50.421294 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31ded9-ac60-409f-852f-4c186237f0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:50.421940 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31ded9-ac60-409f-852f-4c186237f0fd None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:50.422220 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31ded9-ac60-409f-852f-4c186237f0fd None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:50.422492 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31ded9-ac60-409f-852f-4c186237f0fd None admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:50.423311 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d31ded9-ac60-409f-852f-4c186237f0fd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:48:50.423647 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d31ded9-ac60-409f-852f-4c186237f0fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:50.425056 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d31ded9-ac60-409f-852f-4c186237f0fd None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:50.433298 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:50.442275 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 641/1268] 10.222.0.15 () {56 vars in 1143 bytes} [Fri Jun 3 11:48:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:48:50.447712 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb0bb9-bc36-4e74-9b95-8f4154da3401 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:50.544823 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb0bb9-bc36-4e74-9b95-8f4154da3401 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:50.577377 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e022b-fc43-4f47-9ed2-3200687ba9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:50.578143 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e022b-fc43-4f47-9ed2-3200687ba9aa None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:50.578428 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e022b-fc43-4f47-9ed2-3200687ba9aa None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:50.578704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e022b-fc43-4f47-9ed2-3200687ba9aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:50.588402 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58e022b-fc43-4f47-9ed2-3200687ba9aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:50.589834 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58e022b-fc43-4f47-9ed2-3200687ba9aa None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:50.607164 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-b58e022b-fc43-4f47-9ed2-3200687ba9aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:48:50.607164 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:48:50.607164 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:48:50.607164 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:48:50.607164 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:48:50.607164 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:48:50.607164 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:48:50.607164 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:48:50.607164 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:48:50.607164 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:48:50.607164 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:48:50.607164 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:48:50.607164 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:48:50.607164 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:48:50.607164 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:48:50.608237 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:48:50.608237 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:48:50.608237 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:48:50.608237 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:48:50.608237 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:48:50.608237 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:48:50.608237 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:48:50.608237 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:48:50.608237 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:48:50.608237 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:48:50.608237 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:48:50.608237 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:48:50.608237 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:48:50.608237 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:48:50.608237 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:48:50.608237 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:48:50.608237 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:48:50.609184 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:48:50.609184 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:48:50.609184 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:48:50.609184 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:48:50.609184 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 628/1269] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:48:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:48:50.613806 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31ded9-ac60-409f-852f-4c186237f0fd None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:50.712200 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31ded9-ac60-409f-852f-4c186237f0fd None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:50.749411 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27397f25-e746-487b-bd92-f1f1ea1bac67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:50.750073 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27397f25-e746-487b-bd92-f1f1ea1bac67 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:50.750359 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27397f25-e746-487b-bd92-f1f1ea1bac67 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:50.750636 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27397f25-e746-487b-bd92-f1f1ea1bac67 None admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:50.751359 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27397f25-e746-487b-bd92-f1f1ea1bac67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:48:50.751697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27397f25-e746-487b-bd92-f1f1ea1bac67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:50.753072 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27397f25-e746-487b-bd92-f1f1ea1bac67 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:50.764043 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 642/1270] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:48:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:48:50.769735 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e022b-fc43-4f47-9ed2-3200687ba9aa None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:50.801468 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:50.867055 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e022b-fc43-4f47-9ed2-3200687ba9aa None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:50.898998 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2cbd25-de5e-47dc-aaef-a727e8f11064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:50.899805 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cbd25-de5e-47dc-aaef-a727e8f11064 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:50.900087 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cbd25-de5e-47dc-aaef-a727e8f11064 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:50.900359 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cbd25-de5e-47dc-aaef-a727e8f11064 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:50.907681 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2cbd25-de5e-47dc-aaef-a727e8f11064 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:50.909107 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2cbd25-de5e-47dc-aaef-a727e8f11064 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:50.922922 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-1c2cbd25-de5e-47dc-aaef-a727e8f11064 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:48:50.922922 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:48:50.922922 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:48:50.922922 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:48:50.922922 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:48:50.922922 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:48:50.922922 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:48:50.922922 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:48:50.922922 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:48:50.922922 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:48:50.922922 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:48:50.922922 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:48:50.922922 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 11:48:50.922922 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 11:48:50.922922 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 11:48:50.923961 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 11:48:50.923961 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:48:50.923961 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:48:50.923961 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:48:50.923961 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:48:50.923961 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:48:50.923961 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:48:50.923961 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:48:50.923961 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:48:50.923961 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:48:50.923961 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:48:50.923961 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:48:50.923961 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:48:50.923961 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:48:50.923961 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:48:50.923961 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:48:50.923961 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:48:50.924907 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 11:48:50.924907 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 11:48:50.924907 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 11:48:50.924907 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 11:48:50.924907 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 11:48:50.924907 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 11:48:50.924907 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:48:50.924907 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:48:50.924907 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 629/1271] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:48:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:48:50.929881 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27397f25-e746-487b-bd92-f1f1ea1bac67 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:50.986012 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:51.026799 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27397f25-e746-487b-bd92-f1f1ea1bac67 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:51.060649 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4281b39c-c363-49ea-93f7-b0c50c806539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:51.061241 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281b39c-c363-49ea-93f7-b0c50c806539 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:51.061525 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281b39c-c363-49ea-93f7-b0c50c806539 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:51.061803 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281b39c-c363-49ea-93f7-b0c50c806539 None admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:51.062583 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4281b39c-c363-49ea-93f7-b0c50c806539 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:48:51.062893 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4281b39c-c363-49ea-93f7-b0c50c806539 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:51.064355 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4281b39c-c363-49ea-93f7-b0c50c806539 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:51.076656 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 643/1272] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 3 11:48:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:48:51.082473 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2cbd25-de5e-47dc-aaef-a727e8f11064 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:51.171197 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:51.180328 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2cbd25-de5e-47dc-aaef-a727e8f11064 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:51.212450 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07889395-bead-4f67-bbc6-dc65f9d3cdde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:51.213311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07889395-bead-4f67-bbc6-dc65f9d3cdde None admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:51.213589 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07889395-bead-4f67-bbc6-dc65f9d3cdde None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:51.213861 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07889395-bead-4f67-bbc6-dc65f9d3cdde None admin] PATH_INFO: `/v3/projects/cff223ee05524cf4bf3591fc5a39559e/users/eb5a91437dd64e2491ce41b4d12d4835/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:51.216353 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07889395-bead-4f67-bbc6-dc65f9d3cdde None admin] RBAC: Authorizing `identity:create_grant(project_id=cff223ee05524cf4bf3591fc5a39559e, user_id=eb5a91437dd64e2491ce41b4d12d4835, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:51.217762 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07889395-bead-4f67-bbc6-dc65f9d3cdde None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:51.230190 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 630/1273] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Jun 3 11:48:51 2022] PUT /identity/v3/projects/cff223ee05524cf4bf3591fc5a39559e/users/eb5a91437dd64e2491ce41b4d12d4835/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:48:53.418970 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7504aba-82c2-41db-8bbf-c250314eb1b8 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:53.419530 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7504aba-82c2-41db-8bbf-c250314eb1b8 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:53.419530 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7504aba-82c2-41db-8bbf-c250314eb1b8 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:53.420907 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 644/1274] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:48:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:48:53.425949 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b7f50-d493-4b13-b5e8-0ace3e3a8d98 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:53.426372 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b7f50-d493-4b13-b5e8-0ace3e3a8d98 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:53.426499 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b7f50-d493-4b13-b5e8-0ace3e3a8d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:53.442728 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-994b7f50-d493-4b13-b5e8-0ace3e3a8d98 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:48:53.443928 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-994b7f50-d493-4b13-b5e8-0ace3e3a8d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:48:53.507038 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 631/1275] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:48:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:48:53.531007 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7504aba-82c2-41db-8bbf-c250314eb1b8 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:53.628187 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7504aba-82c2-41db-8bbf-c250314eb1b8 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:53.645292 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:53.662575 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fbff03-cd95-401b-bc1d-a977effaf90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:53.663350 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbff03-cd95-401b-bc1d-a977effaf90d None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:53.663664 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbff03-cd95-401b-bc1d-a977effaf90d None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:53.663940 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbff03-cd95-401b-bc1d-a977effaf90d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:53.673765 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fbff03-cd95-401b-bc1d-a977effaf90d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 03 11:48:53.681267 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-02fbff03-cd95-401b-bc1d-a977effaf90d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:48:53.681267 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:48:53.681267 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:48:53.681267 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:48:53.681267 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:48:53.681267 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:48:53.681267 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:48:53.681267 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:48:53.681267 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:48:53.681267 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:48:53.681267 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:48:53.681267 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:48:53.681267 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 03 11:48:53.681267 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 03 11:48:53.681267 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 03 11:48:53.681267 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 03 11:48:53.682378 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 03 11:48:53.682378 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 03 11:48:53.682378 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 03 11:48:53.682378 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 03 11:48:53.682378 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:48:53.682378 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:48:53.682378 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:48:53.682378 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:48:53.682378 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:48:53.682378 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:48:53.682378 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:48:53.682378 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:48:53.682378 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:48:53.682378 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:48:53.682378 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:48:53.682378 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:48:53.683264 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:48:53.683264 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:48:53.683264 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:48:53.683264 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:48:53.683264 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 03 11:48:53.683264 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 03 11:48:53.683264 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 03 11:48:53.683264 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 03 11:48:53.683264 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 03 11:48:53.683264 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 03 11:48:53.683264 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 03 11:48:53.683264 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:48:53.683264 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 645/1276] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Jun 3 11:48:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:48:53.688665 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b7f50-d493-4b13-b5e8-0ace3e3a8d98 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:53.780304 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:53.798770 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b7f50-d493-4b13-b5e8-0ace3e3a8d98 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:53.831773 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed4407-fe40-43af-bea8-11e5a31920ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:53.832425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed4407-fe40-43af-bea8-11e5a31920ae None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:53.832706 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed4407-fe40-43af-bea8-11e5a31920ae None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:53.832982 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed4407-fe40-43af-bea8-11e5a31920ae None admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:53.833715 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed4407-fe40-43af-bea8-11e5a31920ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:48:53.834017 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed4407-fe40-43af-bea8-11e5a31920ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:53.835377 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed4407-fe40-43af-bea8-11e5a31920ae None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:53.843105 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 632/1277] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Jun 3 11:48:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:48:53.848720 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fbff03-cd95-401b-bc1d-a977effaf90d None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:53.945930 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fbff03-cd95-401b-bc1d-a977effaf90d None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:53.979105 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564655cb-143d-4bf4-9646-3cfcdafdfe9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:53.979913 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564655cb-143d-4bf4-9646-3cfcdafdfe9f None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:53.980195 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564655cb-143d-4bf4-9646-3cfcdafdfe9f None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:53.980462 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564655cb-143d-4bf4-9646-3cfcdafdfe9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:53.990644 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564655cb-143d-4bf4-9646-3cfcdafdfe9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:53.992122 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564655cb-143d-4bf4-9646-3cfcdafdfe9f None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:54.009090 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-564655cb-143d-4bf4-9646-3cfcdafdfe9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:48:54.009090 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:48:54.009090 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:48:54.009090 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:48:54.009090 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:48:54.009090 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:48:54.009090 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:48:54.009090 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:48:54.009090 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:48:54.009090 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:48:54.009090 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:48:54.009090 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:48:54.009090 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:48:54.009090 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:48:54.009090 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:48:54.010125 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:48:54.010125 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:48:54.010125 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:48:54.010125 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:48:54.010125 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:48:54.010125 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:48:54.010125 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:48:54.010125 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:48:54.010125 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:48:54.010125 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:48:54.010125 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:48:54.010125 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:48:54.010125 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:48:54.010125 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:48:54.010125 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:48:54.010125 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:48:54.010125 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:48:54.011233 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:48:54.011233 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:48:54.011233 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:48:54.011233 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:48:54.011233 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 646/1278] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:48:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:48:54.016524 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed4407-fe40-43af-bea8-11e5a31920ae None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:54.112668 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed4407-fe40-43af-bea8-11e5a31920ae None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:54.144606 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f558c1-bd6f-4691-8f2c-aae83104fc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:54.145246 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f558c1-bd6f-4691-8f2c-aae83104fc22 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:54.145528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f558c1-bd6f-4691-8f2c-aae83104fc22 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:54.145803 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f558c1-bd6f-4691-8f2c-aae83104fc22 None admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:54.146508 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f558c1-bd6f-4691-8f2c-aae83104fc22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:48:54.146811 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f558c1-bd6f-4691-8f2c-aae83104fc22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:54.148194 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f558c1-bd6f-4691-8f2c-aae83104fc22 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:54.159702 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 633/1279] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:48:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:48:54.165098 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564655cb-143d-4bf4-9646-3cfcdafdfe9f None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:54.195570 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:54.261649 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564655cb-143d-4bf4-9646-3cfcdafdfe9f None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:54.293968 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82ee4e-4840-4854-9531-0279b1071321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:54.294751 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82ee4e-4840-4854-9531-0279b1071321 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:54.295035 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82ee4e-4840-4854-9531-0279b1071321 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:54.295308 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82ee4e-4840-4854-9531-0279b1071321 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:54.303299 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d82ee4e-4840-4854-9531-0279b1071321 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:54.304785 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d82ee4e-4840-4854-9531-0279b1071321 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:54.319167 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-8d82ee4e-4840-4854-9531-0279b1071321 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 03 11:48:54.319167 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:48:54.319167 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:48:54.319167 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:48:54.319167 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:48:54.319167 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:48:54.319167 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:48:54.319167 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:48:54.319167 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:48:54.319167 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:48:54.319167 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:48:54.319167 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:48:54.319167 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 03 11:48:54.319167 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 03 11:48:54.319167 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 03 11:48:54.319167 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 03 11:48:54.320328 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:48:54.320328 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:48:54.320328 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 03 11:48:54.320328 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:48:54.320328 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 03 11:48:54.320328 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 03 11:48:54.320328 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:48:54.320328 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:48:54.320328 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:48:54.320328 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:48:54.320328 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:48:54.320328 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:48:54.320328 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:48:54.320328 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:48:54.320328 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:48:54.320328 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:48:54.320328 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:48:54.320328 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:48:54.321507 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:48:54.321507 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:48:54.321507 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 03 11:48:54.321507 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 03 11:48:54.321507 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 03 11:48:54.321507 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 03 11:48:54.321507 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 03 11:48:54.321507 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 03 11:48:54.321507 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 03 11:48:54.321507 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:48:54.321507 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 647/1280] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:48:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:48:54.327911 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f558c1-bd6f-4691-8f2c-aae83104fc22 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:54.331619 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:54.423896 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f558c1-bd6f-4691-8f2c-aae83104fc22 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:54.456395 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8028b6-f2af-4a13-aad6-40dd958ff8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:54.457046 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8028b6-f2af-4a13-aad6-40dd958ff8ed None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:54.457327 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8028b6-f2af-4a13-aad6-40dd958ff8ed None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:54.457604 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8028b6-f2af-4a13-aad6-40dd958ff8ed None admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:54.458422 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8028b6-f2af-4a13-aad6-40dd958ff8ed None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:48:54.458733 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8028b6-f2af-4a13-aad6-40dd958ff8ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:54.460196 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8028b6-f2af-4a13-aad6-40dd958ff8ed None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:54.476948 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 634/1281] 10.222.0.15 () {56 vars in 1143 bytes} [Fri Jun 3 11:48:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:48:54.483224 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82ee4e-4840-4854-9531-0279b1071321 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:54.570738 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:54.580427 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82ee4e-4840-4854-9531-0279b1071321 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:54.613163 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93789de2-0139-44b2-ba97-7fd2d96f38d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:54.613792 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93789de2-0139-44b2-ba97-7fd2d96f38d2 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:54.614071 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93789de2-0139-44b2-ba97-7fd2d96f38d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:54.614344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93789de2-0139-44b2-ba97-7fd2d96f38d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:54.679036 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93789de2-0139-44b2-ba97-7fd2d96f38d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:54.680501 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93789de2-0139-44b2-ba97-7fd2d96f38d2 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:54.767577 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:54.778308 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 648/1282] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Jun 3 11:48:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 03 11:48:54.784045 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8028b6-f2af-4a13-aad6-40dd958ff8ed None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:54.843428 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:54.880006 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8028b6-f2af-4a13-aad6-40dd958ff8ed None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:54.913624 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81451c4c-f00c-489e-b7ee-153fcc7a0cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:54.914402 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81451c4c-f00c-489e-b7ee-153fcc7a0cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:54.914683 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81451c4c-f00c-489e-b7ee-153fcc7a0cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:54.914957 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81451c4c-f00c-489e-b7ee-153fcc7a0cd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:54.924737 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81451c4c-f00c-489e-b7ee-153fcc7a0cd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:54.926170 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81451c4c-f00c-489e-b7ee-153fcc7a0cd1 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:54.943009 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-81451c4c-f00c-489e-b7ee-153fcc7a0cd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:48:54.943009 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:48:54.943009 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:48:54.943009 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:48:54.943009 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:48:54.943009 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:48:54.943009 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:48:54.943009 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:48:54.943009 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:48:54.943009 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:48:54.943009 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:48:54.943009 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:48:54.943009 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 03 11:48:54.943009 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 03 11:48:54.943009 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 03 11:48:54.944117 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 03 11:48:54.944117 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:48:54.944117 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:48:54.944117 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:48:54.944117 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:48:54.944117 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:48:54.944117 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:48:54.944117 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:48:54.944117 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:48:54.944117 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:48:54.944117 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:48:54.944117 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:48:54.944117 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:48:54.944117 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:48:54.944117 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:48:54.944117 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:48:54.944117 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:48:54.945389 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 03 11:48:54.945389 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 03 11:48:54.945389 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 03 11:48:54.945389 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:48:54.945389 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 635/1283] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:48:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:48:54.950260 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93789de2-0139-44b2-ba97-7fd2d96f38d2 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:55.046394 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93789de2-0139-44b2-ba97-7fd2d96f38d2 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:55.079810 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82fe2f-ce7f-4adf-8e02-326f64c74b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:55.080456 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82fe2f-ce7f-4adf-8e02-326f64c74b47 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:55.080742 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82fe2f-ce7f-4adf-8e02-326f64c74b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:55.081038 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82fe2f-ce7f-4adf-8e02-326f64c74b47 None admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:55.081741 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe82fe2f-ce7f-4adf-8e02-326f64c74b47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:48:55.082048 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe82fe2f-ce7f-4adf-8e02-326f64c74b47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:55.083410 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe82fe2f-ce7f-4adf-8e02-326f64c74b47 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:55.095013 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 649/1284] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Jun 3 11:48:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:48:55.100295 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81451c4c-f00c-489e-b7ee-153fcc7a0cd1 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:55.196196 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81451c4c-f00c-489e-b7ee-153fcc7a0cd1 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:55.210852 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:55.239564 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0be54d-572b-4437-8fd0-5f6e6b5dc298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:55.240332 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0be54d-572b-4437-8fd0-5f6e6b5dc298 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:55.240614 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0be54d-572b-4437-8fd0-5f6e6b5dc298 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:55.240888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0be54d-572b-4437-8fd0-5f6e6b5dc298 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:55.247913 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0be54d-572b-4437-8fd0-5f6e6b5dc298 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:55.249340 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0be54d-572b-4437-8fd0-5f6e6b5dc298 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:55.263224 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application [None req-9b0be54d-572b-4437-8fd0-5f6e6b5dc298 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:48:55.263224 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:48:55.263224 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:48:55.263224 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:48:55.263224 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:48:55.263224 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:48:55.263224 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:48:55.263224 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:48:55.263224 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:48:55.263224 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:48:55.263224 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:48:55.263224 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:48:55.263224 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 03 11:48:55.263224 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 03 11:48:55.263224 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 03 11:48:55.264302 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 03 11:48:55.264302 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:48:55.264302 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:48:55.264302 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:48:55.264302 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:48:55.264302 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:48:55.264302 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:48:55.264302 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:48:55.264302 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application with Lock( Jun 03 11:48:55.264302 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:48:55.264302 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:48:55.264302 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:48:55.264302 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:48:55.264302 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:48:55.264302 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:48:55.264302 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:48:55.264302 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:48:55.265380 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 03 11:48:55.265380 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 03 11:48:55.265380 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 03 11:48:55.265380 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 03 11:48:55.265380 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 03 11:48:55.265380 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 03 11:48:55.265380 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 03 11:48:55.265380 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: ERROR keystone.server.flask.application Jun 03 11:48:55.265380 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 636/1285] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Jun 3 11:48:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:48:55.270027 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82fe2f-ce7f-4adf-8e02-326f64c74b47 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:55.318007 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:55.365710 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82fe2f-ce7f-4adf-8e02-326f64c74b47 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:55.398285 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec53754-29d7-47d4-9ec9-76c2fa408536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:55.398930 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec53754-29d7-47d4-9ec9-76c2fa408536 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:55.399214 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec53754-29d7-47d4-9ec9-76c2fa408536 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:55.399491 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec53754-29d7-47d4-9ec9-76c2fa408536 None admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:55.400300 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec53754-29d7-47d4-9ec9-76c2fa408536 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:48:55.400609 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec53754-29d7-47d4-9ec9-76c2fa408536 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:55.402056 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec53754-29d7-47d4-9ec9-76c2fa408536 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:55.413865 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 650/1286] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Jun 3 11:48:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:48:55.419963 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0be54d-572b-4437-8fd0-5f6e6b5dc298 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:55.517821 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0be54d-572b-4437-8fd0-5f6e6b5dc298 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:55.550790 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46eabae-a85a-4031-bc88-012d4534b3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:55.551425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46eabae-a85a-4031-bc88-012d4534b3a1 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:55.551751 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46eabae-a85a-4031-bc88-012d4534b3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:55.552033 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46eabae-a85a-4031-bc88-012d4534b3a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:55.552855 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46eabae-a85a-4031-bc88-012d4534b3a1 None admin] RBAC: Adding query filter params (role.id=c486e164840b41a59fd118dece2ce572, scope.project.id=cff223ee05524cf4bf3591fc5a39559e, user.id=eb5a91437dd64e2491ce41b4d12d4835) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:48:55.553171 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46eabae-a85a-4031-bc88-012d4534b3a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:55.554586 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46eabae-a85a-4031-bc88-012d4534b3a1 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:55.560894 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 637/1287] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Jun 3 11:48:55 2022] GET /identity/v3/role_assignments?user.id=eb5a91437dd64e2491ce41b4d12d4835&scope.project.id=cff223ee05524cf4bf3591fc5a39559e&role.id=c486e164840b41a59fd118dece2ce572 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:48:57.770028 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514407d9-bcf4-486d-a9e5-3a101ba1b732 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:57.770596 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514407d9-bcf4-486d-a9e5-3a101ba1b732 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:57.770596 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514407d9-bcf4-486d-a9e5-3a101ba1b732 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:57.772004 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 651/1288] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:48:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:48:57.777184 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812b412-27d4-492f-a86e-eee08cd339f6 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:57.778136 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812b412-27d4-492f-a86e-eee08cd339f6 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:57.778277 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812b412-27d4-492f-a86e-eee08cd339f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:57.795000 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-b812b412-27d4-492f-a86e-eee08cd339f6 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:48:57.796194 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-b812b412-27d4-492f-a86e-eee08cd339f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:48:57.825870 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:57.861782 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 638/1289] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:48:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:48:57.883432 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514407d9-bcf4-486d-a9e5-3a101ba1b732 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:57.982961 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514407d9-bcf4-486d-a9e5-3a101ba1b732 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:57.994416 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:48:58.017995 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b85e9-8f70-4c05-b034-2c9aaf128870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:58.018781 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b85e9-8f70-4c05-b034-2c9aaf128870 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:58.019059 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b85e9-8f70-4c05-b034-2c9aaf128870 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:58.019326 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b85e9-8f70-4c05-b034-2c9aaf128870 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:58.020009 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b85e9-8f70-4c05-b034-2c9aaf128870 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:58.021539 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b85e9-8f70-4c05-b034-2c9aaf128870 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:58.033780 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-e49b85e9-8f70-4c05-b034-2c9aaf128870 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 11:48:58.033780 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:48:58.033780 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 11:48:58.033780 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 11:48:58.033780 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 11:48:58.033780 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 11:48:58.033780 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 11:48:58.033780 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:48:58.033780 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 11:48:58.033780 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:48:58.033780 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 11:48:58.033780 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:48:58.033780 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:48:58.033780 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:48:58.033780 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:48:58.033780 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:48:58.033780 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:48:58.034833 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:48:58.034833 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:48:58.034833 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:48:58.034833 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:48:58.034833 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:48:58.034833 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:48:58.034833 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 11:48:58.034833 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 11:48:58.034833 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 11:48:58.034833 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 11:48:58.034833 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:48:58.034833 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:48:58.034833 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:48:58.034833 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:48:58.034833 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:48:58.034833 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:48:58.035895 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:48:58.035895 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:48:58.035895 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:48:58.035895 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:48:58.035895 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:48:58.035895 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:48:58.035895 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:48:58.035895 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:48:58.035895 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:48:58.035895 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:48:58.035895 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 11:48:58.035895 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:48:58.035895 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 11:48:58.035895 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:48:58.035895 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 652/1290] 10.222.0.15 () {56 vars in 1117 bytes} [Fri Jun 3 11:48:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:48:58.041012 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812b412-27d4-492f-a86e-eee08cd339f6 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:58.135932 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812b412-27d4-492f-a86e-eee08cd339f6 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:58.169299 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48026c2-61d7-4f11-aab4-bcd455eeb7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:58.169939 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48026c2-61d7-4f11-aab4-bcd455eeb7c8 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:58.170221 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48026c2-61d7-4f11-aab4-bcd455eeb7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:58.170492 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48026c2-61d7-4f11-aab4-bcd455eeb7c8 None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:58.171181 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48026c2-61d7-4f11-aab4-bcd455eeb7c8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:48:58.171483 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48026c2-61d7-4f11-aab4-bcd455eeb7c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:58.172867 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48026c2-61d7-4f11-aab4-bcd455eeb7c8 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:58.177543 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 639/1291] 10.222.0.15 () {56 vars in 1116 bytes} [Fri Jun 3 11:48:58 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:48:58.183049 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b85e9-8f70-4c05-b034-2c9aaf128870 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:48:58.280174 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b85e9-8f70-4c05-b034-2c9aaf128870 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:48:58.312296 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92725ff1-c73a-43d9-b45d-84a51191b902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:48:58.312941 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92725ff1-c73a-43d9-b45d-84a51191b902 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:48:58.313222 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92725ff1-c73a-43d9-b45d-84a51191b902 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:48:58.313495 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92725ff1-c73a-43d9-b45d-84a51191b902 None admin] PATH_INFO: `/v3/services` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:48:58.314189 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92725ff1-c73a-43d9-b45d-84a51191b902 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:48:58.314491 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92725ff1-c73a-43d9-b45d-84a51191b902 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:48:58.315869 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92725ff1-c73a-43d9-b45d-84a51191b902 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:48:58.320184 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 653/1292] 10.222.0.15 () {56 vars in 1116 bytes} [Fri Jun 3 11:48:58 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:49:00.515830 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319330f-479d-4e9f-8652-f46d6850b829 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:49:00.516360 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319330f-479d-4e9f-8652-f46d6850b829 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:49:00.516360 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319330f-479d-4e9f-8652-f46d6850b829 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:49:00.517788 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 640/1293] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:49:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:49:00.522849 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7598cf0-fed1-4575-8608-fd7445527704 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:49:00.523210 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7598cf0-fed1-4575-8608-fd7445527704 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:49:00.523418 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7598cf0-fed1-4575-8608-fd7445527704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:49:00.540150 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-b7598cf0-fed1-4575-8608-fd7445527704 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:49:00.541327 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-b7598cf0-fed1-4575-8608-fd7445527704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:49:00.571393 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:49:00.607851 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 654/1294] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:49:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:49:00.630704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319330f-479d-4e9f-8652-f46d6850b829 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:49:00.661528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:49:00.740724 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319330f-479d-4e9f-8652-f46d6850b829 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:49:00.781782 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675737c-4e50-4127-9cc2-28145902436b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:49:00.782364 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675737c-4e50-4127-9cc2-28145902436b None admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:49:00.782643 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675737c-4e50-4127-9cc2-28145902436b None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:49:00.782912 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675737c-4e50-4127-9cc2-28145902436b None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:49:00.783669 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c675737c-4e50-4127-9cc2-28145902436b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:49:00.785357 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c675737c-4e50-4127-9cc2-28145902436b None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:49:00.797944 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 641/1295] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Jun 3 11:49:00 2022] POST /identity/v3/services => generated 246 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:49:02.983519 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846dc6d9-01e6-4c7a-9775-b196b86c058d None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:49:02.984012 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846dc6d9-01e6-4c7a-9775-b196b86c058d None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:49:02.984119 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846dc6d9-01e6-4c7a-9775-b196b86c058d None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:49:02.985427 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 655/1296] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:49:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:49:02.990574 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46a908-f232-4a07-b99c-881bcae346f6 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:49:02.990970 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46a908-f232-4a07-b99c-881bcae346f6 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:49:02.991117 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46a908-f232-4a07-b99c-881bcae346f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:49:03.007799 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-ed46a908-f232-4a07-b99c-881bcae346f6 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:49:03.008965 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-ed46a908-f232-4a07-b99c-881bcae346f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:49:03.079169 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 642/1297] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:49:02 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:49:03.101861 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846dc6d9-01e6-4c7a-9775-b196b86c058d None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:49:03.197596 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846dc6d9-01e6-4c7a-9775-b196b86c058d None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:49:03.230243 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6efb281-6aa4-4589-a016-02356fe3ce5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:49:03.231043 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6efb281-6aa4-4589-a016-02356fe3ce5e None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:49:03.231322 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6efb281-6aa4-4589-a016-02356fe3ce5e None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:49:03.231622 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6efb281-6aa4-4589-a016-02356fe3ce5e None admin] PATH_INFO: `/v3/services/placement` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:49:03.232260 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6efb281-6aa4-4589-a016-02356fe3ce5e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:49:03.233615 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6efb281-6aa4-4589-a016-02356fe3ce5e None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:49:03.244948 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-f6efb281-6aa4-4589-a016-02356fe3ce5e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 11:49:03.244948 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:49:03.244948 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 11:49:03.244948 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 11:49:03.244948 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 11:49:03.244948 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 11:49:03.244948 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 11:49:03.244948 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:49:03.244948 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 11:49:03.244948 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:49:03.244948 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 11:49:03.244948 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:49:03.244948 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:49:03.244948 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:49:03.244948 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:49:03.244948 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:49:03.244948 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:49:03.245930 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:49:03.245930 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:49:03.245930 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:49:03.245930 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:49:03.245930 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:49:03.245930 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:49:03.245930 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 11:49:03.245930 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 11:49:03.245930 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 11:49:03.245930 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 11:49:03.245930 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:49:03.245930 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:49:03.245930 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:49:03.245930 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:49:03.245930 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:49:03.245930 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:49:03.246846 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:49:03.246846 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:49:03.246846 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:49:03.246846 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:49:03.246846 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:49:03.246846 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:49:03.246846 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:49:03.246846 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:49:03.246846 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:49:03.246846 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:49:03.246846 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 11:49:03.246846 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:49:03.246846 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 11:49:03.246846 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:49:03.246846 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 656/1298] 10.222.0.15 () {56 vars in 1117 bytes} [Fri Jun 3 11:49:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:49:03.252034 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed46a908-f232-4a07-b99c-881bcae346f6 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:49:03.269968 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:49:03.347484 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed46a908-f232-4a07-b99c-881bcae346f6 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:49:03.379886 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0056791-0828-4818-934a-1d79a553db32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:49:03.380539 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0056791-0828-4818-934a-1d79a553db32 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:49:03.380823 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0056791-0828-4818-934a-1d79a553db32 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:49:03.381098 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0056791-0828-4818-934a-1d79a553db32 None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:49:03.381796 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0056791-0828-4818-934a-1d79a553db32 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:49:03.382100 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0056791-0828-4818-934a-1d79a553db32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:49:03.383459 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0056791-0828-4818-934a-1d79a553db32 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:49:03.389101 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 643/1299] 10.222.0.15 () {56 vars in 1116 bytes} [Fri Jun 3 11:49:03 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:49:03.394963 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6efb281-6aa4-4589-a016-02356fe3ce5e None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:49:03.426223 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:49:03.492480 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6efb281-6aa4-4589-a016-02356fe3ce5e None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:49:03.524071 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7a0e9-174d-48d8-ab7a-692b5cca6b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:49:03.524707 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7a0e9-174d-48d8-ab7a-692b5cca6b55 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:49:03.524992 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7a0e9-174d-48d8-ab7a-692b5cca6b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:49:03.525266 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7a0e9-174d-48d8-ab7a-692b5cca6b55 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:49:03.526043 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa7a0e9-174d-48d8-ab7a-692b5cca6b55 None admin] RBAC: Adding query filter params (interface=public, service_id=2bfb4a2f9fe6412f8797dfd03fb8a216, region_id=RegionOne) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:49:03.526352 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa7a0e9-174d-48d8-ab7a-692b5cca6b55 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:49:03.528500 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa7a0e9-174d-48d8-ab7a-692b5cca6b55 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:49:03.533378 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 657/1300] 10.222.0.15 () {56 vars in 1251 bytes} [Fri Jun 3 11:49:03 2022] GET /identity/v3/endpoints?service_id=2bfb4a2f9fe6412f8797dfd03fb8a216&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:49:03.538707 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0056791-0828-4818-934a-1d79a553db32 None admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:49:03.617763 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:49:03.635463 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0056791-0828-4818-934a-1d79a553db32 None admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:49:03.668930 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ea2de-b979-4863-bca9-24df1a8ba499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:49:03.669569 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ea2de-b979-4863-bca9-24df1a8ba499 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:49:03.669853 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ea2de-b979-4863-bca9-24df1a8ba499 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:49:03.670128 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ea2de-b979-4863-bca9-24df1a8ba499 None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:49:03.670798 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ea2de-b979-4863-bca9-24df1a8ba499 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:49:03.672175 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ea2de-b979-4863-bca9-24df1a8ba499 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:49:03.678742 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 644/1301] 10.222.0.15 () {56 vars in 1087 bytes} [Fri Jun 3 11:49:03 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:49:05.893179 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c5efe-c606-4697-97b6-e430f8cc8b73 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:49:05.893706 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c5efe-c606-4697-97b6-e430f8cc8b73 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:49:05.893821 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c5efe-c606-4697-97b6-e430f8cc8b73 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:49:05.895141 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 658/1302] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:49:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:49:05.900608 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd828a22-8a5a-45d9-bf3b-d7f552d3da4a None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:49:05.900968 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd828a22-8a5a-45d9-bf3b-d7f552d3da4a None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:49:05.901175 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd828a22-8a5a-45d9-bf3b-d7f552d3da4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:49:05.917719 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-dd828a22-8a5a-45d9-bf3b-d7f552d3da4a None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:49:05.918895 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-dd828a22-8a5a-45d9-bf3b-d7f552d3da4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:49:05.983360 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 645/1303] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:49:05 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 03 11:49:06.006439 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c5efe-c606-4697-97b6-e430f8cc8b73 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:49:06.100353 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:49:06.108237 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c5efe-c606-4697-97b6-e430f8cc8b73 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:49:06.140951 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ba6b6-bdcd-4f55-adae-bd37ba02c5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:49:06.141732 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ba6b6-bdcd-4f55-adae-bd37ba02c5e7 None admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:49:06.142016 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ba6b6-bdcd-4f55-adae-bd37ba02c5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:49:06.142292 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ba6b6-bdcd-4f55-adae-bd37ba02c5e7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:49:06.142940 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ba6b6-bdcd-4f55-adae-bd37ba02c5e7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:49:06.144391 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ba6b6-bdcd-4f55-adae-bd37ba02c5e7 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:49:06.156284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application [None req-058ba6b6-bdcd-4f55-adae-bd37ba02c5e7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 11:49:06.156284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:49:06.156284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 03 11:49:06.156284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 03 11:49:06.156284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 03 11:49:06.156284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 03 11:49:06.156284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 03 11:49:06.156284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:49:06.156284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 11:49:06.156284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:49:06.156284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 03 11:49:06.156284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:49:06.156284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 03 11:49:06.156284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 03 11:49:06.156284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 03 11:49:06.156284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 03 11:49:06.156284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 03 11:49:06.158696 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 03 11:49:06.158696 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 03 11:49:06.158696 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 03 11:49:06.158696 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 03 11:49:06.158696 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 03 11:49:06.158696 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 03 11:49:06.158696 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 03 11:49:06.158696 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 03 11:49:06.158696 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 03 11:49:06.158696 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 03 11:49:06.158696 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 03 11:49:06.158696 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 03 11:49:06.158696 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 03 11:49:06.158696 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 03 11:49:06.158696 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 03 11:49:06.158696 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.get_or_create( Jun 03 11:49:06.159824 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 03 11:49:06.159824 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application with Lock( Jun 03 11:49:06.159824 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 03 11:49:06.159824 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self._enter() Jun 03 11:49:06.159824 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 03 11:49:06.159824 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 03 11:49:06.159824 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 03 11:49:06.159824 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application return self.creator() Jun 03 11:49:06.159824 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 03 11:49:06.159824 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application created_value = creator( Jun 03 11:49:06.159824 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 03 11:49:06.159824 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 03 11:49:06.159824 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 03 11:49:06.159824 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: ERROR keystone.server.flask.application Jun 03 11:49:06.159824 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 659/1304] 10.222.0.15 () {56 vars in 1117 bytes} [Fri Jun 3 11:49:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 03 11:49:06.163572 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd828a22-8a5a-45d9-bf3b-d7f552d3da4a None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:49:06.237926 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:49:06.261063 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd828a22-8a5a-45d9-bf3b-d7f552d3da4a None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:49:06.294067 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb6673-3815-47d1-bf3a-15f636455759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:49:06.294712 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb6673-3815-47d1-bf3a-15f636455759 None admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:49:06.294998 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb6673-3815-47d1-bf3a-15f636455759 None admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:49:06.295280 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb6673-3815-47d1-bf3a-15f636455759 None admin] PATH_INFO: `/v3/services` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:49:06.296013 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb6673-3815-47d1-bf3a-15f636455759 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:49:06.296327 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb6673-3815-47d1-bf3a-15f636455759 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:49:06.297690 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb6673-3815-47d1-bf3a-15f636455759 None admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:49:06.302709 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 646/1305] 10.222.0.15 () {56 vars in 1116 bytes} [Fri Jun 3 11:49:06 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:49:06.308295 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ba6b6-bdcd-4f55-adae-bd37ba02c5e7 None admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:49:06.405758 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ba6b6-bdcd-4f55-adae-bd37ba02c5e7 None admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:49:06.438047 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d664d5-d362-4963-a874-f59bb64972c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:49:06.438689 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d664d5-d362-4963-a874-f59bb64972c7 None admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:49:06.438967 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d664d5-d362-4963-a874-f59bb64972c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:49:06.439239 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d664d5-d362-4963-a874-f59bb64972c7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:49:06.440002 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d664d5-d362-4963-a874-f59bb64972c7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:49:06.441346 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d664d5-d362-4963-a874-f59bb64972c7 None admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:49:06.458377 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 660/1306] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Jun 3 11:49:06 2022] POST /identity/v3/endpoints => generated 331 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 11:49:16.300326 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=30 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:49:16.454688 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:50:09.579092 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a8b28-63eb-40ed-8151-7ea7a91bf7e3 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:50:09.579617 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a8b28-63eb-40ed-8151-7ea7a91bf7e3 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:50:09.580339 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a8b28-63eb-40ed-8151-7ea7a91bf7e3 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:50:09.581783 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 647/1307] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:50:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:50:09.587409 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288aa3fc-8887-4b88-91cd-8392e1f96925 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:50:09.588239 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288aa3fc-8887-4b88-91cd-8392e1f96925 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:50:09.588682 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288aa3fc-8887-4b88-91cd-8392e1f96925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:50:09.664232 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-288aa3fc-8887-4b88-91cd-8392e1f96925 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:50:09.665859 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-288aa3fc-8887-4b88-91cd-8392e1f96925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:50:09.835663 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 661/1308] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:50:09.903070 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec7d42-a229-4df2-9f33-f105aa2df8c3 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:50:09.904499 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec7d42-a229-4df2-9f33-f105aa2df8c3 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:50:09.904499 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec7d42-a229-4df2-9f33-f105aa2df8c3 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:50:09.906118 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 648/1309] 10.222.0.15 () {54 vars in 964 bytes} [Fri Jun 3 11:50:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:50:09.912634 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fbc3f-eabd-4324-9582-77e6193e915d None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:50:09.912941 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fbc3f-eabd-4324-9582-77e6193e915d None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:50:09.913203 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fbc3f-eabd-4324-9582-77e6193e915d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:50:10.018287 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-f71fbc3f-eabd-4324-9582-77e6193e915d None None] MFA Rules not processed for user `a78b4284099546cd9c126a5739380b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:50:10.019846 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-f71fbc3f-eabd-4324-9582-77e6193e915d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:50:10.054514 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:50:10.117943 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 662/1310] 10.222.0.15 () {58 vars in 1061 bytes} [Fri Jun 3 11:50:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:50:10.127582 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec7d42-a229-4df2-9f33-f105aa2df8c3 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:50:10.129335 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-c7ec7d42-a229-4df2-9f33-f105aa2df8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:50:10.248869 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec7d42-a229-4df2-9f33-f105aa2df8c3 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:50:10.329954 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bfff83-983f-4bda-9942-f95e4702918c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:50:10.330794 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfff83-983f-4bda-9942-f95e4702918c service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:50:10.331087 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfff83-983f-4bda-9942-f95e4702918c service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:50:10.331365 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfff83-983f-4bda-9942-f95e4702918c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:50:10.333168 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-65bfff83-983f-4bda-9942-f95e4702918c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:50:10.390728 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:50:10.450173 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bfff83-983f-4bda-9942-f95e4702918c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:50:10.451644 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bfff83-983f-4bda-9942-f95e4702918c service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:50:10.471530 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 649/1311] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:50:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:50:12.975601 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a51e30-3dfa-43a1-bcaa-01a34c938d59 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:50:12.976068 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a51e30-3dfa-43a1-bcaa-01a34c938d59 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:50:12.976164 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a51e30-3dfa-43a1-bcaa-01a34c938d59 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:50:12.977674 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 663/1312] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 11:50:12.983230 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbeba3-31a8-4ada-9642-7f4ab746e71a None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:50:12.983717 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbeba3-31a8-4ada-9642-7f4ab746e71a None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:50:12.983822 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbeba3-31a8-4ada-9642-7f4ab746e71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:50:13.066219 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-1bfbeba3-31a8-4ada-9642-7f4ab746e71a None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:50:13.067539 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-1bfbeba3-31a8-4ada-9642-7f4ab746e71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:50:13.165714 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 650/1313] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:50:13.203471 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a51e30-3dfa-43a1-bcaa-01a34c938d59 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:50:13.205071 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-70a51e30-3dfa-43a1-bcaa-01a34c938d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:50:13.310809 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a51e30-3dfa-43a1-bcaa-01a34c938d59 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:50:13.389740 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:50:13.392539 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f62fa6-7e4d-406c-b106-2a799c356190 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:50:13.393381 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f62fa6-7e4d-406c-b106-2a799c356190 service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:50:13.393837 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f62fa6-7e4d-406c-b106-2a799c356190 service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:50:13.394294 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f62fa6-7e4d-406c-b106-2a799c356190 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:50:13.395981 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-66f62fa6-7e4d-406c-b106-2a799c356190 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:50:13.505939 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f62fa6-7e4d-406c-b106-2a799c356190 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:50:13.507392 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f62fa6-7e4d-406c-b106-2a799c356190 service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:50:13.528462 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 664/1314] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:50:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 11:50:16.100866 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904be3c-1b70-42de-ab62-1add8effc113 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:50:16.101457 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904be3c-1b70-42de-ab62-1add8effc113 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:50:16.101457 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904be3c-1b70-42de-ab62-1add8effc113 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:50:16.102811 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 651/1315] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:50:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:50:16.108725 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8becf70-dd35-4849-9a32-9007d834a54c None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:50:16.109229 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8becf70-dd35-4849-9a32-9007d834a54c None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:50:16.109332 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8becf70-dd35-4849-9a32-9007d834a54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:50:16.179663 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-c8becf70-dd35-4849-9a32-9007d834a54c None None] MFA Rules not processed for user `54ceb1595a2943459ed05f05f288a335`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:50:16.180835 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-c8becf70-dd35-4849-9a32-9007d834a54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:50:16.238327 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:50:16.285807 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 665/1316] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:50:16 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:50:16.325896 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904be3c-1b70-42de-ab62-1add8effc113 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:50:16.327491 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-5904be3c-1b70-42de-ab62-1add8effc113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:50:16.337690 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:50:16.433602 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904be3c-1b70-42de-ab62-1add8effc113 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:50:16.506019 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2cb895-8a8a-4364-83e4-7c88aede2c74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:50:16.506667 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cb895-8a8a-4364-83e4-7c88aede2c74 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:50:16.506949 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cb895-8a8a-4364-83e4-7c88aede2c74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:50:16.507226 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cb895-8a8a-4364-83e4-7c88aede2c74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:50:16.508926 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-7b2cb895-8a8a-4364-83e4-7c88aede2c74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:50:16.573236 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:50:16.626508 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2cb895-8a8a-4364-83e4-7c88aede2c74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:50:16.627980 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2cb895-8a8a-4364-83e4-7c88aede2c74 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:50:16.646381 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 652/1317] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:50:16 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:50:19.418177 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b7de0-4ab6-4288-a7d3-68036b333f4f None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:50:19.418715 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b7de0-4ab6-4288-a7d3-68036b333f4f None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:50:19.418715 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b7de0-4ab6-4288-a7d3-68036b333f4f None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:50:19.420116 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 666/1318] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:50:19.425331 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9b0e7-cfd9-4990-8c03-14c2228caa1b None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:50:19.425768 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9b0e7-cfd9-4990-8c03-14c2228caa1b None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:50:19.425878 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9b0e7-cfd9-4990-8c03-14c2228caa1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:50:19.489975 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-7eb9b0e7-cfd9-4990-8c03-14c2228caa1b None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:50:19.491166 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-7eb9b0e7-cfd9-4990-8c03-14c2228caa1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:50:19.588571 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 653/1319] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:50:19 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:50:19.628120 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b7de0-4ab6-4288-a7d3-68036b333f4f None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:50:19.629660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-221b7de0-4ab6-4288-a7d3-68036b333f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:50:19.729452 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b7de0-4ab6-4288-a7d3-68036b333f4f None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:50:19.800791 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb17a45-1dd6-4b80-b833-0a69e77387be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:50:19.801438 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb17a45-1dd6-4b80-b833-0a69e77387be service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:50:19.801721 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb17a45-1dd6-4b80-b833-0a69e77387be service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:50:19.801995 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb17a45-1dd6-4b80-b833-0a69e77387be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:50:19.803674 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-adb17a45-1dd6-4b80-b833-0a69e77387be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:50:19.812556 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:50:19.919000 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb17a45-1dd6-4b80-b833-0a69e77387be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:50:19.920466 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb17a45-1dd6-4b80-b833-0a69e77387be service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:50:19.937821 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 667/1320] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:50:19 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:50:22.826133 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01778a53-8769-4195-9923-9b83b360559a None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:50:22.826704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01778a53-8769-4195-9923-9b83b360559a None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:50:22.826704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01778a53-8769-4195-9923-9b83b360559a None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:50:22.828084 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 654/1321] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:50:22.833449 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef53f3e-c240-40b4-9675-2e0c651ec4bb None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:50:22.833827 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef53f3e-c240-40b4-9675-2e0c651ec4bb None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:50:22.834004 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef53f3e-c240-40b4-9675-2e0c651ec4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:50:22.900568 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-bef53f3e-c240-40b4-9675-2e0c651ec4bb None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:50:22.902181 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-bef53f3e-c240-40b4-9675-2e0c651ec4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:50:22.959903 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:50:22.999159 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 668/1322] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:50:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:50:23.034688 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01778a53-8769-4195-9923-9b83b360559a None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:50:23.036260 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-01778a53-8769-4195-9923-9b83b360559a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:50:23.056164 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:50:23.140810 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01778a53-8769-4195-9923-9b83b360559a None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:50:23.217041 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344e9c6-6684-4f0e-95ed-d9e15e4c8fa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:50:23.217682 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344e9c6-6684-4f0e-95ed-d9e15e4c8fa2 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:50:23.217968 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344e9c6-6684-4f0e-95ed-d9e15e4c8fa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:50:23.218260 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344e9c6-6684-4f0e-95ed-d9e15e4c8fa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:50:23.219903 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-4344e9c6-6684-4f0e-95ed-d9e15e4c8fa2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:50:23.292248 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:50:23.330637 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344e9c6-6684-4f0e-95ed-d9e15e4c8fa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:50:23.332105 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344e9c6-6684-4f0e-95ed-d9e15e4c8fa2 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:50:23.350990 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 655/1323] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:50:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:50:25.653563 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15955871-cf9b-4e25-9879-15de981441c9 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:50:25.654005 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15955871-cf9b-4e25-9879-15de981441c9 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:50:25.654130 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15955871-cf9b-4e25-9879-15de981441c9 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:50:25.655543 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 669/1324] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:50:25.660962 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27fb4d-2ab6-4d67-a208-584ef9ffced9 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:50:25.661382 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27fb4d-2ab6-4d67-a208-584ef9ffced9 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:50:25.661521 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27fb4d-2ab6-4d67-a208-584ef9ffced9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:50:25.725694 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-eb27fb4d-2ab6-4d67-a208-584ef9ffced9 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:50:25.726873 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-eb27fb4d-2ab6-4d67-a208-584ef9ffced9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:50:25.821782 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 656/1325] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:50:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:50:25.872509 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a0db5-3552-47e9-974e-b223d41844d9 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:50:25.872796 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a0db5-3552-47e9-974e-b223d41844d9 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:50:25.873071 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a0db5-3552-47e9-974e-b223d41844d9 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:50:25.874429 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 670/1326] 10.222.0.15 () {54 vars in 964 bytes} [Fri Jun 3 11:50:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 11:50:25.880811 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29757fc7-4442-4af4-9819-bf9d52c9cabb None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:50:25.881188 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29757fc7-4442-4af4-9819-bf9d52c9cabb None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:50:25.881473 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29757fc7-4442-4af4-9819-bf9d52c9cabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:50:25.912881 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:50:25.956908 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-29757fc7-4442-4af4-9819-bf9d52c9cabb None None] MFA Rules not processed for user `a78b4284099546cd9c126a5739380b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:50:25.958094 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-29757fc7-4442-4af4-9819-bf9d52c9cabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:50:26.033885 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 657/1327] 10.222.0.15 () {58 vars in 1061 bytes} [Fri Jun 3 11:50:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:50:26.043514 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a0db5-3552-47e9-974e-b223d41844d9 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:50:26.045108 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-0d6a0db5-3552-47e9-974e-b223d41844d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:50:26.144903 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a0db5-3552-47e9-974e-b223d41844d9 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:50:26.218704 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a36bdcf-7bfb-4118-98ba-9e4068801c24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:50:26.219274 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36bdcf-7bfb-4118-98ba-9e4068801c24 service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:50:26.219583 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36bdcf-7bfb-4118-98ba-9e4068801c24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:50:26.219858 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36bdcf-7bfb-4118-98ba-9e4068801c24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:50:26.221503 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-5a36bdcf-7bfb-4118-98ba-9e4068801c24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:50:26.238892 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:50:26.331694 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a36bdcf-7bfb-4118-98ba-9e4068801c24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:50:26.333146 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a36bdcf-7bfb-4118-98ba-9e4068801c24 service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:50:26.351664 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 671/1328] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:50:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:50:28.868479 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351c792-0015-4989-a142-b3cf15a9608b None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:50:28.869007 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351c792-0015-4989-a142-b3cf15a9608b None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:50:28.869101 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351c792-0015-4989-a142-b3cf15a9608b None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:50:28.870962 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 658/1329] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:50:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:50:28.876472 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d209f-ef0a-41f5-85d8-7a18167c15a2 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:50:28.876923 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d209f-ef0a-41f5-85d8-7a18167c15a2 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:50:28.877171 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d209f-ef0a-41f5-85d8-7a18167c15a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:50:29.071551 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-ac6d209f-ef0a-41f5-85d8-7a18167c15a2 None None] MFA Rules not processed for user `54ceb1595a2943459ed05f05f288a335`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:50:29.072765 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-ac6d209f-ef0a-41f5-85d8-7a18167c15a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:50:29.136574 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:50:29.168368 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 672/1330] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:50:28 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:50:29.205243 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351c792-0015-4989-a142-b3cf15a9608b None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:50:29.206766 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-6351c792-0015-4989-a142-b3cf15a9608b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:50:29.309220 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351c792-0015-4989-a142-b3cf15a9608b None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:50:29.330003 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:50:29.383786 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19edc5a1-d16b-4332-a44c-1d384deed407 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:50:29.384436 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edc5a1-d16b-4332-a44c-1d384deed407 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:50:29.384720 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edc5a1-d16b-4332-a44c-1d384deed407 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:50:29.384995 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edc5a1-d16b-4332-a44c-1d384deed407 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:50:29.387290 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-19edc5a1-d16b-4332-a44c-1d384deed407 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:50:29.497016 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19edc5a1-d16b-4332-a44c-1d384deed407 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:50:29.498502 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19edc5a1-d16b-4332-a44c-1d384deed407 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:50:29.518258 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 659/1331] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:50:29 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:50:31.994510 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29941e92-11c9-48bd-a8e0-e2b23ceecfaf None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:50:31.995639 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29941e92-11c9-48bd-a8e0-e2b23ceecfaf None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:50:31.995639 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29941e92-11c9-48bd-a8e0-e2b23ceecfaf None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:50:31.997010 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 673/1332] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:50:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:50:32.002215 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27894716-99ca-42b3-a33e-5c610c54f72d None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:50:32.002662 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27894716-99ca-42b3-a33e-5c610c54f72d None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:50:32.002759 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27894716-99ca-42b3-a33e-5c610c54f72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:50:32.064906 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:50:32.068113 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-27894716-99ca-42b3-a33e-5c610c54f72d None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:50:32.069516 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-27894716-99ca-42b3-a33e-5c610c54f72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:50:32.170104 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 660/1333] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:50:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 11:50:32.206398 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29941e92-11c9-48bd-a8e0-e2b23ceecfaf None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:50:32.207999 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-29941e92-11c9-48bd-a8e0-e2b23ceecfaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:50:32.317215 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29941e92-11c9-48bd-a8e0-e2b23ceecfaf None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:50:32.393561 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388c9a1-06d9-43ad-a887-46be0762b794 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:50:32.394221 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388c9a1-06d9-43ad-a887-46be0762b794 service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:50:32.394513 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388c9a1-06d9-43ad-a887-46be0762b794 service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:50:32.394792 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388c9a1-06d9-43ad-a887-46be0762b794 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:50:32.396475 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-4388c9a1-06d9-43ad-a887-46be0762b794 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:50:32.423688 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:50:32.506608 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4388c9a1-06d9-43ad-a887-46be0762b794 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:50:32.508094 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4388c9a1-06d9-43ad-a887-46be0762b794 service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:50:32.526084 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 674/1334] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:50:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:50:34.804562 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844fde6-f33b-4966-81d9-ef8b58457eef None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:50:34.805124 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844fde6-f33b-4966-81d9-ef8b58457eef None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:50:34.805124 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844fde6-f33b-4966-81d9-ef8b58457eef None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:50:34.806486 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 661/1335] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:50:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:50:34.811602 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb74971-4db1-4475-9072-b6d5dd91c95c None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:50:34.812012 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb74971-4db1-4475-9072-b6d5dd91c95c None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:50:34.812170 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb74971-4db1-4475-9072-b6d5dd91c95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:50:34.875595 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-dbb74971-4db1-4475-9072-b6d5dd91c95c None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:50:34.876782 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-dbb74971-4db1-4475-9072-b6d5dd91c95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:50:34.952676 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:50:34.974389 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 675/1336] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:50:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:50:35.014342 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844fde6-f33b-4966-81d9-ef8b58457eef None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:50:35.015959 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-c844fde6-f33b-4966-81d9-ef8b58457eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:50:35.116704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844fde6-f33b-4966-81d9-ef8b58457eef None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:50:35.145153 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:50:35.189480 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a36af-5bfd-4a9a-8ca6-96e6e43ffe24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:50:35.190123 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a36af-5bfd-4a9a-8ca6-96e6e43ffe24 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:50:35.190408 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a36af-5bfd-4a9a-8ca6-96e6e43ffe24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:50:35.190684 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a36af-5bfd-4a9a-8ca6-96e6e43ffe24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:50:35.192341 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-c02a36af-5bfd-4a9a-8ca6-96e6e43ffe24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:50:35.298595 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a36af-5bfd-4a9a-8ca6-96e6e43ffe24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:50:35.300059 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a36af-5bfd-4a9a-8ca6-96e6e43ffe24 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:50:35.319569 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 662/1337] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:50:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:50:37.900897 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74b6de-d189-4225-8675-1b9baf5f5066 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:50:37.901294 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74b6de-d189-4225-8675-1b9baf5f5066 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:50:37.901400 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74b6de-d189-4225-8675-1b9baf5f5066 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:50:37.903018 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 676/1338] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:50:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:50:37.908403 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3401c6-51a4-474c-8749-c64b766c5b81 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:50:37.908808 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3401c6-51a4-474c-8749-c64b766c5b81 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:50:37.908948 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3401c6-51a4-474c-8749-c64b766c5b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:50:37.971577 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-9d3401c6-51a4-474c-8749-c64b766c5b81 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:50:37.972756 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-9d3401c6-51a4-474c-8749-c64b766c5b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:50:37.980804 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:50:38.069207 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 663/1339] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:50:37 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:50:38.104888 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74b6de-d189-4225-8675-1b9baf5f5066 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:50:38.106443 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-2c74b6de-d189-4225-8675-1b9baf5f5066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:50:38.208235 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74b6de-d189-4225-8675-1b9baf5f5066 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:50:38.279116 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178ecdf-bb43-447a-a8f0-f91d473ebf24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:50:38.279783 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178ecdf-bb43-447a-a8f0-f91d473ebf24 service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:50:38.280067 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178ecdf-bb43-447a-a8f0-f91d473ebf24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:50:38.280339 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178ecdf-bb43-447a-a8f0-f91d473ebf24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:50:38.281957 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-3178ecdf-bb43-447a-a8f0-f91d473ebf24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:50:38.317346 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:50:38.390612 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3178ecdf-bb43-447a-a8f0-f91d473ebf24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:50:38.392099 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3178ecdf-bb43-447a-a8f0-f91d473ebf24 service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:50:38.410787 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 677/1340] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:50:38 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 11:50:42.555820 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefe9a3-6afa-40b4-8365-5772b9ffc2af None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:50:42.556388 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefe9a3-6afa-40b4-8365-5772b9ffc2af None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:50:42.556388 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefe9a3-6afa-40b4-8365-5772b9ffc2af None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:50:42.558336 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 664/1341] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:50:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:50:42.563545 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00026669-94ba-4d75-a829-2539f7cbb3fe None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:50:42.564002 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00026669-94ba-4d75-a829-2539f7cbb3fe None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:50:42.564112 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00026669-94ba-4d75-a829-2539f7cbb3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:50:42.635801 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-00026669-94ba-4d75-a829-2539f7cbb3fe None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:50:42.636969 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-00026669-94ba-4d75-a829-2539f7cbb3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:50:42.728739 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:50:42.741758 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 678/1342] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:50:42.780705 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceefe9a3-6afa-40b4-8365-5772b9ffc2af None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:50:42.782775 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-ceefe9a3-6afa-40b4-8365-5772b9ffc2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:50:42.878996 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceefe9a3-6afa-40b4-8365-5772b9ffc2af None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:50:42.882614 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc466b1-9fd2-440e-8c3e-c3c36e857eef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:50:42.883256 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc466b1-9fd2-440e-8c3e-c3c36e857eef service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:50:42.883582 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc466b1-9fd2-440e-8c3e-c3c36e857eef service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:50:42.883862 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc466b1-9fd2-440e-8c3e-c3c36e857eef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:50:42.893270 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc466b1-9fd2-440e-8c3e-c3c36e857eef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:50:42.894718 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc466b1-9fd2-440e-8c3e-c3c36e857eef service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:50:42.905502 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 665/1343] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:50:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:50:45.782075 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8052bc-b7fb-431e-be1d-bba1b64dfcea None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:50:45.782593 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8052bc-b7fb-431e-be1d-bba1b64dfcea None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:50:45.782741 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8052bc-b7fb-431e-be1d-bba1b64dfcea None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:50:45.784490 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 679/1344] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:50:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:50:45.789887 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f959b6-8a17-4ccd-9172-2d6df14503bc None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:50:45.790321 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f959b6-8a17-4ccd-9172-2d6df14503bc None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:50:45.790428 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f959b6-8a17-4ccd-9172-2d6df14503bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:50:45.818801 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-84f959b6-8a17-4ccd-9172-2d6df14503bc None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:50:45.820001 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-84f959b6-8a17-4ccd-9172-2d6df14503bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:50:45.846673 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:50:45.899096 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 666/1345] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:50:45 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:50:45.935921 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8052bc-b7fb-431e-be1d-bba1b64dfcea None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:50:45.946323 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8052bc-b7fb-431e-be1d-bba1b64dfcea None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:50:45.949785 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a627916-9fa4-42a9-b312-ce24c779116f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:50:45.950413 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a627916-9fa4-42a9-b312-ce24c779116f service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:50:45.950692 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a627916-9fa4-42a9-b312-ce24c779116f service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:50:45.950965 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a627916-9fa4-42a9-b312-ce24c779116f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:50:45.959715 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a627916-9fa4-42a9-b312-ce24c779116f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:50:45.961134 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a627916-9fa4-42a9-b312-ce24c779116f service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:50:45.970448 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 680/1346] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:50:45 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:50:50.133835 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b50d5-717b-4b41-b913-d0791a1e2d8d None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:50:50.135001 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b50d5-717b-4b41-b913-d0791a1e2d8d None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:50:50.135001 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b50d5-717b-4b41-b913-d0791a1e2d8d None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:50:50.136333 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 667/1347] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:50:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:50:50.141479 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9ac2e-1b80-4499-a5ef-b8f712e0e474 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:50:50.141904 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9ac2e-1b80-4499-a5ef-b8f712e0e474 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:50:50.142055 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9ac2e-1b80-4499-a5ef-b8f712e0e474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:50:50.160282 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-a4d9ac2e-1b80-4499-a5ef-b8f712e0e474 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:50:50.161452 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-a4d9ac2e-1b80-4499-a5ef-b8f712e0e474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:50:50.169737 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 681/1348] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:50:50.206118 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b50d5-717b-4b41-b913-d0791a1e2d8d None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:50:50.217466 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b50d5-717b-4b41-b913-d0791a1e2d8d None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:50:50.221178 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89017a73-6dd4-4b4a-aba5-64c3c52262dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:50:50.221883 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89017a73-6dd4-4b4a-aba5-64c3c52262dc service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:50:50.222266 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89017a73-6dd4-4b4a-aba5-64c3c52262dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:50:50.222617 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89017a73-6dd4-4b4a-aba5-64c3c52262dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:50:50.232760 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89017a73-6dd4-4b4a-aba5-64c3c52262dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:50:50.234200 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89017a73-6dd4-4b4a-aba5-64c3c52262dc service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:50:50.243600 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 668/1349] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:50:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:50:55.655100 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a2a51-7649-4ab6-9284-6fe97b4b1a0b None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:50:55.656034 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a2a51-7649-4ab6-9284-6fe97b4b1a0b None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:50:55.656492 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a2a51-7649-4ab6-9284-6fe97b4b1a0b None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:50:55.658435 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 682/1350] 10.222.0.15 () {54 vars in 921 bytes} [Fri Jun 3 11:50:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 11:50:55.662985 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78daef-7c22-44ef-bffc-46384ea3b335 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:50:55.663376 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78daef-7c22-44ef-bffc-46384ea3b335 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:50:55.663617 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78daef-7c22-44ef-bffc-46384ea3b335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:50:55.861807 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-0b78daef-7c22-44ef-bffc-46384ea3b335 None None] MFA Rules not processed for user `eb5a91437dd64e2491ce41b4d12d4835`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:50:55.861807 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-0b78daef-7c22-44ef-bffc-46384ea3b335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:50:55.988430 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 669/1351] 10.222.0.15 () {58 vars in 1018 bytes} [Fri Jun 3 11:50:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:51:00.100580 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a096c2e-09a2-41dc-99b5-b311270bd088 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:00.101087 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a096c2e-09a2-41dc-99b5-b311270bd088 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:00.101168 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a096c2e-09a2-41dc-99b5-b311270bd088 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:00.103215 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 683/1352] 10.222.0.15 () {54 vars in 921 bytes} [Fri Jun 3 11:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:51:00.108549 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049a4c7-48bb-49ba-923c-7a34d314bfd3 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:00.109057 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049a4c7-48bb-49ba-923c-7a34d314bfd3 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:00.109315 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049a4c7-48bb-49ba-923c-7a34d314bfd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:00.129611 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-c049a4c7-48bb-49ba-923c-7a34d314bfd3 None None] MFA Rules not processed for user `eb5a91437dd64e2491ce41b4d12d4835`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:51:00.131125 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-c049a4c7-48bb-49ba-923c-7a34d314bfd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:51:00.141205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 670/1353] 10.222.0.15 () {58 vars in 1018 bytes} [Fri Jun 3 11:51:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:51:00.155194 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=13 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:51:01.691071 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f430c-170b-422a-a269-ee3f08bd89cd None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:01.691667 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f430c-170b-422a-a269-ee3f08bd89cd None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:01.691804 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f430c-170b-422a-a269-ee3f08bd89cd None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:01.693188 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 684/1354] 10.222.0.15 () {54 vars in 921 bytes} [Fri Jun 3 11:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:51:01.698815 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00d152-6452-45fe-8c45-06c2bb9bd175 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:01.699247 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00d152-6452-45fe-8c45-06c2bb9bd175 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:01.699362 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00d152-6452-45fe-8c45-06c2bb9bd175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:01.718259 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-ce00d152-6452-45fe-8c45-06c2bb9bd175 None None] MFA Rules not processed for user `eb5a91437dd64e2491ce41b4d12d4835`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:51:01.719450 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-ce00d152-6452-45fe-8c45-06c2bb9bd175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:51:01.728034 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 671/1355] 10.222.0.15 () {58 vars in 1018 bytes} [Fri Jun 3 11:51:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:51:05.576182 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6fef5-e8f5-4562-899e-445651c9d709 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:05.576721 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6fef5-e8f5-4562-899e-445651c9d709 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:05.576721 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6fef5-e8f5-4562-899e-445651c9d709 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:05.577974 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 685/1356] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:51:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:51:05.583284 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6cdee-28be-43c9-8c77-85494d8113e5 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:05.583734 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6cdee-28be-43c9-8c77-85494d8113e5 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:05.583971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6cdee-28be-43c9-8c77-85494d8113e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:05.602825 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-1ba6cdee-28be-43c9-8c77-85494d8113e5 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:51:05.604049 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-1ba6cdee-28be-43c9-8c77-85494d8113e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:51:05.612030 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 672/1357] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:51:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:51:05.674969 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f8cdc-5b9a-484d-96e9-8e16f0735279 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:05.676089 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f8cdc-5b9a-484d-96e9-8e16f0735279 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:05.676522 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f8cdc-5b9a-484d-96e9-8e16f0735279 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:05.678163 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 686/1358] 10.222.0.15 () {54 vars in 961 bytes} [Fri Jun 3 11:51:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:51:05.690665 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65440a05-b89b-4938-a9ff-bf7f613b07a9 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:05.691207 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65440a05-b89b-4938-a9ff-bf7f613b07a9 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:05.691787 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65440a05-b89b-4938-a9ff-bf7f613b07a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:05.739848 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:51:05.748308 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-65440a05-b89b-4938-a9ff-bf7f613b07a9 None None] MFA Rules not processed for user `6247bfb7aebd45eeb97ba5933be44c6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:51:05.749494 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-65440a05-b89b-4938-a9ff-bf7f613b07a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:51:05.836436 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 673/1359] 10.222.0.15 () {58 vars in 1058 bytes} [Fri Jun 3 11:51:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 11:51:05.844661 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f8cdc-5b9a-484d-96e9-8e16f0735279 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:51:05.860825 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f8cdc-5b9a-484d-96e9-8e16f0735279 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:51:05.866532 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778df3e2-c5ad-4c44-a2f4-44a3cd980593 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:51:05.867224 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778df3e2-c5ad-4c44-a2f4-44a3cd980593 service nova] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:05.867537 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778df3e2-c5ad-4c44-a2f4-44a3cd980593 service nova] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:05.867837 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778df3e2-c5ad-4c44-a2f4-44a3cd980593 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:05.877000 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778df3e2-c5ad-4c44-a2f4-44a3cd980593 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:51:05.878621 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778df3e2-c5ad-4c44-a2f4-44a3cd980593 service nova] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:51:05.888760 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 687/1360] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:51:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 11:51:08.348852 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedab264-c928-43a7-9d5b-5583ab6ca683 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:08.349428 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedab264-c928-43a7-9d5b-5583ab6ca683 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:08.349428 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedab264-c928-43a7-9d5b-5583ab6ca683 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:08.350920 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 674/1361] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:51:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:51:08.356829 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b7d49-a471-425e-97ef-cb012a9fe23b None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:08.357607 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b7d49-a471-425e-97ef-cb012a9fe23b None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:08.357908 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b7d49-a471-425e-97ef-cb012a9fe23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:08.378971 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-bc7b7d49-a471-425e-97ef-cb012a9fe23b None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:51:08.380489 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-bc7b7d49-a471-425e-97ef-cb012a9fe23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:51:08.391889 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 688/1362] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:51:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:51:08.433578 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedab264-c928-43a7-9d5b-5583ab6ca683 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:51:08.448455 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedab264-c928-43a7-9d5b-5583ab6ca683 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:51:08.454094 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ba41d-7c99-40c6-a183-d819ad172aa4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:51:08.454833 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ba41d-7c99-40c6-a183-d819ad172aa4 service nova] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:08.455224 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ba41d-7c99-40c6-a183-d819ad172aa4 service nova] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:08.455655 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ba41d-7c99-40c6-a183-d819ad172aa4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:08.464172 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ba41d-7c99-40c6-a183-d819ad172aa4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:51:08.465888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ba41d-7c99-40c6-a183-d819ad172aa4 service nova] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:51:08.476336 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 675/1363] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:51:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:51:11.041998 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8162a-4ba4-46f7-96b2-a893523e7369 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:11.042497 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8162a-4ba4-46f7-96b2-a893523e7369 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:11.042578 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8162a-4ba4-46f7-96b2-a893523e7369 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:11.043938 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 689/1364] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:51:11.049692 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4752d-f979-44c5-90f8-983c3e089450 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:11.050152 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4752d-f979-44c5-90f8-983c3e089450 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:11.050248 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4752d-f979-44c5-90f8-983c3e089450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:11.068406 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-37d4752d-f979-44c5-90f8-983c3e089450 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:51:11.069641 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-37d4752d-f979-44c5-90f8-983c3e089450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:51:11.077448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 676/1365] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:51:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:51:11.122001 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b0ce0-6c84-4bde-9267-eb1cae8dc696 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:11.122315 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b0ce0-6c84-4bde-9267-eb1cae8dc696 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:11.122592 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b0ce0-6c84-4bde-9267-eb1cae8dc696 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:11.123976 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 690/1366] 10.222.0.15 () {54 vars in 961 bytes} [Fri Jun 3 11:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:51:11.129589 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3a2a8-ecd1-4f1d-8adf-298ed066e89c None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:11.129879 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3a2a8-ecd1-4f1d-8adf-298ed066e89c None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:11.130160 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3a2a8-ecd1-4f1d-8adf-298ed066e89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:11.148332 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-8fd3a2a8-ecd1-4f1d-8adf-298ed066e89c None None] MFA Rules not processed for user `6247bfb7aebd45eeb97ba5933be44c6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:51:11.150066 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-8fd3a2a8-ecd1-4f1d-8adf-298ed066e89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:51:11.159646 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 677/1367] 10.222.0.15 () {58 vars in 1058 bytes} [Fri Jun 3 11:51:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 11:51:11.168276 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b0ce0-6c84-4bde-9267-eb1cae8dc696 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:51:11.182324 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b0ce0-6c84-4bde-9267-eb1cae8dc696 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:51:11.187671 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7760843a-f64a-4d4e-a31a-6a7299a3ae01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:51:11.188385 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760843a-f64a-4d4e-a31a-6a7299a3ae01 service nova] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:11.188727 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760843a-f64a-4d4e-a31a-6a7299a3ae01 service nova] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:11.189064 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760843a-f64a-4d4e-a31a-6a7299a3ae01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:11.197073 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7760843a-f64a-4d4e-a31a-6a7299a3ae01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:51:11.198634 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7760843a-f64a-4d4e-a31a-6a7299a3ae01 service nova] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:51:11.207997 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 691/1368] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:51:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:51:13.522284 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfe9b8-146a-48b6-8e91-9dd786031c58 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:13.522899 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfe9b8-146a-48b6-8e91-9dd786031c58 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:13.522899 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfe9b8-146a-48b6-8e91-9dd786031c58 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:13.524796 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 678/1369] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:51:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:51:13.530480 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a269fa5-27cf-49cd-bd23-8452f41f2b3d None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:13.530919 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a269fa5-27cf-49cd-bd23-8452f41f2b3d None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:13.531016 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a269fa5-27cf-49cd-bd23-8452f41f2b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:13.550043 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-6a269fa5-27cf-49cd-bd23-8452f41f2b3d None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:51:13.551226 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-6a269fa5-27cf-49cd-bd23-8452f41f2b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:51:13.559448 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 692/1370] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:51:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:51:13.603949 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cfe9b8-146a-48b6-8e91-9dd786031c58 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:51:13.619485 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cfe9b8-146a-48b6-8e91-9dd786031c58 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:51:13.625064 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6de89-f05d-4f67-80af-885c3b7869d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:51:13.625935 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6de89-f05d-4f67-80af-885c3b7869d1 service nova] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:13.626217 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6de89-f05d-4f67-80af-885c3b7869d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:13.626488 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6de89-f05d-4f67-80af-885c3b7869d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:13.637041 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b6de89-f05d-4f67-80af-885c3b7869d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:51:13.638991 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b6de89-f05d-4f67-80af-885c3b7869d1 service nova] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:51:13.650601 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 679/1371] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:51:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:51:13.793422 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cb629-4a62-4f8f-aaa3-cbdac436887f None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:13.793631 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cb629-4a62-4f8f-aaa3-cbdac436887f None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:13.793875 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cb629-4a62-4f8f-aaa3-cbdac436887f None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:13.796947 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 693/1372] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:51:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:51:13.801682 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abc427-635f-433f-85fc-c4dac1af18dd None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:13.801971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abc427-635f-433f-85fc-c4dac1af18dd None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:13.802432 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abc427-635f-433f-85fc-c4dac1af18dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:13.822359 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-83abc427-635f-433f-85fc-c4dac1af18dd None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:51:13.823627 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-83abc427-635f-433f-85fc-c4dac1af18dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:51:13.832536 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 680/1373] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:51:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:51:14.142611 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ec12d-d2a1-4a22-984d-5ff0ba9589e5 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:14.142611 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ec12d-d2a1-4a22-984d-5ff0ba9589e5 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:14.142611 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ec12d-d2a1-4a22-984d-5ff0ba9589e5 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:14.144810 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 694/1374] 10.222.0.15 () {54 vars in 963 bytes} [Fri Jun 3 11:51:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:51:14.148598 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45249a-5a5b-4561-a0bf-8d2fc680a633 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:14.148926 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45249a-5a5b-4561-a0bf-8d2fc680a633 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:14.149212 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45249a-5a5b-4561-a0bf-8d2fc680a633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:14.199972 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-6d45249a-5a5b-4561-a0bf-8d2fc680a633 None None] MFA Rules not processed for user `978c834f137a4a6ab83a54af0239c137`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:51:14.201182 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-6d45249a-5a5b-4561-a0bf-8d2fc680a633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:51:14.271678 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 681/1375] 10.222.0.15 () {58 vars in 1060 bytes} [Fri Jun 3 11:51:14 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:51:14.278612 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ec12d-d2a1-4a22-984d-5ff0ba9589e5 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:51:14.290625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ec12d-d2a1-4a22-984d-5ff0ba9589e5 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:51:14.294336 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bd571-9d08-495e-8050-a2daeb31b46b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:51:14.295042 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bd571-9d08-495e-8050-a2daeb31b46b service cinder] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:14.295396 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bd571-9d08-495e-8050-a2daeb31b46b service cinder] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:14.295778 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bd571-9d08-495e-8050-a2daeb31b46b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:14.306822 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7bd571-9d08-495e-8050-a2daeb31b46b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:51:14.308363 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7bd571-9d08-495e-8050-a2daeb31b46b service cinder] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:51:14.319111 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 695/1376] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:51:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:51:15.942189 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab31b66-4bbe-4144-9e20-a45d220a48f5 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:15.942702 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab31b66-4bbe-4144-9e20-a45d220a48f5 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:15.942964 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab31b66-4bbe-4144-9e20-a45d220a48f5 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:15.944372 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 682/1377] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:51:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:51:15.949665 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56795f53-a4aa-4f2a-ba30-8da82c0324c7 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:15.950100 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56795f53-a4aa-4f2a-ba30-8da82c0324c7 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:15.950198 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56795f53-a4aa-4f2a-ba30-8da82c0324c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:15.967884 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-56795f53-a4aa-4f2a-ba30-8da82c0324c7 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:51:15.969066 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-56795f53-a4aa-4f2a-ba30-8da82c0324c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:51:15.977503 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 696/1378] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:51:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:51:16.022765 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab31b66-4bbe-4144-9e20-a45d220a48f5 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:51:16.038676 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab31b66-4bbe-4144-9e20-a45d220a48f5 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:51:16.045320 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e9852-5bd6-48a4-81ba-b4755da4f070 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:51:16.045985 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e9852-5bd6-48a4-81ba-b4755da4f070 service nova] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:16.046269 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e9852-5bd6-48a4-81ba-b4755da4f070 service nova] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:16.046551 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e9852-5bd6-48a4-81ba-b4755da4f070 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:16.055982 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440e9852-5bd6-48a4-81ba-b4755da4f070 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:51:16.057603 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440e9852-5bd6-48a4-81ba-b4755da4f070 service nova] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:51:16.061961 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:51:16.069567 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 683/1379] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:51:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:51:18.368347 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d86996-f2c3-4c87-b4b5-fb52db927143 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:18.368908 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d86996-f2c3-4c87-b4b5-fb52db927143 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:18.368908 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d86996-f2c3-4c87-b4b5-fb52db927143 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:18.370275 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 697/1380] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:51:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:51:18.375623 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208986b-eb19-48eb-a183-2afb8c10f331 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:18.376059 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208986b-eb19-48eb-a183-2afb8c10f331 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:18.376185 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208986b-eb19-48eb-a183-2afb8c10f331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:18.394383 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-d208986b-eb19-48eb-a183-2afb8c10f331 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:51:18.395607 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-d208986b-eb19-48eb-a183-2afb8c10f331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:51:18.404715 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 684/1381] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:51:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:51:18.449719 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d86996-f2c3-4c87-b4b5-fb52db927143 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:51:18.466118 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d86996-f2c3-4c87-b4b5-fb52db927143 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:51:18.471740 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6e9de-3a58-442e-b6ba-852c6890b82c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:51:18.472376 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6e9de-3a58-442e-b6ba-852c6890b82c service nova] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:18.472668 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6e9de-3a58-442e-b6ba-852c6890b82c service nova] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:18.472946 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6e9de-3a58-442e-b6ba-852c6890b82c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:18.483428 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f6e9de-3a58-442e-b6ba-852c6890b82c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:51:18.485088 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f6e9de-3a58-442e-b6ba-852c6890b82c service nova] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:51:18.495234 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 698/1382] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:51:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:51:20.763603 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b726f90-6af8-4558-ba01-c41d2e3321ff None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:20.764179 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b726f90-6af8-4558-ba01-c41d2e3321ff None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:20.764179 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b726f90-6af8-4558-ba01-c41d2e3321ff None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:20.765544 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 685/1383] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:51:20.772082 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d13db-1b5c-499e-af38-5aa1f786e22e None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:20.772703 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d13db-1b5c-499e-af38-5aa1f786e22e None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:20.772703 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d13db-1b5c-499e-af38-5aa1f786e22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:20.794000 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-190d13db-1b5c-499e-af38-5aa1f786e22e None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:51:20.795649 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-190d13db-1b5c-499e-af38-5aa1f786e22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:51:20.804349 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 699/1384] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:51:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:51:20.845960 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b726f90-6af8-4558-ba01-c41d2e3321ff None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:51:20.861387 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b726f90-6af8-4558-ba01-c41d2e3321ff None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:51:20.866817 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2fe26-2db4-4708-9fd3-c0a27cc2b2e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:51:20.867561 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2fe26-2db4-4708-9fd3-c0a27cc2b2e5 service nova] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:20.867914 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2fe26-2db4-4708-9fd3-c0a27cc2b2e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:20.868262 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2fe26-2db4-4708-9fd3-c0a27cc2b2e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:20.876834 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d2fe26-2db4-4708-9fd3-c0a27cc2b2e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:51:20.878469 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d2fe26-2db4-4708-9fd3-c0a27cc2b2e5 service nova] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:51:20.888423 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 686/1385] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:51:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:51:23.199852 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726446a4-7ece-4c33-a1a0-f155daaacb3e None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:23.200386 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726446a4-7ece-4c33-a1a0-f155daaacb3e None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:23.200495 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726446a4-7ece-4c33-a1a0-f155daaacb3e None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:23.202287 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 700/1386] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:51:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:51:23.208783 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a54e3-8429-462e-a72b-a632987d8186 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:23.209186 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a54e3-8429-462e-a72b-a632987d8186 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:23.209444 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a54e3-8429-462e-a72b-a632987d8186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:23.227435 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-585a54e3-8429-462e-a72b-a632987d8186 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:51:23.228674 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-585a54e3-8429-462e-a72b-a632987d8186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:51:23.236588 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 687/1387] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:51:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:51:23.281088 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726446a4-7ece-4c33-a1a0-f155daaacb3e None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:51:23.296301 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726446a4-7ece-4c33-a1a0-f155daaacb3e None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:51:23.301988 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66420d7-4df3-40d3-a3a2-0b6d2897d87d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:51:23.302625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66420d7-4df3-40d3-a3a2-0b6d2897d87d service nova] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:23.302909 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66420d7-4df3-40d3-a3a2-0b6d2897d87d service nova] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:23.303192 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66420d7-4df3-40d3-a3a2-0b6d2897d87d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:23.312133 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66420d7-4df3-40d3-a3a2-0b6d2897d87d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:51:23.313731 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66420d7-4df3-40d3-a3a2-0b6d2897d87d service nova] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:51:23.324840 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 701/1388] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:51:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:51:25.605481 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1458263-2f72-4eb6-b4e0-94bdd56f349b None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:25.606041 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1458263-2f72-4eb6-b4e0-94bdd56f349b None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:25.606041 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1458263-2f72-4eb6-b4e0-94bdd56f349b None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:25.607516 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 688/1389] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:51:25.612718 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b4f39-6ba3-4cb3-8e4d-aa311548f6e4 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:25.613161 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b4f39-6ba3-4cb3-8e4d-aa311548f6e4 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:25.613286 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b4f39-6ba3-4cb3-8e4d-aa311548f6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:25.630703 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-ad7b4f39-6ba3-4cb3-8e4d-aa311548f6e4 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:51:25.631924 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-ad7b4f39-6ba3-4cb3-8e4d-aa311548f6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:51:25.640524 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 702/1390] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:51:25.685173 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1458263-2f72-4eb6-b4e0-94bdd56f349b None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:51:25.700572 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1458263-2f72-4eb6-b4e0-94bdd56f349b None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:51:25.707991 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ff0a2-77e6-4abe-a6cd-41ed5d788b42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:51:25.708634 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ff0a2-77e6-4abe-a6cd-41ed5d788b42 service nova] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:25.708917 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ff0a2-77e6-4abe-a6cd-41ed5d788b42 service nova] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:25.709215 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ff0a2-77e6-4abe-a6cd-41ed5d788b42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:25.720410 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ff0a2-77e6-4abe-a6cd-41ed5d788b42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:51:25.722083 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ff0a2-77e6-4abe-a6cd-41ed5d788b42 service nova] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:51:25.732286 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 689/1391] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:51:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:51:28.023056 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594e6b5-dfc9-4d14-bb70-d2df492c545d None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:28.023646 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594e6b5-dfc9-4d14-bb70-d2df492c545d None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:28.023646 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594e6b5-dfc9-4d14-bb70-d2df492c545d None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:28.024866 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 703/1392] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:51:28.030415 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66959c-4004-4708-9cd1-56475f5dae06 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:28.030837 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66959c-4004-4708-9cd1-56475f5dae06 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:28.030977 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66959c-4004-4708-9cd1-56475f5dae06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:28.049698 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-fc66959c-4004-4708-9cd1-56475f5dae06 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:51:28.050900 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-fc66959c-4004-4708-9cd1-56475f5dae06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:51:28.059411 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 690/1393] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:51:28.104032 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594e6b5-dfc9-4d14-bb70-d2df492c545d None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:51:28.118723 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594e6b5-dfc9-4d14-bb70-d2df492c545d None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:51:28.124052 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f92e06-c24c-4e77-97da-4bf1df77c63b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:51:28.124681 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f92e06-c24c-4e77-97da-4bf1df77c63b service nova] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:28.124964 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f92e06-c24c-4e77-97da-4bf1df77c63b service nova] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:28.125239 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f92e06-c24c-4e77-97da-4bf1df77c63b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:28.133346 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f92e06-c24c-4e77-97da-4bf1df77c63b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:51:28.134915 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f92e06-c24c-4e77-97da-4bf1df77c63b service nova] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:51:28.144340 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 704/1394] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:51:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:51:30.064053 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ebf28-3f50-47f1-91af-4fb187493c35 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:30.064646 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ebf28-3f50-47f1-91af-4fb187493c35 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:30.064646 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ebf28-3f50-47f1-91af-4fb187493c35 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:30.065930 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 691/1395] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:51:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:51:30.072547 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6b71d-6232-4a9a-98b1-c92aa1bd5cff None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:30.073098 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6b71d-6232-4a9a-98b1-c92aa1bd5cff None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:30.073098 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6b71d-6232-4a9a-98b1-c92aa1bd5cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:30.092701 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-01b6b71d-6232-4a9a-98b1-c92aa1bd5cff None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:51:30.093943 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-01b6b71d-6232-4a9a-98b1-c92aa1bd5cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:51:30.102365 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 705/1396] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:51:30.159308 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5ef22-bf94-4207-8cbe-6065b2066bc6 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:30.159635 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5ef22-bf94-4207-8cbe-6065b2066bc6 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:30.159944 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5ef22-bf94-4207-8cbe-6065b2066bc6 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:30.161317 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 692/1397] 10.222.0.15 () {54 vars in 962 bytes} [Fri Jun 3 11:51:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:51:30.166566 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9b8b7-5bc4-4e85-81e3-31a1dc9d8655 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:30.166945 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9b8b7-5bc4-4e85-81e3-31a1dc9d8655 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:30.167296 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9b8b7-5bc4-4e85-81e3-31a1dc9d8655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:30.172955 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=55 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:51:30.216299 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-c1f9b8b7-5bc4-4e85-81e3-31a1dc9d8655 None None] MFA Rules not processed for user `9aa048aec48b4755ac13eae997bff2fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:51:30.217488 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-c1f9b8b7-5bc4-4e85-81e3-31a1dc9d8655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:51:30.279677 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 706/1398] 10.222.0.15 () {58 vars in 1059 bytes} [Fri Jun 3 11:51:30 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:51:30.286815 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5ef22-bf94-4207-8cbe-6065b2066bc6 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:51:30.297445 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5ef22-bf94-4207-8cbe-6065b2066bc6 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:51:30.300944 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e3372-65a1-4049-9040-05d9f3104357 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aa048aec48b4755ac13eae997bff2fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:51:30.301574 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e3372-65a1-4049-9040-05d9f3104357 service glance] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:30.301858 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e3372-65a1-4049-9040-05d9f3104357 service glance] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:30.302138 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e3372-65a1-4049-9040-05d9f3104357 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:30.311448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766e3372-65a1-4049-9040-05d9f3104357 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:51:30.312936 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766e3372-65a1-4049-9040-05d9f3104357 service glance] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:51:30.323078 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 693/1399] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:51:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:51:30.404176 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a447d40-924f-4d3e-8dd0-328966f6a282 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:30.404446 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a447d40-924f-4d3e-8dd0-328966f6a282 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:30.404736 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a447d40-924f-4d3e-8dd0-328966f6a282 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:30.406276 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 707/1400] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:51:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:51:30.411803 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893498d-8af4-4df8-8297-6f819bb8cdf7 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:30.412100 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893498d-8af4-4df8-8297-6f819bb8cdf7 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:30.412366 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893498d-8af4-4df8-8297-6f819bb8cdf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:30.431340 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-7893498d-8af4-4df8-8297-6f819bb8cdf7 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:51:30.432566 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-7893498d-8af4-4df8-8297-6f819bb8cdf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:51:30.440626 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 694/1401] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:51:30.486087 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a447d40-924f-4d3e-8dd0-328966f6a282 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:51:30.500482 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a447d40-924f-4d3e-8dd0-328966f6a282 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:51:30.506389 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b9efc-8d5d-43ce-861d-ff296f1490be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:51:30.507025 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b9efc-8d5d-43ce-861d-ff296f1490be service nova] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:30.507333 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b9efc-8d5d-43ce-861d-ff296f1490be service nova] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:30.507646 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b9efc-8d5d-43ce-861d-ff296f1490be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:30.516410 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04b9efc-8d5d-43ce-861d-ff296f1490be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:51:30.518261 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04b9efc-8d5d-43ce-861d-ff296f1490be service nova] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:51:30.528966 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 708/1402] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:51:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:51:30.858947 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24149743-0bec-4298-be53-35b8c5a5f880 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:30.859262 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24149743-0bec-4298-be53-35b8c5a5f880 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:30.859569 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24149743-0bec-4298-be53-35b8c5a5f880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:30.911760 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-24149743-0bec-4298-be53-35b8c5a5f880 None None] MFA Rules not processed for user `a55cbe88e78e4f3a82b8703a3b1804e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:51:30.912974 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-24149743-0bec-4298-be53-35b8c5a5f880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:51:30.976795 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 695/1403] 10.222.0.15 () {58 vars in 1009 bytes} [Fri Jun 3 11:51:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:51:31.021204 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68eedc-122e-4f1d-b98a-7dd9e3d929d2 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:31.021566 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68eedc-122e-4f1d-b98a-7dd9e3d929d2 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:31.021908 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68eedc-122e-4f1d-b98a-7dd9e3d929d2 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:31.023989 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 709/1404] 10.222.0.15 () {54 vars in 942 bytes} [Fri Jun 3 11:51:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:51:31.030631 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738375fc-f703-4873-bbfd-6b9ff529b6b5 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:31.031033 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738375fc-f703-4873-bbfd-6b9ff529b6b5 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:31.031322 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738375fc-f703-4873-bbfd-6b9ff529b6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:31.079573 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-738375fc-f703-4873-bbfd-6b9ff529b6b5 None None] MFA Rules not processed for user `5f52901fe535420bb0019272d4eafe72`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:51:31.080779 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-738375fc-f703-4873-bbfd-6b9ff529b6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:51:31.114055 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:51:31.155573 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 696/1405] 10.222.0.15 () {58 vars in 1039 bytes} [Fri Jun 3 11:51:31 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:51:31.164495 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed68eedc-122e-4f1d-b98a-7dd9e3d929d2 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:51:31.177710 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed68eedc-122e-4f1d-b98a-7dd9e3d929d2 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:51:31.183118 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083c005-44e7-4310-bd1e-7967d33b3c2d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f52901fe535420bb0019272d4eafe72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:51:31.183777 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083c005-44e7-4310-bd1e-7967d33b3c2d service swift] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:31.184063 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083c005-44e7-4310-bd1e-7967d33b3c2d service swift] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:31.184342 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083c005-44e7-4310-bd1e-7967d33b3c2d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:31.192339 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9083c005-44e7-4310-bd1e-7967d33b3c2d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:51:31.193921 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9083c005-44e7-4310-bd1e-7967d33b3c2d service swift] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:51:31.202506 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 710/1406] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Jun 3 11:51:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 11:51:32.825851 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2ce55-71d1-47f5-a062-f8ba4eb70f0b None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:32.826431 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2ce55-71d1-47f5-a062-f8ba4eb70f0b None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:32.826532 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2ce55-71d1-47f5-a062-f8ba4eb70f0b None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:32.828606 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 697/1407] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:51:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:51:32.834465 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6862e-d4a6-4616-85b2-c1241fa85781 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:32.835458 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6862e-d4a6-4616-85b2-c1241fa85781 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:32.835781 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6862e-d4a6-4616-85b2-c1241fa85781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:32.854063 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-f2a6862e-d4a6-4616-85b2-c1241fa85781 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:51:32.855513 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-f2a6862e-d4a6-4616-85b2-c1241fa85781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:51:32.863408 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 711/1408] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:51:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:51:32.913955 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2ce55-71d1-47f5-a062-f8ba4eb70f0b None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:51:32.931620 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2ce55-71d1-47f5-a062-f8ba4eb70f0b None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:51:32.942698 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a402a-9c2f-4fec-9562-7ffa9042fbb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:51:32.943777 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a402a-9c2f-4fec-9562-7ffa9042fbb5 service nova] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:32.944391 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a402a-9c2f-4fec-9562-7ffa9042fbb5 service nova] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:32.944884 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a402a-9c2f-4fec-9562-7ffa9042fbb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:32.955739 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a402a-9c2f-4fec-9562-7ffa9042fbb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:51:32.958097 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a402a-9c2f-4fec-9562-7ffa9042fbb5 service nova] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:51:32.977276 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 698/1409] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:51:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:51:42.848521 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=52 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:51:42.965674 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=21 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:51:54.671684 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eacdb3-5bd2-48a5-a692-4c43aa16ca1d None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:54.672315 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eacdb3-5bd2-48a5-a692-4c43aa16ca1d None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:54.672315 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eacdb3-5bd2-48a5-a692-4c43aa16ca1d None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:54.673590 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 712/1410] 10.222.0.15 () {54 vars in 918 bytes} [Fri Jun 3 11:51:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:51:54.678692 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8855f08-60db-4d43-85d1-ba63eabcfb09 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:54.679181 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8855f08-60db-4d43-85d1-ba63eabcfb09 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:54.679286 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8855f08-60db-4d43-85d1-ba63eabcfb09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:54.697021 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-f8855f08-60db-4d43-85d1-ba63eabcfb09 None None] MFA Rules not processed for user `eb5a91437dd64e2491ce41b4d12d4835`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:51:54.698213 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-f8855f08-60db-4d43-85d1-ba63eabcfb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:51:54.706596 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 699/1411] 10.222.0.15 () {58 vars in 1015 bytes} [Fri Jun 3 11:51:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:51:54.720764 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ee9c8-06c7-43bf-84db-b93e964a2441 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:54.721050 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ee9c8-06c7-43bf-84db-b93e964a2441 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:54.721326 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ee9c8-06c7-43bf-84db-b93e964a2441 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:54.722650 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 713/1412] 10.222.0.15 () {54 vars in 918 bytes} [Fri Jun 3 11:51:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:51:54.727757 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43086cc-fbbe-4dc3-9b20-6f88eef11b2c None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:54.728043 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43086cc-fbbe-4dc3-9b20-6f88eef11b2c None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:54.728321 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43086cc-fbbe-4dc3-9b20-6f88eef11b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:54.745471 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-a43086cc-fbbe-4dc3-9b20-6f88eef11b2c None None] MFA Rules not processed for user `6247bfb7aebd45eeb97ba5933be44c6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:51:54.746759 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-a43086cc-fbbe-4dc3-9b20-6f88eef11b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:51:54.756286 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 700/1413] 10.222.0.15 () {58 vars in 1015 bytes} [Fri Jun 3 11:51:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:51:57.443169 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae2d7b-e4dc-451f-8f8e-3f34d4f5f838 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:57.443770 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae2d7b-e4dc-451f-8f8e-3f34d4f5f838 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:57.443885 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae2d7b-e4dc-451f-8f8e-3f34d4f5f838 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:57.445183 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 714/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 11:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:51:57.450509 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335e869-2896-4375-a421-55a2316222c7 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:57.450956 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335e869-2896-4375-a421-55a2316222c7 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:57.451068 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335e869-2896-4375-a421-55a2316222c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:57.468910 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-7335e869-2896-4375-a421-55a2316222c7 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:51:57.470091 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-7335e869-2896-4375-a421-55a2316222c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:51:57.478622 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 701/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 11:51:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:51:57.520685 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae2d7b-e4dc-451f-8f8e-3f34d4f5f838 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:51:57.536634 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae2d7b-e4dc-451f-8f8e-3f34d4f5f838 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:51:57.542556 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2f33b-de0f-434d-8b27-fe13d7688627 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:51:57.543183 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2f33b-de0f-434d-8b27-fe13d7688627 service nova] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:57.543467 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2f33b-de0f-434d-8b27-fe13d7688627 service nova] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:57.543777 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2f33b-de0f-434d-8b27-fe13d7688627 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:57.551774 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d2f33b-de0f-434d-8b27-fe13d7688627 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:51:57.553393 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d2f33b-de0f-434d-8b27-fe13d7688627 service nova] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:51:57.562572 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 715/1416] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:51:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:51:58.555707 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f42490-7547-4866-805f-4217ced939b3 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:58.556309 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f42490-7547-4866-805f-4217ced939b3 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:58.556309 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f42490-7547-4866-805f-4217ced939b3 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:58.557594 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 702/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 11:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:51:58.562405 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219edb7-8752-4485-a42f-f208e3af17f8 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:58.562807 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219edb7-8752-4485-a42f-f208e3af17f8 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:58.562949 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219edb7-8752-4485-a42f-f208e3af17f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:58.580719 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-0219edb7-8752-4485-a42f-f208e3af17f8 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:51:58.581893 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-0219edb7-8752-4485-a42f-f208e3af17f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:51:58.589492 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 716/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 11:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:51:58.758184 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f42490-7547-4866-805f-4217ced939b3 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:51:58.772280 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f42490-7547-4866-805f-4217ced939b3 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:51:58.777825 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9109ef44-5b0b-47fb-bca4-f1209fe03ee3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:51:58.778446 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109ef44-5b0b-47fb-bca4-f1209fe03ee3 service nova] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:58.778726 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109ef44-5b0b-47fb-bca4-f1209fe03ee3 service nova] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:58.778999 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109ef44-5b0b-47fb-bca4-f1209fe03ee3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:58.787488 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9109ef44-5b0b-47fb-bca4-f1209fe03ee3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:51:58.789074 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9109ef44-5b0b-47fb-bca4-f1209fe03ee3 service nova] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:51:58.798194 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 703/1419] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:51:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:51:59.713646 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef3906-d7d5-4c65-9cd3-a94b1d5c8749 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:59.714109 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef3906-d7d5-4c65-9cd3-a94b1d5c8749 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:59.714227 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef3906-d7d5-4c65-9cd3-a94b1d5c8749 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:59.715637 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 717/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 11:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:51:59.720668 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa126d-3293-416e-b242-80f2b5318a60 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:59.721088 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa126d-3293-416e-b242-80f2b5318a60 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:59.721225 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa126d-3293-416e-b242-80f2b5318a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:59.739471 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-aaaa126d-3293-416e-b242-80f2b5318a60 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:51:59.740704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-aaaa126d-3293-416e-b242-80f2b5318a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:51:59.748457 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 704/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 11:51:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:51:59.897912 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef3906-d7d5-4c65-9cd3-a94b1d5c8749 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:51:59.913218 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef3906-d7d5-4c65-9cd3-a94b1d5c8749 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:51:59.918534 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327fb3a7-73d6-4804-8f0d-9c155b2f4f04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:51:59.919166 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327fb3a7-73d6-4804-8f0d-9c155b2f4f04 service nova] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:51:59.919453 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327fb3a7-73d6-4804-8f0d-9c155b2f4f04 service nova] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:51:59.919765 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327fb3a7-73d6-4804-8f0d-9c155b2f4f04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:51:59.927780 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327fb3a7-73d6-4804-8f0d-9c155b2f4f04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:51:59.929350 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327fb3a7-73d6-4804-8f0d-9c155b2f4f04 service nova] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:51:59.938617 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 718/1422] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:51:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:52:00.852279 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f74e8-4877-4dfc-bcf7-0aa7a89b279a None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:52:00.852866 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f74e8-4877-4dfc-bcf7-0aa7a89b279a None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:52:00.852866 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f74e8-4877-4dfc-bcf7-0aa7a89b279a None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:52:00.854209 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 705/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 11:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:52:00.859116 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02e66e-6d02-4b12-9b2d-55310c4b02f6 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:52:00.859554 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02e66e-6d02-4b12-9b2d-55310c4b02f6 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:52:00.859689 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02e66e-6d02-4b12-9b2d-55310c4b02f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:52:00.877670 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-7b02e66e-6d02-4b12-9b2d-55310c4b02f6 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:52:00.878867 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-7b02e66e-6d02-4b12-9b2d-55310c4b02f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:52:00.886606 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 719/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 11:52:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:52:01.036275 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f74e8-4877-4dfc-bcf7-0aa7a89b279a None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:52:01.051731 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f74e8-4877-4dfc-bcf7-0aa7a89b279a None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:52:01.057698 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f009a8-6b82-4b35-afdc-41c90bc2590f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:52:01.058324 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f009a8-6b82-4b35-afdc-41c90bc2590f service nova] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:52:01.058604 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f009a8-6b82-4b35-afdc-41c90bc2590f service nova] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:52:01.058875 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f009a8-6b82-4b35-afdc-41c90bc2590f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:52:01.067480 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f009a8-6b82-4b35-afdc-41c90bc2590f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:52:01.069125 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f009a8-6b82-4b35-afdc-41c90bc2590f service nova] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:52:01.078485 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 706/1425] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:52:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:52:01.983841 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bae931-f8ee-40f9-978a-0c11969c51ec None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:52:01.984363 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bae931-f8ee-40f9-978a-0c11969c51ec None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:52:01.984363 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bae931-f8ee-40f9-978a-0c11969c51ec None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:52:01.985689 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 720/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 11:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:52:01.992180 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686de184-fb80-4543-9968-8351bd64ce34 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:52:01.992603 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686de184-fb80-4543-9968-8351bd64ce34 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:52:01.992828 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686de184-fb80-4543-9968-8351bd64ce34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:52:02.011646 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-686de184-fb80-4543-9968-8351bd64ce34 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:52:02.012867 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-686de184-fb80-4543-9968-8351bd64ce34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:52:02.020751 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 707/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 11:52:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:52:02.168504 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bae931-f8ee-40f9-978a-0c11969c51ec None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:52:02.184172 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bae931-f8ee-40f9-978a-0c11969c51ec None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:52:02.189412 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc341c51-050f-440f-862d-1ed1165a8f37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:52:02.190037 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc341c51-050f-440f-862d-1ed1165a8f37 service nova] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:52:02.190316 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc341c51-050f-440f-862d-1ed1165a8f37 service nova] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:52:02.190583 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc341c51-050f-440f-862d-1ed1165a8f37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:52:02.199121 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc341c51-050f-440f-862d-1ed1165a8f37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:52:02.200712 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc341c51-050f-440f-862d-1ed1165a8f37 service nova] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:52:02.209788 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 721/1428] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:52:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:52:03.043765 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f096fa0-9b6c-439b-a5d3-a19b250bf33f None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:52:03.044320 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f096fa0-9b6c-439b-a5d3-a19b250bf33f None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:52:03.044320 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f096fa0-9b6c-439b-a5d3-a19b250bf33f None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:52:03.045693 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 708/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 11:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:52:03.050536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e81206-c497-4241-b9d0-0959f0d69ba3 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:52:03.050980 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e81206-c497-4241-b9d0-0959f0d69ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:52:03.051093 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e81206-c497-4241-b9d0-0959f0d69ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:52:03.069780 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-48e81206-c497-4241-b9d0-0959f0d69ba3 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:52:03.070980 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-48e81206-c497-4241-b9d0-0959f0d69ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:52:03.078898 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 722/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 11:52:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 11:52:03.228765 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f096fa0-9b6c-439b-a5d3-a19b250bf33f None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:52:03.242896 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f096fa0-9b6c-439b-a5d3-a19b250bf33f None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:52:03.248437 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde7eef-b84c-4edc-bcef-30ae6fe77d58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:52:03.249075 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde7eef-b84c-4edc-bcef-30ae6fe77d58 service nova] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:52:03.249365 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde7eef-b84c-4edc-bcef-30ae6fe77d58 service nova] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:52:03.249646 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde7eef-b84c-4edc-bcef-30ae6fe77d58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:52:03.258458 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddde7eef-b84c-4edc-bcef-30ae6fe77d58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:52:03.260077 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddde7eef-b84c-4edc-bcef-30ae6fe77d58 service nova] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:52:03.269648 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 709/1431] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:52:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:52:04.125252 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85458d-5316-4582-8fe2-35f11c80adad None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:52:04.125804 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85458d-5316-4582-8fe2-35f11c80adad None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:52:04.125804 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85458d-5316-4582-8fe2-35f11c80adad None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:52:04.127176 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 723/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 11:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:52:04.132249 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc34e9d-0b6b-495c-ad8c-e92de0cfee43 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:52:04.132674 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc34e9d-0b6b-495c-ad8c-e92de0cfee43 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:52:04.132809 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc34e9d-0b6b-495c-ad8c-e92de0cfee43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:52:04.151350 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-bcc34e9d-0b6b-495c-ad8c-e92de0cfee43 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:52:04.152546 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-bcc34e9d-0b6b-495c-ad8c-e92de0cfee43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:52:04.160202 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 710/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 11:52:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:52:04.307803 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85458d-5316-4582-8fe2-35f11c80adad None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:52:04.322147 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85458d-5316-4582-8fe2-35f11c80adad None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:52:04.327465 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd128176-f055-4290-9912-2a5995e26593 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:52:04.328122 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd128176-f055-4290-9912-2a5995e26593 service nova] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:52:04.328409 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd128176-f055-4290-9912-2a5995e26593 service nova] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:52:04.328686 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd128176-f055-4290-9912-2a5995e26593 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:52:04.337192 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd128176-f055-4290-9912-2a5995e26593 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:52:04.338784 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd128176-f055-4290-9912-2a5995e26593 service nova] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:52:04.348099 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 724/1434] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:52:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:52:05.184147 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21b22c-c3ba-4541-bb0b-db161920ba93 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:52:05.184696 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21b22c-c3ba-4541-bb0b-db161920ba93 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:52:05.184696 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21b22c-c3ba-4541-bb0b-db161920ba93 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:52:05.185981 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 711/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 11:52:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:52:05.190766 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6a6af-a765-45d2-8f9c-e9c2f2699a92 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:52:05.191198 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6a6af-a765-45d2-8f9c-e9c2f2699a92 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:52:05.191337 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6a6af-a765-45d2-8f9c-e9c2f2699a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:52:05.209386 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-02f6a6af-a765-45d2-8f9c-e9c2f2699a92 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:52:05.210548 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-02f6a6af-a765-45d2-8f9c-e9c2f2699a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:52:05.218115 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 725/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 11:52:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:52:05.367217 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a21b22c-c3ba-4541-bb0b-db161920ba93 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:52:05.381360 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a21b22c-c3ba-4541-bb0b-db161920ba93 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:52:05.386721 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976d7fd-ad3a-4b53-b395-c36442410ce0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:52:05.387343 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976d7fd-ad3a-4b53-b395-c36442410ce0 service nova] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:52:05.387662 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976d7fd-ad3a-4b53-b395-c36442410ce0 service nova] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:52:05.387941 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976d7fd-ad3a-4b53-b395-c36442410ce0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:52:05.396125 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5976d7fd-ad3a-4b53-b395-c36442410ce0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:52:05.397704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5976d7fd-ad3a-4b53-b395-c36442410ce0 service nova] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:52:05.407290 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 712/1437] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:52:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:52:06.252665 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bb41c-a54a-438a-9e7c-76ec78b181f4 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:52:06.253198 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bb41c-a54a-438a-9e7c-76ec78b181f4 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:52:06.253198 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bb41c-a54a-438a-9e7c-76ec78b181f4 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:52:06.254491 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 726/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 11:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:52:06.260035 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c32297-1b4d-463f-8754-d01ee4fdfeb1 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:52:06.260454 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c32297-1b4d-463f-8754-d01ee4fdfeb1 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:52:06.260585 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c32297-1b4d-463f-8754-d01ee4fdfeb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:52:06.279076 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-d8c32297-1b4d-463f-8754-d01ee4fdfeb1 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:52:06.280284 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-d8c32297-1b4d-463f-8754-d01ee4fdfeb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:52:06.288271 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 713/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 11:52:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 11:52:06.436336 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277bb41c-a54a-438a-9e7c-76ec78b181f4 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:52:06.450941 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277bb41c-a54a-438a-9e7c-76ec78b181f4 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:52:06.456283 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b623a7-9f5a-4f98-b541-933db7472dab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:52:06.456911 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b623a7-9f5a-4f98-b541-933db7472dab service nova] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:52:06.457195 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b623a7-9f5a-4f98-b541-933db7472dab service nova] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:52:06.457473 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b623a7-9f5a-4f98-b541-933db7472dab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:52:06.465704 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b623a7-9f5a-4f98-b541-933db7472dab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:52:06.467277 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b623a7-9f5a-4f98-b541-933db7472dab service nova] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:52:06.476490 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 727/1440] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:52:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:52:08.564038 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d63d58-5428-4820-9229-8c4538618e95 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:52:08.564572 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d63d58-5428-4820-9229-8c4538618e95 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:52:08.564572 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d63d58-5428-4820-9229-8c4538618e95 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:52:08.565879 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 714/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 11:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:52:08.571098 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2ee6c-67b7-454a-9e67-53c491c621f9 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:52:08.571555 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2ee6c-67b7-454a-9e67-53c491c621f9 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:52:08.571699 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2ee6c-67b7-454a-9e67-53c491c621f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:52:08.589252 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-25f2ee6c-67b7-454a-9e67-53c491c621f9 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:52:08.590434 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-25f2ee6c-67b7-454a-9e67-53c491c621f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:52:08.598100 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 728/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 11:52:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:52:08.636438 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d63d58-5428-4820-9229-8c4538618e95 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:52:08.647486 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d63d58-5428-4820-9229-8c4538618e95 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:52:08.651238 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712bb09-c4ff-4344-95f0-5a6aa8107481 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:52:08.651904 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712bb09-c4ff-4344-95f0-5a6aa8107481 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:52:08.652191 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712bb09-c4ff-4344-95f0-5a6aa8107481 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:52:08.652473 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712bb09-c4ff-4344-95f0-5a6aa8107481 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:52:08.661293 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8712bb09-c4ff-4344-95f0-5a6aa8107481 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:52:08.663296 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8712bb09-c4ff-4344-95f0-5a6aa8107481 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:52:08.672702 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 715/1443] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:52:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:52:11.048052 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06400de8-6199-4cf2-8265-4c14f7ecad90 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:52:11.048611 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06400de8-6199-4cf2-8265-4c14f7ecad90 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:52:11.048611 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06400de8-6199-4cf2-8265-4c14f7ecad90 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:52:11.049972 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 729/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 11:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:52:11.055196 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a7648-ac7b-45fc-9680-a29e192629b2 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:52:11.055647 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a7648-ac7b-45fc-9680-a29e192629b2 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:52:11.055798 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a7648-ac7b-45fc-9680-a29e192629b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:52:11.074389 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-283a7648-ac7b-45fc-9680-a29e192629b2 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:52:11.075638 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-283a7648-ac7b-45fc-9680-a29e192629b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:52:11.084060 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 716/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 11:52:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:52:11.122203 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06400de8-6199-4cf2-8265-4c14f7ecad90 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:52:11.132952 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06400de8-6199-4cf2-8265-4c14f7ecad90 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:52:11.136513 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939fcbf-a36f-478b-b480-389c1093a27c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:52:11.137144 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939fcbf-a36f-478b-b480-389c1093a27c service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:52:11.137428 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939fcbf-a36f-478b-b480-389c1093a27c service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:52:11.137706 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939fcbf-a36f-478b-b480-389c1093a27c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:52:11.146968 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3939fcbf-a36f-478b-b480-389c1093a27c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:52:11.148463 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3939fcbf-a36f-478b-b480-389c1093a27c service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:52:11.158023 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 730/1446] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:52:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:52:13.680030 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930ffe5-f370-43ea-9443-2616dc50eebc None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:52:13.680570 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930ffe5-f370-43ea-9443-2616dc50eebc None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:52:13.680570 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930ffe5-f370-43ea-9443-2616dc50eebc None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:52:13.681939 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 717/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 11:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:52:13.687312 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc11631-584d-4ef7-bfa2-afb93af61d78 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:52:13.687744 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc11631-584d-4ef7-bfa2-afb93af61d78 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:52:13.687900 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc11631-584d-4ef7-bfa2-afb93af61d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:52:13.705439 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-6dc11631-584d-4ef7-bfa2-afb93af61d78 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:52:13.706621 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-6dc11631-584d-4ef7-bfa2-afb93af61d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:52:13.714908 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 731/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 11:52:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:52:13.753777 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930ffe5-f370-43ea-9443-2616dc50eebc None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:52:13.764239 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930ffe5-f370-43ea-9443-2616dc50eebc None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:52:13.767676 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc0dd2-59cb-4744-bdf2-b6f3379230ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:52:13.768291 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc0dd2-59cb-4744-bdf2-b6f3379230ed service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:52:13.768569 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc0dd2-59cb-4744-bdf2-b6f3379230ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:52:13.768838 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc0dd2-59cb-4744-bdf2-b6f3379230ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:52:13.777767 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc0dd2-59cb-4744-bdf2-b6f3379230ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:52:13.779185 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc0dd2-59cb-4744-bdf2-b6f3379230ed service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:52:13.788991 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 718/1449] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:52:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:52:16.119033 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5dad3-644b-4d34-88e7-4595837651c6 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:52:16.119655 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5dad3-644b-4d34-88e7-4595837651c6 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:52:16.119655 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5dad3-644b-4d34-88e7-4595837651c6 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:52:16.120984 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 732/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 11:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:52:16.126425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04851aa5-a983-4505-b3cb-11bcc2448c94 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:52:16.126833 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04851aa5-a983-4505-b3cb-11bcc2448c94 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:52:16.127001 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04851aa5-a983-4505-b3cb-11bcc2448c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:52:16.144955 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-04851aa5-a983-4505-b3cb-11bcc2448c94 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:52:16.146182 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-04851aa5-a983-4505-b3cb-11bcc2448c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:52:16.154177 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 719/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 11:52:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:52:16.191867 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5dad3-644b-4d34-88e7-4595837651c6 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:52:16.202899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5dad3-644b-4d34-88e7-4595837651c6 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:52:16.206409 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00423067-4123-40d8-becd-eb4df566c911 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:52:16.207030 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00423067-4123-40d8-becd-eb4df566c911 service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:52:16.207306 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00423067-4123-40d8-becd-eb4df566c911 service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:52:16.207616 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00423067-4123-40d8-becd-eb4df566c911 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:52:16.216341 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00423067-4123-40d8-becd-eb4df566c911 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:52:16.217770 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00423067-4123-40d8-becd-eb4df566c911 service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:52:16.227097 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 733/1452] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:52:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 11:52:18.512063 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb33bc-04ce-4298-830c-bc4bb91210c1 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:52:18.512623 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb33bc-04ce-4298-830c-bc4bb91210c1 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:52:18.512623 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb33bc-04ce-4298-830c-bc4bb91210c1 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:52:18.514015 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 720/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 11:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:52:18.519477 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600035bf-ac9b-4c77-b142-5d20d6525840 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:52:18.519943 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600035bf-ac9b-4c77-b142-5d20d6525840 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:52:18.520063 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600035bf-ac9b-4c77-b142-5d20d6525840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:52:18.537629 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-600035bf-ac9b-4c77-b142-5d20d6525840 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:52:18.538794 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-600035bf-ac9b-4c77-b142-5d20d6525840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:52:18.546447 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 734/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 11:52:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:52:18.585045 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb33bc-04ce-4298-830c-bc4bb91210c1 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:52:18.586961 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-a3eb33bc-04ce-4298-830c-bc4bb91210c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:52:18.599715 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb33bc-04ce-4298-830c-bc4bb91210c1 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:52:18.603101 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984fa90-b542-491f-990e-506e8b2e1b6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:52:18.603752 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984fa90-b542-491f-990e-506e8b2e1b6b service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:52:18.604032 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984fa90-b542-491f-990e-506e8b2e1b6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:52:18.604307 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984fa90-b542-491f-990e-506e8b2e1b6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:52:18.612974 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0984fa90-b542-491f-990e-506e8b2e1b6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:52:18.614956 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0984fa90-b542-491f-990e-506e8b2e1b6b service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:52:18.624132 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 721/1455] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:52:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:52:21.155862 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92737407-100e-4b23-8f7b-77574ef5f4b3 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:52:21.156395 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92737407-100e-4b23-8f7b-77574ef5f4b3 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:52:21.156395 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92737407-100e-4b23-8f7b-77574ef5f4b3 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:52:21.157751 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 735/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 11:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 11:52:21.163602 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421e853-7676-4fa8-b09f-0f7e434a3a22 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:52:21.164033 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421e853-7676-4fa8-b09f-0f7e434a3a22 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:52:21.164163 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421e853-7676-4fa8-b09f-0f7e434a3a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:52:21.182475 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-3421e853-7676-4fa8-b09f-0f7e434a3a22 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:52:21.183702 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-3421e853-7676-4fa8-b09f-0f7e434a3a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:52:21.191472 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 722/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 11:52:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:52:21.229010 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92737407-100e-4b23-8f7b-77574ef5f4b3 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:52:21.240236 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92737407-100e-4b23-8f7b-77574ef5f4b3 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:52:21.243716 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d87888-2b19-4c0a-a3f1-67cf75814d84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:52:21.244339 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d87888-2b19-4c0a-a3f1-67cf75814d84 service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:52:21.244624 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d87888-2b19-4c0a-a3f1-67cf75814d84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:52:21.244898 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d87888-2b19-4c0a-a3f1-67cf75814d84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:52:21.253681 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d87888-2b19-4c0a-a3f1-67cf75814d84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:52:21.255144 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d87888-2b19-4c0a-a3f1-67cf75814d84 service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:52:21.264537 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 736/1458] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:52:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:52:23.642392 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31800fc0-c17f-49d4-8881-ff080c516865 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:52:23.642977 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31800fc0-c17f-49d4-8881-ff080c516865 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:52:23.642977 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31800fc0-c17f-49d4-8881-ff080c516865 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:52:23.644341 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 723/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 11:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:52:23.649542 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a7b6a-6e5b-472c-92cb-36bcbae228e5 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:52:23.649952 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a7b6a-6e5b-472c-92cb-36bcbae228e5 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:52:23.650098 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a7b6a-6e5b-472c-92cb-36bcbae228e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:52:23.656282 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=70 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:52:23.668619 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-d15a7b6a-6e5b-472c-92cb-36bcbae228e5 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:52:23.669814 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-d15a7b6a-6e5b-472c-92cb-36bcbae228e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:52:23.678058 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 737/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 11:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:52:23.715046 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31800fc0-c17f-49d4-8881-ff080c516865 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:52:23.720624 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=73 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:52:23.727193 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31800fc0-c17f-49d4-8881-ff080c516865 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:52:23.730644 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd4f70-54e4-4772-a8b4-7763b744313a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:52:23.731271 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd4f70-54e4-4772-a8b4-7763b744313a service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:52:23.731585 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd4f70-54e4-4772-a8b4-7763b744313a service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:52:23.731864 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd4f70-54e4-4772-a8b4-7763b744313a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:52:23.741373 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd4f70-54e4-4772-a8b4-7763b744313a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:52:23.742792 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd4f70-54e4-4772-a8b4-7763b744313a service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:52:23.752091 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 724/1461] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:52:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:52:26.023638 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc20846-dd4e-4d64-a1cf-2a0973c38cab None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:52:26.024163 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc20846-dd4e-4d64-a1cf-2a0973c38cab None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:52:26.024163 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc20846-dd4e-4d64-a1cf-2a0973c38cab None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:52:26.025845 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 738/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 11:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:52:26.031033 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e1724-aa04-45f3-a871-94e612328102 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:52:26.031515 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e1724-aa04-45f3-a871-94e612328102 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:52:26.031631 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e1724-aa04-45f3-a871-94e612328102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:52:26.049687 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-6e1e1724-aa04-45f3-a871-94e612328102 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:52:26.050873 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-6e1e1724-aa04-45f3-a871-94e612328102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:52:26.058719 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 725/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 11:52:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:52:26.095524 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc20846-dd4e-4d64-a1cf-2a0973c38cab None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:52:26.106883 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc20846-dd4e-4d64-a1cf-2a0973c38cab None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:52:26.110382 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320d1c5-1624-4863-a3b1-feea85fd3144 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:52:26.111013 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320d1c5-1624-4863-a3b1-feea85fd3144 service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:52:26.111299 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320d1c5-1624-4863-a3b1-feea85fd3144 service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:52:26.111613 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320d1c5-1624-4863-a3b1-feea85fd3144 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:52:26.120982 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e320d1c5-1624-4863-a3b1-feea85fd3144 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:52:26.122416 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e320d1c5-1624-4863-a3b1-feea85fd3144 service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:52:26.132335 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 739/1464] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:52:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:52:28.369599 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936cd6c5-bff5-4a16-9e2d-6989a8d168fb None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:52:28.370198 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936cd6c5-bff5-4a16-9e2d-6989a8d168fb None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:52:28.370198 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936cd6c5-bff5-4a16-9e2d-6989a8d168fb None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:52:28.371553 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 726/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 11:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:52:28.376727 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0da264-99a0-4ea7-933a-48286206744a None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:52:28.377141 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0da264-99a0-4ea7-933a-48286206744a None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:52:28.377308 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0da264-99a0-4ea7-933a-48286206744a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:52:28.395635 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-9c0da264-99a0-4ea7-933a-48286206744a None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:52:28.396830 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-9c0da264-99a0-4ea7-933a-48286206744a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:52:28.404850 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 740/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 11:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:52:28.442102 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936cd6c5-bff5-4a16-9e2d-6989a8d168fb None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:52:28.452651 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936cd6c5-bff5-4a16-9e2d-6989a8d168fb None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:52:28.456118 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9370f0-d2b7-497c-9cfc-d1a511c869c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:52:28.456740 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9370f0-d2b7-497c-9cfc-d1a511c869c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:52:28.457022 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9370f0-d2b7-497c-9cfc-d1a511c869c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:52:28.457813 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9370f0-d2b7-497c-9cfc-d1a511c869c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:52:28.466561 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9370f0-d2b7-497c-9cfc-d1a511c869c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:52:28.468035 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9370f0-d2b7-497c-9cfc-d1a511c869c4 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:52:28.478007 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 727/1467] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:52:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:52:30.724105 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472ac88-ff43-4d9b-901c-3fe09ecc65d3 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:52:30.724674 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472ac88-ff43-4d9b-901c-3fe09ecc65d3 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:52:30.724674 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472ac88-ff43-4d9b-901c-3fe09ecc65d3 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:52:30.726037 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 741/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 11:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:52:30.731350 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135eef44-9709-4185-b6f4-a8f4f7d563b5 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:52:30.731837 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135eef44-9709-4185-b6f4-a8f4f7d563b5 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:52:30.731944 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135eef44-9709-4185-b6f4-a8f4f7d563b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:52:30.749865 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-135eef44-9709-4185-b6f4-a8f4f7d563b5 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:52:30.751062 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-135eef44-9709-4185-b6f4-a8f4f7d563b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:52:30.759418 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 728/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 11:52:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:52:30.795934 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472ac88-ff43-4d9b-901c-3fe09ecc65d3 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:52:30.807153 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472ac88-ff43-4d9b-901c-3fe09ecc65d3 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:52:30.810954 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e14abd-aeaa-4230-a77f-5b308f05edb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:52:30.811614 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e14abd-aeaa-4230-a77f-5b308f05edb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:52:30.811903 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e14abd-aeaa-4230-a77f-5b308f05edb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:52:30.812180 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e14abd-aeaa-4230-a77f-5b308f05edb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:52:30.820898 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e14abd-aeaa-4230-a77f-5b308f05edb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:52:30.822318 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e14abd-aeaa-4230-a77f-5b308f05edb5 service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:52:30.831589 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 742/1470] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:52:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:52:40.744833 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=17 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:52:40.827430 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=17 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:53:02.410316 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc519e7-cc53-4541-a46b-a5a31e4d36a5 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:53:02.410929 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc519e7-cc53-4541-a46b-a5a31e4d36a5 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:53:02.410929 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc519e7-cc53-4541-a46b-a5a31e4d36a5 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:53:02.412270 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 729/1471] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:53:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:53:02.417404 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea1bbf-be9a-4bde-8a69-497497762e1d None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:53:02.417845 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea1bbf-be9a-4bde-8a69-497497762e1d None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:53:02.417949 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea1bbf-be9a-4bde-8a69-497497762e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:53:02.436348 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-5eea1bbf-be9a-4bde-8a69-497497762e1d None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:53:02.437536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-5eea1bbf-be9a-4bde-8a69-497497762e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:53:02.445247 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 743/1472] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:53:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:53:02.492819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90bbeb-6fae-44dd-9452-087dff223b3d None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:53:02.493111 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90bbeb-6fae-44dd-9452-087dff223b3d None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:53:02.493392 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90bbeb-6fae-44dd-9452-087dff223b3d None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:53:02.494756 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 730/1473] 10.222.0.15 () {54 vars in 962 bytes} [Fri Jun 3 11:53:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:53:02.499478 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf739a-309c-4dea-b5d4-35b49dc487e4 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:53:02.499865 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf739a-309c-4dea-b5d4-35b49dc487e4 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:53:02.500152 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf739a-309c-4dea-b5d4-35b49dc487e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:53:02.518329 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-d4bf739a-309c-4dea-b5d4-35b49dc487e4 None None] MFA Rules not processed for user `9aa048aec48b4755ac13eae997bff2fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:53:02.519537 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-d4bf739a-309c-4dea-b5d4-35b49dc487e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:53:02.526107 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 744/1474] 10.222.0.15 () {58 vars in 1059 bytes} [Fri Jun 3 11:53:02 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:53:02.532975 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90bbeb-6fae-44dd-9452-087dff223b3d None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:53:02.544015 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90bbeb-6fae-44dd-9452-087dff223b3d None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:53:02.547441 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d1be0-361f-43ee-8b54-7512c2b4808a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aa048aec48b4755ac13eae997bff2fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:53:02.548087 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d1be0-361f-43ee-8b54-7512c2b4808a service glance] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:53:02.548374 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d1be0-361f-43ee-8b54-7512c2b4808a service glance] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:53:02.548656 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d1be0-361f-43ee-8b54-7512c2b4808a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:53:02.557941 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d1be0-361f-43ee-8b54-7512c2b4808a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:53:02.559376 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d1be0-361f-43ee-8b54-7512c2b4808a service glance] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:53:02.568720 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 731/1475] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:53:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:53:04.868523 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a18ef-669f-44ec-8deb-0177eace79ac None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:53:04.869118 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a18ef-669f-44ec-8deb-0177eace79ac None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:53:04.869118 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a18ef-669f-44ec-8deb-0177eace79ac None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:53:04.870439 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 745/1476] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:53:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:53:04.875613 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4f930-54d4-4f43-b460-85864ced8767 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:53:04.876038 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4f930-54d4-4f43-b460-85864ced8767 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:53:04.876151 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4f930-54d4-4f43-b460-85864ced8767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:53:04.894073 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-37a4f930-54d4-4f43-b460-85864ced8767 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:53:04.895261 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-37a4f930-54d4-4f43-b460-85864ced8767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:53:04.903236 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 732/1477] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:53:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:53:04.926839 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a18ef-669f-44ec-8deb-0177eace79ac None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:53:04.939240 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a18ef-669f-44ec-8deb-0177eace79ac None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:53:04.943730 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c2361-d16f-4aa2-9b2f-f3698648ddf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:53:04.944371 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c2361-d16f-4aa2-9b2f-f3698648ddf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:53:04.944655 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c2361-d16f-4aa2-9b2f-f3698648ddf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:53:04.944933 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c2361-d16f-4aa2-9b2f-f3698648ddf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:53:04.945660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c2361-d16f-4aa2-9b2f-f3698648ddf3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:53:04.947407 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: WARNING py.warnings [None req-984c2361-d16f-4aa2-9b2f-f3698648ddf3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 11:53:04.947407 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: warnings.warn(msg) Jun 03 11:53:04.947407 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: Jun 03 11:53:04.948567 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c2361-d16f-4aa2-9b2f-f3698648ddf3 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:53:04.967622 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 746/1478] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Jun 3 11:53:04 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:53:07.212792 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69716906-3700-4e94-bb14-743b8af8a0ce None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:53:07.213317 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69716906-3700-4e94-bb14-743b8af8a0ce None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:53:07.213317 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69716906-3700-4e94-bb14-743b8af8a0ce None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:53:07.214611 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 733/1479] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:53:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:53:07.219820 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ec3f1-d634-4d99-b6b2-7cd3b0efee2d None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:53:07.220268 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ec3f1-d634-4d99-b6b2-7cd3b0efee2d None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:53:07.220388 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ec3f1-d634-4d99-b6b2-7cd3b0efee2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:53:07.238240 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-4f8ec3f1-d634-4d99-b6b2-7cd3b0efee2d None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:53:07.239404 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-4f8ec3f1-d634-4d99-b6b2-7cd3b0efee2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:53:07.247321 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 747/1480] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 11:53:07.291152 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69716906-3700-4e94-bb14-743b8af8a0ce None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:53:07.306468 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69716906-3700-4e94-bb14-743b8af8a0ce None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:53:07.311999 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427791e-c19e-4b0c-b467-29758c564803 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:53:07.312640 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427791e-c19e-4b0c-b467-29758c564803 service nova] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:53:07.312928 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427791e-c19e-4b0c-b467-29758c564803 service nova] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:53:07.313206 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427791e-c19e-4b0c-b467-29758c564803 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:53:07.321467 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2427791e-c19e-4b0c-b467-29758c564803 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:53:07.323067 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2427791e-c19e-4b0c-b467-29758c564803 service nova] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:53:07.333047 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 734/1481] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:53:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:53:09.715784 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363517e-ac0f-4bb5-ac4d-771be12052c0 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:53:09.716368 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363517e-ac0f-4bb5-ac4d-771be12052c0 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:53:09.716368 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363517e-ac0f-4bb5-ac4d-771be12052c0 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:53:09.717857 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 748/1482] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:53:09.723898 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3bf276-8d9d-4f06-811e-ea1e9854c5fa None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:53:09.724301 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3bf276-8d9d-4f06-811e-ea1e9854c5fa None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:53:09.724456 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3bf276-8d9d-4f06-811e-ea1e9854c5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:53:09.741864 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-ed3bf276-8d9d-4f06-811e-ea1e9854c5fa None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:53:09.743044 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-ed3bf276-8d9d-4f06-811e-ea1e9854c5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:53:09.750720 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 735/1483] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:53:09.787305 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363517e-ac0f-4bb5-ac4d-771be12052c0 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:53:09.797860 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363517e-ac0f-4bb5-ac4d-771be12052c0 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:53:09.801611 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca71c9c-ba7d-407c-ac5f-b12e83c7ee0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:53:09.802242 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca71c9c-ba7d-407c-ac5f-b12e83c7ee0b service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:53:09.802526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca71c9c-ba7d-407c-ac5f-b12e83c7ee0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:53:09.802801 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca71c9c-ba7d-407c-ac5f-b12e83c7ee0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:53:09.811738 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca71c9c-ba7d-407c-ac5f-b12e83c7ee0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:53:09.813167 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca71c9c-ba7d-407c-ac5f-b12e83c7ee0b service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:53:09.822392 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 749/1484] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:53:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 11:53:12.082370 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c1676-fc82-44ed-a0b7-f15fa70a4685 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:53:12.082958 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c1676-fc82-44ed-a0b7-f15fa70a4685 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:53:12.082958 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c1676-fc82-44ed-a0b7-f15fa70a4685 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:53:12.084308 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 736/1485] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:53:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:53:12.089691 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4efb1db-fe90-4e1e-818a-ffbf923f548e None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:53:12.090117 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4efb1db-fe90-4e1e-818a-ffbf923f548e None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:53:12.090749 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4efb1db-fe90-4e1e-818a-ffbf923f548e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:53:12.108781 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-b4efb1db-fe90-4e1e-818a-ffbf923f548e None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:53:12.109965 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-b4efb1db-fe90-4e1e-818a-ffbf923f548e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:53:12.117709 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 750/1486] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:53:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:53:12.155364 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c1676-fc82-44ed-a0b7-f15fa70a4685 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:53:12.166640 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c1676-fc82-44ed-a0b7-f15fa70a4685 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:53:12.170130 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392fee3-b96a-4ff9-8fc6-007ba53e9ab3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:53:12.170751 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392fee3-b96a-4ff9-8fc6-007ba53e9ab3 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:53:12.171031 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392fee3-b96a-4ff9-8fc6-007ba53e9ab3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:53:12.171307 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392fee3-b96a-4ff9-8fc6-007ba53e9ab3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:53:12.180044 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392fee3-b96a-4ff9-8fc6-007ba53e9ab3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:53:12.181459 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392fee3-b96a-4ff9-8fc6-007ba53e9ab3 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:53:12.190739 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 737/1487] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:53:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:53:14.499990 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404feccc-af73-4a25-b17c-bfd6a4b54403 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:53:14.500559 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404feccc-af73-4a25-b17c-bfd6a4b54403 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:53:14.500559 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404feccc-af73-4a25-b17c-bfd6a4b54403 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:53:14.501992 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 751/1488] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:53:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:53:14.507263 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38e0ac-6262-4542-b3f0-55f3d87d9e12 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:53:14.507709 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38e0ac-6262-4542-b3f0-55f3d87d9e12 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:53:14.507852 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38e0ac-6262-4542-b3f0-55f3d87d9e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:53:14.525974 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-2b38e0ac-6262-4542-b3f0-55f3d87d9e12 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:53:14.527158 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-2b38e0ac-6262-4542-b3f0-55f3d87d9e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:53:14.535587 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 738/1489] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:53:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:53:14.573544 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404feccc-af73-4a25-b17c-bfd6a4b54403 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:53:14.584633 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404feccc-af73-4a25-b17c-bfd6a4b54403 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:53:14.588075 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b1ff86-70bc-4e04-8728-bf976b86095d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:53:14.588701 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1ff86-70bc-4e04-8728-bf976b86095d service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:53:14.588986 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1ff86-70bc-4e04-8728-bf976b86095d service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:53:14.589268 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1ff86-70bc-4e04-8728-bf976b86095d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:53:14.598553 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b1ff86-70bc-4e04-8728-bf976b86095d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:53:14.600036 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b1ff86-70bc-4e04-8728-bf976b86095d service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:53:14.609244 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 752/1490] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:53:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:53:17.029910 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8b439-24ac-4fca-b3f0-6755ff4ea343 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:53:17.030497 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8b439-24ac-4fca-b3f0-6755ff4ea343 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:53:17.030497 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8b439-24ac-4fca-b3f0-6755ff4ea343 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:53:17.031879 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 739/1491] 10.222.0.15 () {54 vars in 926 bytes} [Fri Jun 3 11:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:53:17.037512 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f040f-d86f-4da2-9b45-8e1e9909385f None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:53:17.037953 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f040f-d86f-4da2-9b45-8e1e9909385f None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:53:17.038064 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f040f-d86f-4da2-9b45-8e1e9909385f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:53:17.056110 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-346f040f-d86f-4da2-9b45-8e1e9909385f None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:53:17.057297 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-346f040f-d86f-4da2-9b45-8e1e9909385f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:53:17.065005 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 753/1492] 10.222.0.15 () {58 vars in 1023 bytes} [Fri Jun 3 11:53:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:53:17.104298 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8b439-24ac-4fca-b3f0-6755ff4ea343 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:53:17.115655 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8b439-24ac-4fca-b3f0-6755ff4ea343 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:53:17.119167 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304642c0-e9fe-4a8c-8eb2-71f92934e9f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:53:17.119829 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304642c0-e9fe-4a8c-8eb2-71f92934e9f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:53:17.120118 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304642c0-e9fe-4a8c-8eb2-71f92934e9f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:53:17.120399 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304642c0-e9fe-4a8c-8eb2-71f92934e9f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:53:17.129238 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304642c0-e9fe-4a8c-8eb2-71f92934e9f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:53:17.130701 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304642c0-e9fe-4a8c-8eb2-71f92934e9f9 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:53:17.140092 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 740/1493] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:53:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:53:27.050999 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=33 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:53:27.135924 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=33 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:54:48.967533 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0138a-fe00-4cc6-acb6-4031682d2c40 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:54:48.968043 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0138a-fe00-4cc6-acb6-4031682d2c40 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:54:48.968147 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0138a-fe00-4cc6-acb6-4031682d2c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:54:48.986331 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-a7b0138a-fe00-4cc6-acb6-4031682d2c40 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:54:48.987592 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-a7b0138a-fe00-4cc6-acb6-4031682d2c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:54:48.995200 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 754/1494] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:54:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:54:49.003628 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e9186-0613-4855-b6c7-20277a529178 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:54:49.004095 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e9186-0613-4855-b6c7-20277a529178 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:54:49.004205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e9186-0613-4855-b6c7-20277a529178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:54:49.021733 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-bc2e9186-0613-4855-b6c7-20277a529178 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:54:49.022922 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-bc2e9186-0613-4855-b6c7-20277a529178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:54:49.030977 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 741/1495] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:54:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:54:49.035605 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b0138a-fe00-4cc6-acb6-4031682d2c40 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:54:49.045213 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b0138a-fe00-4cc6-acb6-4031682d2c40 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:54:49.050181 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b466ca-39fc-4f00-8e10-de0060e181a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:54:49.050821 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b466ca-39fc-4f00-8e10-de0060e181a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:54:49.051101 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b466ca-39fc-4f00-8e10-de0060e181a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:54:49.051378 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b466ca-39fc-4f00-8e10-de0060e181a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:54:49.052132 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b466ca-39fc-4f00-8e10-de0060e181a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:54:49.052435 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b466ca-39fc-4f00-8e10-de0060e181a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:54:49.053442 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: WARNING py.warnings [None req-c5b466ca-39fc-4f00-8e10-de0060e181a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 11:54:49.053442 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: warnings.warn(msg) Jun 03 11:54:49.053442 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: Jun 03 11:54:49.054315 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b466ca-39fc-4f00-8e10-de0060e181a6 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:54:49.066197 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 755/1496] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 11:54:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:54:49.073993 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e9186-0613-4855-b6c7-20277a529178 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:54:49.083121 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e9186-0613-4855-b6c7-20277a529178 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:54:49.087726 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefad174-6d32-412f-ab80-e4e7b39ddb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:54:49.088365 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefad174-6d32-412f-ab80-e4e7b39ddb72 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:54:49.088653 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefad174-6d32-412f-ab80-e4e7b39ddb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:54:49.088930 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefad174-6d32-412f-ab80-e4e7b39ddb72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:54:49.089624 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefad174-6d32-412f-ab80-e4e7b39ddb72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:54:49.091328 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: WARNING py.warnings [None req-eefad174-6d32-412f-ab80-e4e7b39ddb72 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 11:54:49.091328 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: warnings.warn(msg) Jun 03 11:54:49.091328 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: Jun 03 11:54:49.092551 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefad174-6d32-412f-ab80-e4e7b39ddb72 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:54:49.132694 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 742/1497] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:54:49 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 11:54:49.133778 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b466ca-39fc-4f00-8e10-de0060e181a6 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:54:49.143552 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b466ca-39fc-4f00-8e10-de0060e181a6 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:54:49.198056 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53c9ba-8d85-4c02-87c2-8c74ce4d137b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:54:49.198621 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53c9ba-8d85-4c02-87c2-8c74ce4d137b admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:54:49.198906 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53c9ba-8d85-4c02-87c2-8c74ce4d137b admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:54:49.199176 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53c9ba-8d85-4c02-87c2-8c74ce4d137b admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:54:49.199887 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f53c9ba-8d85-4c02-87c2-8c74ce4d137b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:54:49.200888 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: WARNING py.warnings [None req-2f53c9ba-8d85-4c02-87c2-8c74ce4d137b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 11:54:49.200888 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: warnings.warn(msg) Jun 03 11:54:49.200888 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: Jun 03 11:54:49.202106 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f53c9ba-8d85-4c02-87c2-8c74ce4d137b admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:54:49.221701 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 756/1498] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:54:49 2022] POST /identity/v3/users => generated 289 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 11:54:49.225749 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefad174-6d32-412f-ab80-e4e7b39ddb72 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:54:49.236493 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefad174-6d32-412f-ab80-e4e7b39ddb72 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:54:49.241245 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b8ab4-2858-4a14-a963-b231983b9815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:54:49.241926 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b8ab4-2858-4a14-a963-b231983b9815 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:54:49.242207 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b8ab4-2858-4a14-a963-b231983b9815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:54:49.242482 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b8ab4-2858-4a14-a963-b231983b9815 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:54:49.243197 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b8ab4-2858-4a14-a963-b231983b9815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:54:49.244286 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: WARNING py.warnings [None req-3a9b8ab4-2858-4a14-a963-b231983b9815 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 11:54:49.244286 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: warnings.warn(msg) Jun 03 11:54:49.244286 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: Jun 03 11:54:49.245163 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b8ab4-2858-4a14-a963-b231983b9815 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:54:49.257738 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 743/1499] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:54:49.261709 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53c9ba-8d85-4c02-87c2-8c74ce4d137b admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:54:49.271426 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53c9ba-8d85-4c02-87c2-8c74ce4d137b admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:54:49.276256 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319d859-3586-431d-9b9a-3609854f3f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:54:49.276891 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319d859-3586-431d-9b9a-3609854f3f18 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:54:49.277174 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319d859-3586-431d-9b9a-3609854f3f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:54:49.277449 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319d859-3586-431d-9b9a-3609854f3f18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:54:49.278171 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f319d859-3586-431d-9b9a-3609854f3f18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:54:49.279177 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: WARNING py.warnings [None req-f319d859-3586-431d-9b9a-3609854f3f18 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 11:54:49.279177 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: warnings.warn(msg) Jun 03 11:54:49.279177 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: Jun 03 11:54:49.280627 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f319d859-3586-431d-9b9a-3609854f3f18 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:54:49.293630 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 757/1500] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:54:49.298116 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b8ab4-2858-4a14-a963-b231983b9815 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:54:49.307744 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b8ab4-2858-4a14-a963-b231983b9815 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:54:49.312190 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69674b76-9aa2-4b52-a6a0-55484b1add7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:54:49.313043 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69674b76-9aa2-4b52-a6a0-55484b1add7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:54:49.313325 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69674b76-9aa2-4b52-a6a0-55484b1add7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:54:49.313599 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69674b76-9aa2-4b52-a6a0-55484b1add7e admin admin] PATH_INFO: `/v3/projects/0739a6101b9545ac84a25e970400f630/users/36c187143cd24ec4bece57cc61ce39ce/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:54:49.327930 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69674b76-9aa2-4b52-a6a0-55484b1add7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0739a6101b9545ac84a25e970400f630, user_id=36c187143cd24ec4bece57cc61ce39ce, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:54:49.328948 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: WARNING py.warnings [None req-69674b76-9aa2-4b52-a6a0-55484b1add7e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 11:54:49.328948 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: warnings.warn(msg) Jun 03 11:54:49.328948 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: Jun 03 11:54:49.330860 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69674b76-9aa2-4b52-a6a0-55484b1add7e admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:54:49.343948 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 744/1501] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:54:49 2022] PUT /identity/v3/projects/0739a6101b9545ac84a25e970400f630/users/36c187143cd24ec4bece57cc61ce39ce/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:54:49.356246 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272c840-572c-4b18-997d-cf8945bdbc12 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:54:49.356637 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272c840-572c-4b18-997d-cf8945bdbc12 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:54:49.356928 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272c840-572c-4b18-997d-cf8945bdbc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:54:49.383160 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-b272c840-572c-4b18-997d-cf8945bdbc12 None None] MFA Rules not processed for user `36c187143cd24ec4bece57cc61ce39ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:54:49.384406 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-b272c840-572c-4b18-997d-cf8945bdbc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:54:49.446886 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 758/1502] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:54:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:54:49.459822 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b29716-d2d7-4507-be0f-a9addea480bd None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:54:49.460110 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b29716-d2d7-4507-be0f-a9addea480bd None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:54:49.460386 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b29716-d2d7-4507-be0f-a9addea480bd None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:54:49.461724 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 745/1503] 10.222.0.15 () {54 vars in 963 bytes} [Fri Jun 3 11:54:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:54:49.466566 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc07360-e8d8-414a-8a82-0c6c27ab65cd None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:54:49.466861 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc07360-e8d8-414a-8a82-0c6c27ab65cd None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:54:49.467675 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc07360-e8d8-414a-8a82-0c6c27ab65cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:54:49.485742 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-1dc07360-e8d8-414a-8a82-0c6c27ab65cd None None] MFA Rules not processed for user `978c834f137a4a6ab83a54af0239c137`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:54:49.486927 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-1dc07360-e8d8-414a-8a82-0c6c27ab65cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:54:49.529320 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:54:49.538146 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 759/1504] 10.222.0.15 () {58 vars in 1060 bytes} [Fri Jun 3 11:54:49 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:54:49.545611 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b29716-d2d7-4507-be0f-a9addea480bd None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:54:49.556010 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b29716-d2d7-4507-be0f-a9addea480bd None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:54:49.559429 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c8b43-9222-4be2-bf12-bac39bf21cad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:54:49.560072 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c8b43-9222-4be2-bf12-bac39bf21cad service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:54:49.560350 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c8b43-9222-4be2-bf12-bac39bf21cad service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:54:49.560623 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c8b43-9222-4be2-bf12-bac39bf21cad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:54:49.568694 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c8b43-9222-4be2-bf12-bac39bf21cad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:54:49.570103 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c8b43-9222-4be2-bf12-bac39bf21cad service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:54:49.579226 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 746/1505] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:54:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 11:54:49.620085 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83875473-19fe-476d-b38e-bb142bb90e1e None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:54:49.620382 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83875473-19fe-476d-b38e-bb142bb90e1e None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:54:49.620668 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83875473-19fe-476d-b38e-bb142bb90e1e None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:54:49.621988 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 760/1506] 10.222.0.15 () {52 vars in 829 bytes} [Fri Jun 3 11:54:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:54:49.625583 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c8b43-9222-4be2-bf12-bac39bf21cad service cinder] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:54:49.686856 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c8b43-9222-4be2-bf12-bac39bf21cad service cinder] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:54:49.691363 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c8f90-aefe-4ef2-a391-0f1c9b538cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:54:49.692244 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c8f90-aefe-4ef2-a391-0f1c9b538cff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:54:49.692529 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c8f90-aefe-4ef2-a391-0f1c9b538cff admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:54:49.692804 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c8f90-aefe-4ef2-a391-0f1c9b538cff admin admin] PATH_INFO: `/v3/users/36c187143cd24ec4bece57cc61ce39ce` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:54:49.693965 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c8f90-aefe-4ef2-a391-0f1c9b538cff admin admin] RBAC: Authorizing `identity:delete_user(user_id=36c187143cd24ec4bece57cc61ce39ce)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:54:49.694976 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: WARNING py.warnings [None req-0a4c8f90-aefe-4ef2-a391-0f1c9b538cff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 11:54:49.694976 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: warnings.warn(msg) Jun 03 11:54:49.694976 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: Jun 03 11:54:49.696218 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c8f90-aefe-4ef2-a391-0f1c9b538cff admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:54:49.768175 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-0a4c8f90-aefe-4ef2-a391-0f1c9b538cff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36c187143cd24ec4bece57cc61ce39ce'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:54:49.780550 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-0a4c8f90-aefe-4ef2-a391-0f1c9b538cff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36c187143cd24ec4bece57cc61ce39ce'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:54:49.781212 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-0a4c8f90-aefe-4ef2-a391-0f1c9b538cff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36c187143cd24ec4bece57cc61ce39ce'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:54:49.799418 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-0a4c8f90-aefe-4ef2-a391-0f1c9b538cff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36c187143cd24ec4bece57cc61ce39ce'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:54:49.803370 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:54:49.809800 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-0a4c8f90-aefe-4ef2-a391-0f1c9b538cff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36c187143cd24ec4bece57cc61ce39ce'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:54:49.817870 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 747/1507] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 11:54:49 2022] DELETE /identity/v3/users/36c187143cd24ec4bece57cc61ce39ce => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:54:49.822399 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ab1bb-f052-499c-9811-dfa210b040cb None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:54:49.822691 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ab1bb-f052-499c-9811-dfa210b040cb None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:54:49.822975 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ab1bb-f052-499c-9811-dfa210b040cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:54:49.841550 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-784ab1bb-f052-499c-9811-dfa210b040cb None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:54:49.842765 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-784ab1bb-f052-499c-9811-dfa210b040cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:54:49.901039 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 761/1508] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:54:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:54:49.910944 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c8f90-aefe-4ef2-a391-0f1c9b538cff admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:54:49.912367 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-0a4c8f90-aefe-4ef2-a391-0f1c9b538cff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:54:49.968163 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c8f90-aefe-4ef2-a391-0f1c9b538cff admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:54:49.971731 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821741b-9092-43f3-82d5-107e787832c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:54:49.972370 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821741b-9092-43f3-82d5-107e787832c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:54:49.972653 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821741b-9092-43f3-82d5-107e787832c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:54:49.972930 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821741b-9092-43f3-82d5-107e787832c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:54:49.981700 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821741b-9092-43f3-82d5-107e787832c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:54:49.983790 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821741b-9092-43f3-82d5-107e787832c3 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:54:49.993006 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 748/1509] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:54:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:54:50.359744 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ab1bb-f052-499c-9811-dfa210b040cb None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:54:50.361392 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-784ab1bb-f052-499c-9811-dfa210b040cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:54:50.374141 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ab1bb-f052-499c-9811-dfa210b040cb None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:54:50.380473 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c0b21b-6566-4aa3-91de-1a795e26cff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:54:50.381383 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0b21b-6566-4aa3-91de-1a795e26cff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:54:50.381601 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0b21b-6566-4aa3-91de-1a795e26cff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:54:50.381881 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0b21b-6566-4aa3-91de-1a795e26cff2 admin admin] PATH_INFO: `/v3/projects/0739a6101b9545ac84a25e970400f630` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:54:50.383277 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c0b21b-6566-4aa3-91de-1a795e26cff2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0739a6101b9545ac84a25e970400f630)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:54:50.384385 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: WARNING py.warnings [None req-69c0b21b-6566-4aa3-91de-1a795e26cff2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 11:54:50.384385 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: warnings.warn(msg) Jun 03 11:54:50.384385 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: Jun 03 11:54:50.385566 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c0b21b-6566-4aa3-91de-1a795e26cff2 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:54:50.447049 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-69c0b21b-6566-4aa3-91de-1a795e26cff2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0739a6101b9545ac84a25e970400f630', 'request_id': 'req-69c0b21b-6566-4aa3-91de-1a795e26cff2'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:54:50.453297 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-69c0b21b-6566-4aa3-91de-1a795e26cff2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0739a6101b9545ac84a25e970400f630', 'request_id': 'req-69c0b21b-6566-4aa3-91de-1a795e26cff2'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:54:50.463552 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-69c0b21b-6566-4aa3-91de-1a795e26cff2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0739a6101b9545ac84a25e970400f630', 'request_id': 'req-69c0b21b-6566-4aa3-91de-1a795e26cff2'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:54:50.481162 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-69c0b21b-6566-4aa3-91de-1a795e26cff2 admin admin] The token cache is being invalidate because project 0739a6101b9545ac84a25e970400f630 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 11:54:50.481449 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-69c0b21b-6566-4aa3-91de-1a795e26cff2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:54:50.482079 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-69c0b21b-6566-4aa3-91de-1a795e26cff2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:54:50.484236 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 762/1510] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 11:54:50 2022] DELETE /identity/v3/projects/0739a6101b9545ac84a25e970400f630 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:54:59.988953 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:55:00.478135 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:56:27.667451 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd67894-8346-4014-9e16-885e107bd496 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:56:27.668071 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd67894-8346-4014-9e16-885e107bd496 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:56:27.668071 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd67894-8346-4014-9e16-885e107bd496 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:56:27.669448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 749/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 11:56:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:56:27.674237 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa9074-0813-4b7e-b321-51d31f032072 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:56:27.674661 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa9074-0813-4b7e-b321-51d31f032072 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:56:27.674818 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa9074-0813-4b7e-b321-51d31f032072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:56:27.692955 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-0eaa9074-0813-4b7e-b321-51d31f032072 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:56:27.694138 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-0eaa9074-0813-4b7e-b321-51d31f032072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:56:27.751129 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 763/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 11:56:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:56:27.916848 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd67894-8346-4014-9e16-885e107bd496 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:56:27.919079 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-5bd67894-8346-4014-9e16-885e107bd496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:56:27.992589 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd67894-8346-4014-9e16-885e107bd496 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:56:27.998513 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17140ed7-50bb-4ad3-adcf-a11b8da859b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:56:27.999143 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17140ed7-50bb-4ad3-adcf-a11b8da859b4 service nova] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:56:27.999424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17140ed7-50bb-4ad3-adcf-a11b8da859b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:56:27.999729 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17140ed7-50bb-4ad3-adcf-a11b8da859b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:56:28.007719 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17140ed7-50bb-4ad3-adcf-a11b8da859b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:56:28.009287 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17140ed7-50bb-4ad3-adcf-a11b8da859b4 service nova] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:56:28.018530 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 750/1513] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:56:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:56:28.882733 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f3d73-31a8-4de9-90eb-f5557940bd8c None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:56:28.883299 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f3d73-31a8-4de9-90eb-f5557940bd8c None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:56:28.883299 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f3d73-31a8-4de9-90eb-f5557940bd8c None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:56:28.884708 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 764/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 11:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:56:28.890215 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523356e0-6bdd-471f-b2eb-8171acbfd8e1 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:56:28.890671 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523356e0-6bdd-471f-b2eb-8171acbfd8e1 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:56:28.890776 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523356e0-6bdd-471f-b2eb-8171acbfd8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:56:28.908996 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-523356e0-6bdd-471f-b2eb-8171acbfd8e1 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:56:28.910165 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-523356e0-6bdd-471f-b2eb-8171acbfd8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:56:28.917822 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 751/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 11:56:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:56:29.068612 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f3d73-31a8-4de9-90eb-f5557940bd8c None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:56:29.083456 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f3d73-31a8-4de9-90eb-f5557940bd8c None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:56:29.088904 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c0694-1a2f-47d8-b0d5-a4814646dc22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:56:29.089534 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c0694-1a2f-47d8-b0d5-a4814646dc22 service nova] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:56:29.089849 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c0694-1a2f-47d8-b0d5-a4814646dc22 service nova] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:56:29.090128 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c0694-1a2f-47d8-b0d5-a4814646dc22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:56:29.098569 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c0694-1a2f-47d8-b0d5-a4814646dc22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:56:29.100202 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c0694-1a2f-47d8-b0d5-a4814646dc22 service nova] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:56:29.109540 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 765/1516] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:56:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:56:29.207803 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4633467-ddbb-4816-87c7-790e91cb8be9 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:56:29.208090 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4633467-ddbb-4816-87c7-790e91cb8be9 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:56:29.208371 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4633467-ddbb-4816-87c7-790e91cb8be9 None None] PATH_INFO: `/v3` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:56:29.209654 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 752/1517] 10.222.0.32 () {54 vars in 925 bytes} [Fri Jun 3 11:56:29 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:56:29.216413 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a72e6-b1de-40fc-9ab2-c6b7e42ebb24 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:56:29.216717 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a72e6-b1de-40fc-9ab2-c6b7e42ebb24 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:56:29.216996 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a72e6-b1de-40fc-9ab2-c6b7e42ebb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:56:29.235622 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-279a72e6-b1de-40fc-9ab2-c6b7e42ebb24 None None] MFA Rules not processed for user `eb5a91437dd64e2491ce41b4d12d4835`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:56:29.236813 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-279a72e6-b1de-40fc-9ab2-c6b7e42ebb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:56:29.299388 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 766/1518] 10.222.0.32 () {58 vars in 1015 bytes} [Fri Jun 3 11:56:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:56:38.390815 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81a1fd-6fd8-4f2a-9d34-1d4a32892f37 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:56:38.391383 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81a1fd-6fd8-4f2a-9d34-1d4a32892f37 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:56:38.391496 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81a1fd-6fd8-4f2a-9d34-1d4a32892f37 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:56:38.392788 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 753/1519] 10.222.0.15 () {54 vars in 960 bytes} [Fri Jun 3 11:56:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:56:38.397763 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55e7cb-6cba-48ee-92e9-fee7d382e91b None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:56:38.398473 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55e7cb-6cba-48ee-92e9-fee7d382e91b None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:56:38.398583 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55e7cb-6cba-48ee-92e9-fee7d382e91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:56:38.416272 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-ad55e7cb-6cba-48ee-92e9-fee7d382e91b None None] MFA Rules not processed for user `eb5a91437dd64e2491ce41b4d12d4835`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:56:38.417451 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-ad55e7cb-6cba-48ee-92e9-fee7d382e91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:56:38.426379 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 767/1520] 10.222.0.15 () {58 vars in 1057 bytes} [Fri Jun 3 11:56:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:56:38.434298 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81a1fd-6fd8-4f2a-9d34-1d4a32892f37 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:56:38.447852 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81a1fd-6fd8-4f2a-9d34-1d4a32892f37 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:56:38.452798 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5055e0-6a8f-4c94-b29b-e4cebcffe221 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5a91437dd64e2491ce41b4d12d4835', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:56:38.453423 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5055e0-6a8f-4c94-b29b-e4cebcffe221 service placement] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:56:38.453708 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5055e0-6a8f-4c94-b29b-e4cebcffe221 service placement] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:56:38.454013 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5055e0-6a8f-4c94-b29b-e4cebcffe221 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:56:38.462179 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5055e0-6a8f-4c94-b29b-e4cebcffe221 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:56:38.463789 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5055e0-6a8f-4c94-b29b-e4cebcffe221 service placement] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:56:38.473295 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 754/1521] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:56:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:56:40.373141 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8c314-5849-41f9-8ceb-96e79ae4d85b None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:56:40.373696 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8c314-5849-41f9-8ceb-96e79ae4d85b None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:56:40.373696 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8c314-5849-41f9-8ceb-96e79ae4d85b None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:56:40.375104 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 768/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 11:56:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:56:40.379779 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae14af-fa6b-4a8e-8884-5d67bf6c389f None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:56:40.380224 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae14af-fa6b-4a8e-8884-5d67bf6c389f None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:56:40.380330 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae14af-fa6b-4a8e-8884-5d67bf6c389f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:56:40.397840 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-87ae14af-fa6b-4a8e-8884-5d67bf6c389f None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:56:40.399286 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-87ae14af-fa6b-4a8e-8884-5d67bf6c389f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:56:40.407546 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 755/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 11:56:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:56:40.558941 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a8c314-5849-41f9-8ceb-96e79ae4d85b None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:56:40.573441 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a8c314-5849-41f9-8ceb-96e79ae4d85b None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:56:40.579445 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db577074-e0ef-4e13-a303-21bf6e540201 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:56:40.580122 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db577074-e0ef-4e13-a303-21bf6e540201 service nova] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:56:40.580408 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db577074-e0ef-4e13-a303-21bf6e540201 service nova] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:56:40.580684 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db577074-e0ef-4e13-a303-21bf6e540201 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:56:40.588926 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db577074-e0ef-4e13-a303-21bf6e540201 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:56:40.591058 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db577074-e0ef-4e13-a303-21bf6e540201 service nova] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:56:40.600332 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 769/1524] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:56:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:56:41.456442 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa57c5-449a-4a81-bdda-7a941f8040d2 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:56:41.456987 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa57c5-449a-4a81-bdda-7a941f8040d2 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:56:41.456987 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa57c5-449a-4a81-bdda-7a941f8040d2 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:56:41.458340 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 756/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 3 11:56:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:56:41.463198 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb390432-22c1-4b92-9cc6-65ba68960a0d None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:56:41.463641 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb390432-22c1-4b92-9cc6-65ba68960a0d None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:56:41.463775 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb390432-22c1-4b92-9cc6-65ba68960a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:56:41.482196 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-bb390432-22c1-4b92-9cc6-65ba68960a0d None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:56:41.483373 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-bb390432-22c1-4b92-9cc6-65ba68960a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:56:41.491847 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 770/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 3 11:56:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:56:41.643377 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa57c5-449a-4a81-bdda-7a941f8040d2 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:56:41.658159 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa57c5-449a-4a81-bdda-7a941f8040d2 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:56:41.663385 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a68e8-f599-474e-adea-bdb8ab043486 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:56:41.664042 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a68e8-f599-474e-adea-bdb8ab043486 service nova] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:56:41.664322 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a68e8-f599-474e-adea-bdb8ab043486 service nova] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:56:41.664596 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a68e8-f599-474e-adea-bdb8ab043486 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:56:41.673213 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a68e8-f599-474e-adea-bdb8ab043486 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:56:41.674778 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a68e8-f599-474e-adea-bdb8ab043486 service nova] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:56:41.683951 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 757/1527] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:56:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:56:45.690433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb97243-882d-4aab-971c-aa25200c2f7f None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:56:45.691041 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb97243-882d-4aab-971c-aa25200c2f7f None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:56:45.691041 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb97243-882d-4aab-971c-aa25200c2f7f None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:56:45.692396 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 771/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 11:56:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:56:45.697528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f3eab-0935-42a9-967e-2d1c972721e6 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:56:45.697973 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f3eab-0935-42a9-967e-2d1c972721e6 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:56:45.698078 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f3eab-0935-42a9-967e-2d1c972721e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:56:45.715928 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-c18f3eab-0935-42a9-967e-2d1c972721e6 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:56:45.717096 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-c18f3eab-0935-42a9-967e-2d1c972721e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:56:45.724660 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 758/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 11:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:56:45.764809 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb97243-882d-4aab-971c-aa25200c2f7f None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:56:45.766491 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-dbb97243-882d-4aab-971c-aa25200c2f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:56:45.826985 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb97243-882d-4aab-971c-aa25200c2f7f None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:56:45.830507 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec801350-66b8-4a8b-84b3-ab06905da976 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:56:45.831153 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec801350-66b8-4a8b-84b3-ab06905da976 service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:56:45.831434 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec801350-66b8-4a8b-84b3-ab06905da976 service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:56:45.831735 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec801350-66b8-4a8b-84b3-ab06905da976 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:56:45.840526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec801350-66b8-4a8b-84b3-ab06905da976 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:56:45.841953 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec801350-66b8-4a8b-84b3-ab06905da976 service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:56:45.846826 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:56:45.852291 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 772/1530] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:56:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:56:48.073793 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6766aca-470a-432d-9d3b-50aaef8c4eea None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:56:48.074347 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6766aca-470a-432d-9d3b-50aaef8c4eea None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:56:48.074347 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6766aca-470a-432d-9d3b-50aaef8c4eea None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:56:48.075726 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 759/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 11:56:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:56:48.081029 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0325372-2342-4878-8ae9-2c67f127aa1d None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:56:48.081457 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0325372-2342-4878-8ae9-2c67f127aa1d None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:56:48.081567 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0325372-2342-4878-8ae9-2c67f127aa1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:56:48.099212 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-b0325372-2342-4878-8ae9-2c67f127aa1d None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:56:48.100425 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-b0325372-2342-4878-8ae9-2c67f127aa1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:56:48.108632 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 773/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 11:56:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:56:48.143443 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6766aca-470a-432d-9d3b-50aaef8c4eea None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:56:48.154290 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6766aca-470a-432d-9d3b-50aaef8c4eea None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:56:48.157847 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a10977-e15e-4de4-a8f4-3620283dda1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:56:48.158470 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a10977-e15e-4de4-a8f4-3620283dda1f service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:56:48.158753 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a10977-e15e-4de4-a8f4-3620283dda1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:56:48.159028 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a10977-e15e-4de4-a8f4-3620283dda1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:56:48.167781 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a10977-e15e-4de4-a8f4-3620283dda1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:56:48.169714 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a10977-e15e-4de4-a8f4-3620283dda1f service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:56:48.178982 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 760/1533] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:56:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:56:51.859341 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdfb40-cf24-4de1-9791-1bb8d7036fb3 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:56:51.859822 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdfb40-cf24-4de1-9791-1bb8d7036fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:56:51.860040 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdfb40-cf24-4de1-9791-1bb8d7036fb3 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:56:51.861213 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 774/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 11:56:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:56:51.866466 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476c7c9-a7e8-4bc6-b0bb-66a9b1cbe82f None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:56:51.866915 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476c7c9-a7e8-4bc6-b0bb-66a9b1cbe82f None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:56:51.867025 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476c7c9-a7e8-4bc6-b0bb-66a9b1cbe82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:56:51.873386 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=62 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:56:51.885734 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-0476c7c9-a7e8-4bc6-b0bb-66a9b1cbe82f None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:56:51.886924 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-0476c7c9-a7e8-4bc6-b0bb-66a9b1cbe82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:56:51.895264 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 761/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 11:56:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:56:52.162414 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbdfb40-cf24-4de1-9791-1bb8d7036fb3 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:56:52.164156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-9fbdfb40-cf24-4de1-9791-1bb8d7036fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:56:52.219556 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbdfb40-cf24-4de1-9791-1bb8d7036fb3 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:56:52.223269 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4a621-1c26-491e-bcb2-e9468567ffbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:56:52.223948 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4a621-1c26-491e-bcb2-e9468567ffbb service cinder] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:56:52.224235 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4a621-1c26-491e-bcb2-e9468567ffbb service cinder] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:56:52.224547 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4a621-1c26-491e-bcb2-e9468567ffbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:56:52.234003 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb4a621-1c26-491e-bcb2-e9468567ffbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:56:52.235434 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb4a621-1c26-491e-bcb2-e9468567ffbb service cinder] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:56:52.244829 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 775/1536] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:56:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:56:54.494576 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399b31c-7911-4cf0-8215-82bdfbcc9c1a None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:56:54.495163 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399b31c-7911-4cf0-8215-82bdfbcc9c1a None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:56:54.495163 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399b31c-7911-4cf0-8215-82bdfbcc9c1a None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:56:54.496561 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 762/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 3 11:56:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:56:54.501910 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5555a4-aa10-4f16-aaf6-064b79a8d7fc None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:56:54.502322 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5555a4-aa10-4f16-aaf6-064b79a8d7fc None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:56:54.502466 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5555a4-aa10-4f16-aaf6-064b79a8d7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:56:54.520253 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-ca5555a4-aa10-4f16-aaf6-064b79a8d7fc None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:56:54.521437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-ca5555a4-aa10-4f16-aaf6-064b79a8d7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:56:54.530169 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 776/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 3 11:56:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:56:54.797701 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399b31c-7911-4cf0-8215-82bdfbcc9c1a None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:56:54.799383 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-c399b31c-7911-4cf0-8215-82bdfbcc9c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:56:54.812265 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399b31c-7911-4cf0-8215-82bdfbcc9c1a None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:56:54.816006 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c2a41-8088-4fb0-8065-78e8f3d84802 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:56:54.816644 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c2a41-8088-4fb0-8065-78e8f3d84802 service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:56:54.816931 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c2a41-8088-4fb0-8065-78e8f3d84802 service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:56:54.817208 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c2a41-8088-4fb0-8065-78e8f3d84802 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:56:54.826838 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c2a41-8088-4fb0-8065-78e8f3d84802 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:56:54.828290 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c2a41-8088-4fb0-8065-78e8f3d84802 service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:56:54.837687 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 763/1539] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:56:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:57:04.515000 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=32 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:57:04.833471 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=8 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:24.043579 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a4573-1cae-4336-bd6d-00113c069f95 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:24.044251 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a4573-1cae-4336-bd6d-00113c069f95 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:24.044251 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a4573-1cae-4336-bd6d-00113c069f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:24.075991 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-c78a4573-1cae-4336-bd6d-00113c069f95 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:24.077245 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-c78a4573-1cae-4336-bd6d-00113c069f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:24.090393 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 777/1540] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 11:58:24.098536 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f589f-6655-46b0-9b48-bb50275cf2d4 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:24.099136 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f589f-6655-46b0-9b48-bb50275cf2d4 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:24.099136 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f589f-6655-46b0-9b48-bb50275cf2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:24.126697 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-931f589f-6655-46b0-9b48-bb50275cf2d4 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:24.127954 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-931f589f-6655-46b0-9b48-bb50275cf2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:24.136749 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 764/1541] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:24.141303 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a4573-1cae-4336-bd6d-00113c069f95 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:24.155302 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a4573-1cae-4336-bd6d-00113c069f95 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:24.164176 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a704d8-e6e9-4105-badf-c576ed64b9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:24.164846 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a704d8-e6e9-4105-badf-c576ed64b9bd admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:24.165127 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a704d8-e6e9-4105-badf-c576ed64b9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:24.165403 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a704d8-e6e9-4105-badf-c576ed64b9bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:24.166844 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a704d8-e6e9-4105-badf-c576ed64b9bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:58:24.167261 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a704d8-e6e9-4105-badf-c576ed64b9bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:24.168904 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a704d8-e6e9-4105-badf-c576ed64b9bd admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:24.182148 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 778/1542] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 11:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:58:24.191525 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f589f-6655-46b0-9b48-bb50275cf2d4 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:24.201925 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f589f-6655-46b0-9b48-bb50275cf2d4 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:24.216271 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc35063-ac9e-4d77-99d3-685c56b7e779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:24.216963 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc35063-ac9e-4d77-99d3-685c56b7e779 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:24.217247 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc35063-ac9e-4d77-99d3-685c56b7e779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:24.217521 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc35063-ac9e-4d77-99d3-685c56b7e779 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:24.218470 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc35063-ac9e-4d77-99d3-685c56b7e779 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:24.220429 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc35063-ac9e-4d77-99d3-685c56b7e779 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:24.277773 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 765/1543] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:58:24 2022] POST /identity/v3/projects => generated 355 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:58:24.284953 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a704d8-e6e9-4105-badf-c576ed64b9bd admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:24.305138 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a704d8-e6e9-4105-badf-c576ed64b9bd admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:24.307663 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085f046-d1d1-4f72-a0c2-d2c3b4878967 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:24.307957 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085f046-d1d1-4f72-a0c2-d2c3b4878967 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:24.308233 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085f046-d1d1-4f72-a0c2-d2c3b4878967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:24.334150 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-b085f046-d1d1-4f72-a0c2-d2c3b4878967 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:24.335396 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-b085f046-d1d1-4f72-a0c2-d2c3b4878967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:24.485795 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282607b-613c-48be-bb0b-af6d10022c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:24.486383 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282607b-613c-48be-bb0b-af6d10022c18 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:24.486691 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282607b-613c-48be-bb0b-af6d10022c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:24.487278 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282607b-613c-48be-bb0b-af6d10022c18 admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:24.488040 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c282607b-613c-48be-bb0b-af6d10022c18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:24.490148 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c282607b-613c-48be-bb0b-af6d10022c18 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:24.502456 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 766/1544] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:24.509326 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce32c95-d343-4553-b08c-ccd23c0d4f46 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:24.509626 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce32c95-d343-4553-b08c-ccd23c0d4f46 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:24.509895 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce32c95-d343-4553-b08c-ccd23c0d4f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:24.552142 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 779/1545] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:58:24 2022] POST /identity/v3/users => generated 278 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 11:58:24.554109 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f081b-3120-4482-9279-b8b0be8e4838 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:24.554109 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f081b-3120-4482-9279-b8b0be8e4838 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:24.554332 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f081b-3120-4482-9279-b8b0be8e4838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:24.568197 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-cce32c95-d343-4553-b08c-ccd23c0d4f46 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:24.570002 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-cce32c95-d343-4553-b08c-ccd23c0d4f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:24.582161 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-5d2f081b-3120-4482-9279-b8b0be8e4838 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:24.582500 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-5d2f081b-3120-4482-9279-b8b0be8e4838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:24.583262 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 767/1546] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:24.584885 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5df84-a02d-401a-b147-520ccb2720e1 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:24.585392 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5df84-a02d-401a-b147-520ccb2720e1 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:24.585948 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5df84-a02d-401a-b147-520ccb2720e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:24.600841 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 780/1547] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:24.601607 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53f093-28ee-456c-b5bf-2e00dbe95e95 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:24.601901 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53f093-28ee-456c-b5bf-2e00dbe95e95 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:24.602176 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53f093-28ee-456c-b5bf-2e00dbe95e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:24.622952 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-59a5df84-a02d-401a-b147-520ccb2720e1 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:24.624192 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-59a5df84-a02d-401a-b147-520ccb2720e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:24.625051 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-7b53f093-28ee-456c-b5bf-2e00dbe95e95 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:24.626334 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-7b53f093-28ee-456c-b5bf-2e00dbe95e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:24.632363 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 768/1548] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:24.632917 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a5df84-a02d-401a-b147-520ccb2720e1 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:24.634787 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 781/1549] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:24.636610 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696ab63-8eaa-44a9-bafd-85d140693d0a None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:24.636761 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696ab63-8eaa-44a9-bafd-85d140693d0a None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:24.636951 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696ab63-8eaa-44a9-bafd-85d140693d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:24.651462 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a5df84-a02d-401a-b147-520ccb2720e1 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:24.657348 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f837c7-c2d0-4fbe-a3be-965d5cc58c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:24.658361 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f837c7-c2d0-4fbe-a3be-965d5cc58c4a admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:24.658576 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-c696ab63-8eaa-44a9-bafd-85d140693d0a None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:24.659071 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f837c7-c2d0-4fbe-a3be-965d5cc58c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:24.659592 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f837c7-c2d0-4fbe-a3be-965d5cc58c4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:24.659788 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-c696ab63-8eaa-44a9-bafd-85d140693d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:24.661180 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f837c7-c2d0-4fbe-a3be-965d5cc58c4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:24.663556 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f837c7-c2d0-4fbe-a3be-965d5cc58c4a admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:24.668537 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 782/1550] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:24.669790 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0b532-3955-421d-af0e-fecf37513d2b None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:24.670083 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0b532-3955-421d-af0e-fecf37513d2b None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:24.670362 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0b532-3955-421d-af0e-fecf37513d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:24.678995 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 769/1551] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:58:24.680412 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cdeb8-3bd4-49a8-a39d-ee74b525aff9 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:24.680706 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cdeb8-3bd4-49a8-a39d-ee74b525aff9 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:24.681155 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cdeb8-3bd4-49a8-a39d-ee74b525aff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:24.689558 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-e8f0b532-3955-421d-af0e-fecf37513d2b None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:24.690743 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-e8f0b532-3955-421d-af0e-fecf37513d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:24.702685 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-cc6cdeb8-3bd4-49a8-a39d-ee74b525aff9 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:24.703721 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 783/1552] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:24.703889 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-cc6cdeb8-3bd4-49a8-a39d-ee74b525aff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:24.707944 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0b532-3955-421d-af0e-fecf37513d2b None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:24.715790 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 770/1553] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:24.715790 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7855eb-5020-4e94-be98-22bc2781b93a None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:24.715790 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7855eb-5020-4e94-be98-22bc2781b93a None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:24.715790 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7855eb-5020-4e94-be98-22bc2781b93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:24.722597 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0b532-3955-421d-af0e-fecf37513d2b None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:24.728918 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47f204-aef6-4c10-bc2f-747da98a8628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:24.729646 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47f204-aef6-4c10-bc2f-747da98a8628 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:24.729940 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47f204-aef6-4c10-bc2f-747da98a8628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:24.730215 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47f204-aef6-4c10-bc2f-747da98a8628 admin admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:24.731393 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d47f204-aef6-4c10-bc2f-747da98a8628 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:58:24.731738 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d47f204-aef6-4c10-bc2f-747da98a8628 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:24.733384 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d47f204-aef6-4c10-bc2f-747da98a8628 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:24.737185 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-5c7855eb-5020-4e94-be98-22bc2781b93a None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:24.738311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-5c7855eb-5020-4e94-be98-22bc2781b93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:24.747154 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 784/1554] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 11:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:58:24.748597 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d694f5-0ec5-47eb-a37f-ccbd23fc1834 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:24.756081 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d694f5-0ec5-47eb-a37f-ccbd23fc1834 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:24.756254 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 771/1555] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:24.756350 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d694f5-0ec5-47eb-a37f-ccbd23fc1834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:24.756440 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c697696-fd93-464d-bcf0-57db275fd18b None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:24.756440 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c697696-fd93-464d-bcf0-57db275fd18b None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:24.756440 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c697696-fd93-464d-bcf0-57db275fd18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:24.768677 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-2c697696-fd93-464d-bcf0-57db275fd18b None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:24.769854 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-2c697696-fd93-464d-bcf0-57db275fd18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:24.771704 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-b2d694f5-0ec5-47eb-a37f-ccbd23fc1834 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:24.773139 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-b2d694f5-0ec5-47eb-a37f-ccbd23fc1834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:24.778217 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 772/1556] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:24.779282 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca02a9e-4fa6-4c87-b762-9db9e6dc1453 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:24.779711 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca02a9e-4fa6-4c87-b762-9db9e6dc1453 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:24.780003 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca02a9e-4fa6-4c87-b762-9db9e6dc1453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:24.781138 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 785/1557] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:24.781801 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d694f5-0ec5-47eb-a37f-ccbd23fc1834 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:24.795470 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d694f5-0ec5-47eb-a37f-ccbd23fc1834 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:24.800434 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915891ff-c937-4e9b-a5fa-e325cee7a156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:24.800980 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-4ca02a9e-4fa6-4c87-b762-9db9e6dc1453 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:24.801097 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915891ff-c937-4e9b-a5fa-e325cee7a156 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:24.801356 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915891ff-c937-4e9b-a5fa-e325cee7a156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:24.801634 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915891ff-c937-4e9b-a5fa-e325cee7a156 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:24.802145 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-4ca02a9e-4fa6-4c87-b762-9db9e6dc1453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:24.802356 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915891ff-c937-4e9b-a5fa-e325cee7a156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:24.803984 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915891ff-c937-4e9b-a5fa-e325cee7a156 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:24.811061 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 773/1558] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:24.811975 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca02a9e-4fa6-4c87-b762-9db9e6dc1453 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:24.817477 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 786/1559] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:58:24.817477 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac070100-7b38-4912-8fce-8f3b9a00f61f None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:24.817477 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac070100-7b38-4912-8fce-8f3b9a00f61f None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:24.817477 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac070100-7b38-4912-8fce-8f3b9a00f61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:24.821531 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca02a9e-4fa6-4c87-b762-9db9e6dc1453 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:24.826029 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634fecdf-c22e-4a2b-810a-98556ee7890b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:24.826683 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fecdf-c22e-4a2b-810a-98556ee7890b admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:24.826959 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fecdf-c22e-4a2b-810a-98556ee7890b admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:24.827230 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fecdf-c22e-4a2b-810a-98556ee7890b admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:24.828048 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634fecdf-c22e-4a2b-810a-98556ee7890b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:58:24.828353 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634fecdf-c22e-4a2b-810a-98556ee7890b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:24.829365 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: WARNING py.warnings [None req-634fecdf-c22e-4a2b-810a-98556ee7890b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 11:58:24.829365 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: warnings.warn(msg) Jun 03 11:58:24.829365 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: Jun 03 11:58:24.830267 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634fecdf-c22e-4a2b-810a-98556ee7890b admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:24.837173 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-ac070100-7b38-4912-8fce-8f3b9a00f61f None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:24.838757 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-ac070100-7b38-4912-8fce-8f3b9a00f61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:24.842295 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 774/1560] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 11:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:58:24.843163 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634fecdf-c22e-4a2b-810a-98556ee7890b admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:24.849616 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 787/1561] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:24.852028 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f4a66-da3c-46bf-b671-131fcf07e1ed None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:24.852518 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f4a66-da3c-46bf-b671-131fcf07e1ed None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:24.853476 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f4a66-da3c-46bf-b671-131fcf07e1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:24.855880 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634fecdf-c22e-4a2b-810a-98556ee7890b admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:24.860670 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f53506-3e7d-4082-acd7-7ade3eaa1ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:24.861319 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f53506-3e7d-4082-acd7-7ade3eaa1ccb admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:24.861605 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f53506-3e7d-4082-acd7-7ade3eaa1ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:24.861884 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f53506-3e7d-4082-acd7-7ade3eaa1ccb admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:24.862565 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f53506-3e7d-4082-acd7-7ade3eaa1ccb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:24.864511 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f53506-3e7d-4082-acd7-7ade3eaa1ccb admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:24.873276 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-fa0f4a66-da3c-46bf-b671-131fcf07e1ed None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:24.874526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-fa0f4a66-da3c-46bf-b671-131fcf07e1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:24.882859 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 788/1562] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:24.883777 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f4a66-da3c-46bf-b671-131fcf07e1ed None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:24.893483 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f4a66-da3c-46bf-b671-131fcf07e1ed None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:24.899532 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 775/1563] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:58:24 2022] POST /identity/v3/projects => generated 393 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:58:24.899532 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f53506-3e7d-4082-acd7-7ade3eaa1ccb admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:24.948876 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:24.951809 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bbd4d6-e535-49c5-8429-f6b2a5ff4779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:24.952476 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbd4d6-e535-49c5-8429-f6b2a5ff4779 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:24.952821 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbd4d6-e535-49c5-8429-f6b2a5ff4779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:24.953028 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbd4d6-e535-49c5-8429-f6b2a5ff4779 admin admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:24.953749 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bbd4d6-e535-49c5-8429-f6b2a5ff4779 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:58:24.954060 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bbd4d6-e535-49c5-8429-f6b2a5ff4779 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:24.955713 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bbd4d6-e535-49c5-8429-f6b2a5ff4779 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:24.957315 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:24.964401 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f53506-3e7d-4082-acd7-7ade3eaa1ccb admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:24.969212 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 789/1564] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 11:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:58:24.969353 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d26a58-a8a1-41a5-b53b-d33645270728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:24.969941 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d26a58-a8a1-41a5-b53b-d33645270728 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:24.970229 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d26a58-a8a1-41a5-b53b-d33645270728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:24.970507 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d26a58-a8a1-41a5-b53b-d33645270728 admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:24.970857 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bbd4d6-e535-49c5-8429-f6b2a5ff4779 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:24.971245 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d26a58-a8a1-41a5-b53b-d33645270728 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:58:24.971571 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d26a58-a8a1-41a5-b53b-d33645270728 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:24.973183 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d26a58-a8a1-41a5-b53b-d33645270728 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:24.983343 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bbd4d6-e535-49c5-8429-f6b2a5ff4779 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:24.986192 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 776/1565] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 11:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:58:24.986970 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d26a58-a8a1-41a5-b53b-d33645270728 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:24.994672 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0167e-0d94-4e9c-ac97-dcceceb5c0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:24.995274 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0167e-0d94-4e9c-ac97-dcceceb5c0f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:24.995662 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0167e-0d94-4e9c-ac97-dcceceb5c0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:24.995947 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0167e-0d94-4e9c-ac97-dcceceb5c0f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:24.996677 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f0167e-0d94-4e9c-ac97-dcceceb5c0f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:58:24.996985 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f0167e-0d94-4e9c-ac97-dcceceb5c0f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:24.998584 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f0167e-0d94-4e9c-ac97-dcceceb5c0f7 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:24.998921 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d26a58-a8a1-41a5-b53b-d33645270728 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:25.003442 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd025d36-e0c2-423d-8b71-e2b3e8345e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:25.004333 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd025d36-e0c2-423d-8b71-e2b3e8345e33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:25.004615 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd025d36-e0c2-423d-8b71-e2b3e8345e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:25.004890 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd025d36-e0c2-423d-8b71-e2b3e8345e33 admin admin] PATH_INFO: `/v3/projects/8b87f5539aa64ca4bfdaa22476c23704/users/fd203c30da624663942daa16da7f52d7/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:25.010760 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 790/1566] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 11:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:58:25.011553 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0167e-0d94-4e9c-ac97-dcceceb5c0f7 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:25.019796 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd025d36-e0c2-423d-8b71-e2b3e8345e33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b87f5539aa64ca4bfdaa22476c23704, user_id=fd203c30da624663942daa16da7f52d7, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:25.021529 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0167e-0d94-4e9c-ac97-dcceceb5c0f7 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:25.022439 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd025d36-e0c2-423d-8b71-e2b3e8345e33 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:25.027199 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df0023-34d8-4ca7-8e29-a8eda871d679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:25.028016 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df0023-34d8-4ca7-8e29-a8eda871d679 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:25.028405 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df0023-34d8-4ca7-8e29-a8eda871d679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:25.028720 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df0023-34d8-4ca7-8e29-a8eda871d679 admin admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:25.029589 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df0023-34d8-4ca7-8e29-a8eda871d679 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:25.030738 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: WARNING py.warnings [None req-17df0023-34d8-4ca7-8e29-a8eda871d679 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 11:58:25.030738 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: warnings.warn(msg) Jun 03 11:58:25.030738 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: Jun 03 11:58:25.032067 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df0023-34d8-4ca7-8e29-a8eda871d679 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:25.036705 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 777/1567] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:58:24 2022] PUT /identity/v3/projects/8b87f5539aa64ca4bfdaa22476c23704/users/fd203c30da624663942daa16da7f52d7/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:25.037498 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd025d36-e0c2-423d-8b71-e2b3e8345e33 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:25.058767 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 791/1568] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:58:25 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:58:25.059757 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df0023-34d8-4ca7-8e29-a8eda871d679 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:25.105822 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd025d36-e0c2-423d-8b71-e2b3e8345e33 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:25.122710 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df0023-34d8-4ca7-8e29-a8eda871d679 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:25.127292 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4b524-cc1a-4d29-bbe1-a988c02e9abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:25.127985 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4b524-cc1a-4d29-bbe1-a988c02e9abc admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:25.128271 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4b524-cc1a-4d29-bbe1-a988c02e9abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:25.128547 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4b524-cc1a-4d29-bbe1-a988c02e9abc admin admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:25.129276 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4b524-cc1a-4d29-bbe1-a988c02e9abc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:58:25.129578 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4b524-cc1a-4d29-bbe1-a988c02e9abc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:25.131180 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4b524-cc1a-4d29-bbe1-a988c02e9abc admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:25.143228 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 792/1569] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 11:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:58:25.143844 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4b524-cc1a-4d29-bbe1-a988c02e9abc admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:25.156169 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4b524-cc1a-4d29-bbe1-a988c02e9abc admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:25.161213 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aede66-79d9-4a81-a46a-6b091f44b5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:25.161971 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aede66-79d9-4a81-a46a-6b091f44b5c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:25.162385 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aede66-79d9-4a81-a46a-6b091f44b5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:25.162488 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154e478-d57c-4a4c-8f3e-81adfdd66887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:25.162703 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aede66-79d9-4a81-a46a-6b091f44b5c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:25.163087 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154e478-d57c-4a4c-8f3e-81adfdd66887 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:25.163370 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154e478-d57c-4a4c-8f3e-81adfdd66887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:25.163530 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aede66-79d9-4a81-a46a-6b091f44b5c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:25.163673 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154e478-d57c-4a4c-8f3e-81adfdd66887 admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:25.164395 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154e478-d57c-4a4c-8f3e-81adfdd66887 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:58:25.164699 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154e478-d57c-4a4c-8f3e-81adfdd66887 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:25.165820 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aede66-79d9-4a81-a46a-6b091f44b5c4 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:25.166358 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154e478-d57c-4a4c-8f3e-81adfdd66887 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:25.178392 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 778/1570] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 11:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:58:25.179425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154e478-d57c-4a4c-8f3e-81adfdd66887 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:25.189459 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 793/1571] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:58:25 2022] POST /identity/v3/users => generated 297 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:58:25.190603 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aede66-79d9-4a81-a46a-6b091f44b5c4 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:25.191258 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154e478-d57c-4a4c-8f3e-81adfdd66887 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:25.196147 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca9c7e2-a021-45c9-beea-9f2c472c32ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:25.197485 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9c7e2-a021-45c9-beea-9f2c472c32ab admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:25.197826 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9c7e2-a021-45c9-beea-9f2c472c32ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:25.198109 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9c7e2-a021-45c9-beea-9f2c472c32ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:25.198790 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca9c7e2-a021-45c9-beea-9f2c472c32ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:25.200767 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca9c7e2-a021-45c9-beea-9f2c472c32ab admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:25.201119 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aede66-79d9-4a81-a46a-6b091f44b5c4 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:25.205891 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa283bb-2749-4aa8-8f2f-418e96a8955b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:25.206591 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa283bb-2749-4aa8-8f2f-418e96a8955b admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:25.206972 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa283bb-2749-4aa8-8f2f-418e96a8955b admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:25.207316 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa283bb-2749-4aa8-8f2f-418e96a8955b admin admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:25.208081 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa283bb-2749-4aa8-8f2f-418e96a8955b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:25.210009 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa283bb-2749-4aa8-8f2f-418e96a8955b admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:25.226117 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 779/1572] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:58:25 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:58:25.226897 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca9c7e2-a021-45c9-beea-9f2c472c32ab admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:25.235178 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 794/1573] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:58:25 2022] POST /identity/v3/projects => generated 391 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:58:25.236734 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7579d0a-083c-4a9f-88ce-68bde2fce06e None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:25.237031 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7579d0a-083c-4a9f-88ce-68bde2fce06e None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:25.237314 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7579d0a-083c-4a9f-88ce-68bde2fce06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:25.264132 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-f7579d0a-083c-4a9f-88ce-68bde2fce06e None None] MFA Rules not processed for user `fd203c30da624663942daa16da7f52d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:25.265476 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-f7579d0a-083c-4a9f-88ce-68bde2fce06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:25.266860 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:25.290725 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca9c7e2-a021-45c9-beea-9f2c472c32ab admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:25.331218 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 795/1574] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:25 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:25.334896 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7579d0a-083c-4a9f-88ce-68bde2fce06e None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:25.336426 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:25.349590 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7059b2-7fc7-4576-b0ea-939f12add663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:25.350251 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7059b2-7fc7-4576-b0ea-939f12add663 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:25.350534 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7059b2-7fc7-4576-b0ea-939f12add663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:25.350809 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7059b2-7fc7-4576-b0ea-939f12add663 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:25.351496 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7059b2-7fc7-4576-b0ea-939f12add663 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:25.353479 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7059b2-7fc7-4576-b0ea-939f12add663 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:25.380507 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 780/1575] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:58:25 2022] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:58:25.381312 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7059b2-7fc7-4576-b0ea-939f12add663 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:25.400271 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7579d0a-083c-4a9f-88ce-68bde2fce06e None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:25.442503 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7059b2-7fc7-4576-b0ea-939f12add663 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:25.447959 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e81cd-2436-4e9e-9169-ea14c8ce4f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:25.448618 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e81cd-2436-4e9e-9169-ea14c8ce4f58 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:25.448904 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e81cd-2436-4e9e-9169-ea14c8ce4f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:25.449179 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e81cd-2436-4e9e-9169-ea14c8ce4f58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:25.449870 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e81cd-2436-4e9e-9169-ea14c8ce4f58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:25.451810 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e81cd-2436-4e9e-9169-ea14c8ce4f58 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:25.455315 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e7430-24de-40b8-b92f-836063b050f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:25.456073 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e7430-24de-40b8-b92f-836063b050f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:25.456357 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e7430-24de-40b8-b92f-836063b050f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:25.456660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e7430-24de-40b8-b92f-836063b050f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:25.457351 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26e7430-24de-40b8-b92f-836063b050f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:25.459269 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26e7430-24de-40b8-b92f-836063b050f3 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:25.479087 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 796/1576] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:58:25 2022] POST /identity/v3/users => generated 288 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:58:25.479922 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e7430-24de-40b8-b92f-836063b050f3 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:25.485878 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 781/1577] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:58:25 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:58:25.485878 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e81cd-2436-4e9e-9169-ea14c8ce4f58 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:25.489657 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e7430-24de-40b8-b92f-836063b050f3 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:25.534725 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:25.545423 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e895b4-4ea4-4040-8f46-af94c6a893b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:25.546080 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e895b4-4ea4-4040-8f46-af94c6a893b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:25.546361 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e895b4-4ea4-4040-8f46-af94c6a893b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:25.546632 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e895b4-4ea4-4040-8f46-af94c6a893b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:25.546805 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e81cd-2436-4e9e-9169-ea14c8ce4f58 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:25.547308 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e895b4-4ea4-4040-8f46-af94c6a893b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:25.549293 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e895b4-4ea4-4040-8f46-af94c6a893b0 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:25.551424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af1774-4766-46c4-a756-32b8436f8479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:25.552119 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af1774-4766-46c4-a756-32b8436f8479 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:25.552402 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af1774-4766-46c4-a756-32b8436f8479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:25.552678 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af1774-4766-46c4-a756-32b8436f8479 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:25.553393 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67af1774-4766-46c4-a756-32b8436f8479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:25.554981 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67af1774-4766-46c4-a756-32b8436f8479 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:25.565724 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 782/1578] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:58:25.566545 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af1774-4766-46c4-a756-32b8436f8479 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:25.576539 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af1774-4766-46c4-a756-32b8436f8479 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:25.579462 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 797/1579] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:58:25 2022] POST /identity/v3/projects => generated 389 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:58:25.581142 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b054a367-271b-465c-b892-a491fb33c0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:25.581800 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054a367-271b-465c-b892-a491fb33c0d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:25.582078 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054a367-271b-465c-b892-a491fb33c0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:25.582379 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054a367-271b-465c-b892-a491fb33c0d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:25.583011 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b054a367-271b-465c-b892-a491fb33c0d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:25.583469 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e895b4-4ea4-4040-8f46-af94c6a893b0 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:25.584033 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: WARNING py.warnings [None req-b054a367-271b-465c-b892-a491fb33c0d6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 11:58:25.584033 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: warnings.warn(msg) Jun 03 11:58:25.584033 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: Jun 03 11:58:25.585210 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b054a367-271b-465c-b892-a491fb33c0d6 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:25.606795 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 783/1580] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:58:25 2022] POST /identity/v3/users => generated 289 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:58:25.607608 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b054a367-271b-465c-b892-a491fb33c0d6 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:25.611645 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:25.617869 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b054a367-271b-465c-b892-a491fb33c0d6 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:25.648583 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e895b4-4ea4-4040-8f46-af94c6a893b0 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:25.653118 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b5ac4-d965-4938-8a7e-cd4e5bcd5d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:25.653780 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b5ac4-d965-4938-8a7e-cd4e5bcd5d1d admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:25.654062 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b5ac4-d965-4938-8a7e-cd4e5bcd5d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:25.654336 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b5ac4-d965-4938-8a7e-cd4e5bcd5d1d admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:25.655011 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b5ac4-d965-4938-8a7e-cd4e5bcd5d1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:25.656958 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b5ac4-d965-4938-8a7e-cd4e5bcd5d1d admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:25.674090 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b98457-7d27-4678-b205-5ebfa5f0320c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:25.674753 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b98457-7d27-4678-b205-5ebfa5f0320c admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:25.675036 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b98457-7d27-4678-b205-5ebfa5f0320c admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:25.675316 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b98457-7d27-4678-b205-5ebfa5f0320c admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:25.676036 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b98457-7d27-4678-b205-5ebfa5f0320c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:25.677956 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b98457-7d27-4678-b205-5ebfa5f0320c admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:25.679698 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 798/1581] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:58:25 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:58:25.681012 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b5ac4-d965-4938-8a7e-cd4e5bcd5d1d admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:25.692817 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b5ac4-d965-4938-8a7e-cd4e5bcd5d1d admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:25.697711 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f872b-839c-4e11-ad26-579a9c868313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:25.698373 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f872b-839c-4e11-ad26-579a9c868313 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:25.698674 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f872b-839c-4e11-ad26-579a9c868313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:25.698971 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f872b-839c-4e11-ad26-579a9c868313 admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:25.699711 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f872b-839c-4e11-ad26-579a9c868313 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:25.701633 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f872b-839c-4e11-ad26-579a9c868313 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:25.708735 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 784/1582] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:58:25 2022] POST /identity/v3/projects => generated 357 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:58:25.708735 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b98457-7d27-4678-b205-5ebfa5f0320c admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:25.721365 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 799/1583] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:58:25 2022] POST /identity/v3/users => generated 287 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:58:25.722424 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f872b-839c-4e11-ad26-579a9c868313 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:25.732975 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f872b-839c-4e11-ad26-579a9c868313 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:25.771574 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b98457-7d27-4678-b205-5ebfa5f0320c admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:25.777041 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db069ce-84e5-4d98-b20e-ad179c104dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:25.777731 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db069ce-84e5-4d98-b20e-ad179c104dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:25.778042 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db069ce-84e5-4d98-b20e-ad179c104dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:25.778317 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db069ce-84e5-4d98-b20e-ad179c104dd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:25.779038 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db069ce-84e5-4d98-b20e-ad179c104dd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:25.780671 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db069ce-84e5-4d98-b20e-ad179c104dd4 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:25.794120 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 785/1584] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:58:25.794120 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db069ce-84e5-4d98-b20e-ad179c104dd4 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:25.795179 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa9990-072d-458d-a2db-6318ddbbbff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:25.795939 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa9990-072d-458d-a2db-6318ddbbbff8 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:25.796229 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa9990-072d-458d-a2db-6318ddbbbff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:25.796507 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa9990-072d-458d-a2db-6318ddbbbff8 admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:25.797191 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa9990-072d-458d-a2db-6318ddbbbff8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:25.799111 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa9990-072d-458d-a2db-6318ddbbbff8 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:25.803745 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db069ce-84e5-4d98-b20e-ad179c104dd4 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:25.808318 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2590cad-ced7-465c-ba68-411e6733dc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:25.808947 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2590cad-ced7-465c-ba68-411e6733dc75 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:25.809229 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2590cad-ced7-465c-ba68-411e6733dc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:25.809504 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2590cad-ced7-465c-ba68-411e6733dc75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:25.810208 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2590cad-ced7-465c-ba68-411e6733dc75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:25.811853 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2590cad-ced7-465c-ba68-411e6733dc75 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:25.820171 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 800/1585] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:58:25 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:58:25.821224 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa9990-072d-458d-a2db-6318ddbbbff8 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:25.824850 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 786/1586] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:58:25.824850 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2590cad-ced7-465c-ba68-411e6733dc75 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:25.831233 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa9990-072d-458d-a2db-6318ddbbbff8 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:25.833790 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2590cad-ced7-465c-ba68-411e6733dc75 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:25.835739 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095afc4-cb86-4540-a14c-305f7433d8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:25.836378 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095afc4-cb86-4540-a14c-305f7433d8ac admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:25.836660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095afc4-cb86-4540-a14c-305f7433d8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:25.836933 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095afc4-cb86-4540-a14c-305f7433d8ac admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:25.838154 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5095afc4-cb86-4540-a14c-305f7433d8ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:25.839072 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da879c-a64e-4e31-9867-6a19f02a4d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:25.839804 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da879c-a64e-4e31-9867-6a19f02a4d87 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:25.840068 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5095afc4-cb86-4540-a14c-305f7433d8ac admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:25.840213 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da879c-a64e-4e31-9867-6a19f02a4d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:25.840555 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da879c-a64e-4e31-9867-6a19f02a4d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:25.841323 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da879c-a64e-4e31-9867-6a19f02a4d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:25.842966 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da879c-a64e-4e31-9867-6a19f02a4d87 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:25.856426 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 787/1587] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:58:25.856426 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da879c-a64e-4e31-9867-6a19f02a4d87 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:25.863585 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 801/1588] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:58:25 2022] POST /identity/v3/users => generated 295 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:58:25.863585 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095afc4-cb86-4540-a14c-305f7433d8ac admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:25.864495 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da879c-a64e-4e31-9867-6a19f02a4d87 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:25.869490 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff749fe-9eec-4e79-8c9b-cb7e57e34b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:25.870166 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff749fe-9eec-4e79-8c9b-cb7e57e34b09 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:25.870446 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff749fe-9eec-4e79-8c9b-cb7e57e34b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:25.870783 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff749fe-9eec-4e79-8c9b-cb7e57e34b09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:25.871288 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095afc4-cb86-4540-a14c-305f7433d8ac admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:25.871493 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff749fe-9eec-4e79-8c9b-cb7e57e34b09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:25.873170 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff749fe-9eec-4e79-8c9b-cb7e57e34b09 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:25.875766 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4da468-7efe-4471-a85b-b762c11d492a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:25.876407 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4da468-7efe-4471-a85b-b762c11d492a admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:25.876685 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4da468-7efe-4471-a85b-b762c11d492a admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:25.876959 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4da468-7efe-4471-a85b-b762c11d492a admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:25.877631 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4da468-7efe-4471-a85b-b762c11d492a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:25.879512 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4da468-7efe-4471-a85b-b762c11d492a admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:25.888076 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 788/1589] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:58:25.889126 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff749fe-9eec-4e79-8c9b-cb7e57e34b09 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:25.902652 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff749fe-9eec-4e79-8c9b-cb7e57e34b09 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:25.905872 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 802/1590] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:58:25 2022] POST /identity/v3/users => generated 285 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:58:25.906793 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4da468-7efe-4471-a85b-b762c11d492a admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:25.909453 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21de15-6f99-41a8-8375-176fb71c6c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:25.910428 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21de15-6f99-41a8-8375-176fb71c6c8d admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:25.910428 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21de15-6f99-41a8-8375-176fb71c6c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:25.910700 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21de15-6f99-41a8-8375-176fb71c6c8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:25.911423 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b21de15-6f99-41a8-8375-176fb71c6c8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:25.913047 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b21de15-6f99-41a8-8375-176fb71c6c8d admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:25.918359 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4da468-7efe-4471-a85b-b762c11d492a admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:25.922862 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a19d4-9d22-48ec-80f0-18eb8c6a9eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:25.923542 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a19d4-9d22-48ec-80f0-18eb8c6a9eca admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:25.923716 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 789/1591] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:58:25.924492 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21de15-6f99-41a8-8375-176fb71c6c8d admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:25.924609 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a19d4-9d22-48ec-80f0-18eb8c6a9eca admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:25.924872 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a19d4-9d22-48ec-80f0-18eb8c6a9eca admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:25.925632 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a19d4-9d22-48ec-80f0-18eb8c6a9eca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:25.927306 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a19d4-9d22-48ec-80f0-18eb8c6a9eca admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:25.933682 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21de15-6f99-41a8-8375-176fb71c6c8d admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:25.938084 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5451e0-a534-400d-bf27-e0b6e41786e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:25.938706 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5451e0-a534-400d-bf27-e0b6e41786e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:25.938828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 803/1592] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:58:25.938983 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5451e0-a534-400d-bf27-e0b6e41786e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:25.939253 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5451e0-a534-400d-bf27-e0b6e41786e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:25.939557 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a19d4-9d22-48ec-80f0-18eb8c6a9eca admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:25.939992 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5451e0-a534-400d-bf27-e0b6e41786e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:25.941542 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5451e0-a534-400d-bf27-e0b6e41786e5 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:25.943723 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:25.949177 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a19d4-9d22-48ec-80f0-18eb8c6a9eca admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:25.953910 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 790/1593] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:58:25.954037 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9680d-f4c5-40b9-93cb-e7b7c635c955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:25.954802 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9680d-f4c5-40b9-93cb-e7b7c635c955 admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:25.954992 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5451e0-a534-400d-bf27-e0b6e41786e5 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:25.955095 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9680d-f4c5-40b9-93cb-e7b7c635c955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:25.955350 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9680d-f4c5-40b9-93cb-e7b7c635c955 admin admin] PATH_INFO: `/v3/projects/8af67916348c49ec9bb1b61a26e07849/users/a3f1e1d5983645ae9e4f5c8248a677af/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:25.967308 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5451e0-a534-400d-bf27-e0b6e41786e5 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:25.970396 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9680d-f4c5-40b9-93cb-e7b7c635c955 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8af67916348c49ec9bb1b61a26e07849, user_id=a3f1e1d5983645ae9e4f5c8248a677af, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:25.971441 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: WARNING py.warnings [None req-49e9680d-f4c5-40b9-93cb-e7b7c635c955 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 11:58:25.971441 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: warnings.warn(msg) Jun 03 11:58:25.971441 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: Jun 03 11:58:25.972403 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bae674-c53d-4027-b8fd-1704fb425956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:25.973037 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bae674-c53d-4027-b8fd-1704fb425956 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:25.973316 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bae674-c53d-4027-b8fd-1704fb425956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:25.973425 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9680d-f4c5-40b9-93cb-e7b7c635c955 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:25.973586 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bae674-c53d-4027-b8fd-1704fb425956 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:25.974286 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bae674-c53d-4027-b8fd-1704fb425956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:25.975987 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bae674-c53d-4027-b8fd-1704fb425956 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:25.986831 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 791/1594] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:58:25.987486 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 804/1595] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:58:25 2022] PUT /identity/v3/projects/8af67916348c49ec9bb1b61a26e07849/users/a3f1e1d5983645ae9e4f5c8248a677af/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:25.987646 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bae674-c53d-4027-b8fd-1704fb425956 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:25.988211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9680d-f4c5-40b9-93cb-e7b7c635c955 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:26.004958 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bae674-c53d-4027-b8fd-1704fb425956 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:26.011759 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=84,keystone:INSERT=16 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:26.057191 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9680d-f4c5-40b9-93cb-e7b7c635c955 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:26.061708 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af572d-452c-4152-91db-0c2907f8c1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:26.062369 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af572d-452c-4152-91db-0c2907f8c1cf admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:26.062653 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af572d-452c-4152-91db-0c2907f8c1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:26.062925 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af572d-452c-4152-91db-0c2907f8c1cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:26.063307 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab696b-b7ef-4a60-b8ab-abac807c3368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:26.063676 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af572d-452c-4152-91db-0c2907f8c1cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:26.064016 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab696b-b7ef-4a60-b8ab-abac807c3368 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:26.064301 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab696b-b7ef-4a60-b8ab-abac807c3368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:26.064629 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab696b-b7ef-4a60-b8ab-abac807c3368 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:26.065359 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af572d-452c-4152-91db-0c2907f8c1cf admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:26.065472 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab696b-b7ef-4a60-b8ab-abac807c3368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:26.066978 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab696b-b7ef-4a60-b8ab-abac807c3368 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:26.075228 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 805/1596] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:58:26.076133 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af572d-452c-4152-91db-0c2907f8c1cf admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:26.079545 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 792/1597] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:58:26.079545 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab696b-b7ef-4a60-b8ab-abac807c3368 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:26.087995 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af572d-452c-4152-91db-0c2907f8c1cf admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:26.088178 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab696b-b7ef-4a60-b8ab-abac807c3368 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:26.092600 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138171a-c698-48ba-b963-cb86e2f2d3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:26.092735 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe370cd-d1f1-4b87-9a70-f695d42dca8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:26.093256 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138171a-c698-48ba-b963-cb86e2f2d3cd admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:26.093379 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe370cd-d1f1-4b87-9a70-f695d42dca8e admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:26.093546 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138171a-c698-48ba-b963-cb86e2f2d3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:26.093667 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe370cd-d1f1-4b87-9a70-f695d42dca8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:26.093826 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138171a-c698-48ba-b963-cb86e2f2d3cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:26.093933 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe370cd-d1f1-4b87-9a70-f695d42dca8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:26.094540 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe370cd-d1f1-4b87-9a70-f695d42dca8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:26.094650 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9138171a-c698-48ba-b963-cb86e2f2d3cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:26.096153 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe370cd-d1f1-4b87-9a70-f695d42dca8e admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:26.096281 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9138171a-c698-48ba-b963-cb86e2f2d3cd admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:26.106446 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 793/1598] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:58:26.107205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe370cd-d1f1-4b87-9a70-f695d42dca8e admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:26.109902 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 806/1599] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:58:26.110747 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138171a-c698-48ba-b963-cb86e2f2d3cd admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:26.116854 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe370cd-d1f1-4b87-9a70-f695d42dca8e admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:26.119983 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138171a-c698-48ba-b963-cb86e2f2d3cd admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:26.121497 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60695c93-afd3-4f17-8115-dcacaccf4d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:26.122483 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60695c93-afd3-4f17-8115-dcacaccf4d3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:26.122868 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60695c93-afd3-4f17-8115-dcacaccf4d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:26.123151 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60695c93-afd3-4f17-8115-dcacaccf4d3a admin admin] PATH_INFO: `/v3/projects/932d50c10e154de1a975be797066af93/users/f8ca2eac0d21457ca347f2a48e5727f8/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:26.124663 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4508e49-ebea-405c-ba84-de5a4df372c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:26.125302 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4508e49-ebea-405c-ba84-de5a4df372c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:26.125586 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4508e49-ebea-405c-ba84-de5a4df372c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:26.125864 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4508e49-ebea-405c-ba84-de5a4df372c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:26.126578 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4508e49-ebea-405c-ba84-de5a4df372c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:26.128188 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4508e49-ebea-405c-ba84-de5a4df372c5 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:26.138445 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60695c93-afd3-4f17-8115-dcacaccf4d3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=932d50c10e154de1a975be797066af93, user_id=f8ca2eac0d21457ca347f2a48e5727f8, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:26.138752 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 807/1600] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:58:26.139529 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4508e49-ebea-405c-ba84-de5a4df372c5 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:26.141123 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60695c93-afd3-4f17-8115-dcacaccf4d3a admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:26.150500 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4508e49-ebea-405c-ba84-de5a4df372c5 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:26.155449 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 794/1601] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:58:26 2022] PUT /identity/v3/projects/932d50c10e154de1a975be797066af93/users/f8ca2eac0d21457ca347f2a48e5727f8/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:26.156570 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19121d93-ad00-4830-83dd-9d252930fd98 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:26.156845 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19121d93-ad00-4830-83dd-9d252930fd98 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:26.157125 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19121d93-ad00-4830-83dd-9d252930fd98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:26.185648 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-19121d93-ad00-4830-83dd-9d252930fd98 None None] MFA Rules not processed for user `a3f1e1d5983645ae9e4f5c8248a677af`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:26.186854 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-19121d93-ad00-4830-83dd-9d252930fd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:26.216720 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b78eed-20e4-40ba-8214-a22946648d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:26.217604 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b78eed-20e4-40ba-8214-a22946648d35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:26.217886 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b78eed-20e4-40ba-8214-a22946648d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:26.218342 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b78eed-20e4-40ba-8214-a22946648d35 admin admin] PATH_INFO: `/v3/projects/d10936ccaf444728a01afc3f374e2285/users/8e1d264439b340c3af56cad54b7bc4a4/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:26.232212 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b78eed-20e4-40ba-8214-a22946648d35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d10936ccaf444728a01afc3f374e2285, user_id=8e1d264439b340c3af56cad54b7bc4a4, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:26.234867 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b78eed-20e4-40ba-8214-a22946648d35 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:26.249552 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 808/1602] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:58:26 2022] PUT /identity/v3/projects/d10936ccaf444728a01afc3f374e2285/users/8e1d264439b340c3af56cad54b7bc4a4/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:26.250711 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 795/1603] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:26.251577 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19121d93-ad00-4830-83dd-9d252930fd98 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:26.252444 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b78eed-20e4-40ba-8214-a22946648d35 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:26.262971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19121d93-ad00-4830-83dd-9d252930fd98 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:26.297709 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:26.317649 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b78eed-20e4-40ba-8214-a22946648d35 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:26.321431 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4fa3a-14e1-4f89-8c56-6eacb9a7a0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:26.322738 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4fa3a-14e1-4f89-8c56-6eacb9a7a0f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:26.322869 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d280a-0fee-42b0-8da4-1d14b0abc881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:26.323020 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4fa3a-14e1-4f89-8c56-6eacb9a7a0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:26.323293 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4fa3a-14e1-4f89-8c56-6eacb9a7a0f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:26.323731 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d280a-0fee-42b0-8da4-1d14b0abc881 admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:26.324048 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c4fa3a-14e1-4f89-8c56-6eacb9a7a0f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:26.324154 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d280a-0fee-42b0-8da4-1d14b0abc881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:26.324383 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d280a-0fee-42b0-8da4-1d14b0abc881 admin admin] PATH_INFO: `/v3/projects/799fb68a55084528ab5573051a1bf121/users/abcc58cb66804297b184e41726c281bb/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:26.325656 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c4fa3a-14e1-4f89-8c56-6eacb9a7a0f7 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:26.338535 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 796/1604] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:58:26.338535 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4fa3a-14e1-4f89-8c56-6eacb9a7a0f7 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:26.343031 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d280a-0fee-42b0-8da4-1d14b0abc881 admin admin] RBAC: Authorizing `identity:create_grant(project_id=799fb68a55084528ab5573051a1bf121, user_id=abcc58cb66804297b184e41726c281bb, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:26.345708 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d280a-0fee-42b0-8da4-1d14b0abc881 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:26.346580 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4fa3a-14e1-4f89-8c56-6eacb9a7a0f7 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:26.348760 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:26.351696 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ec207-5f27-43a4-8bb4-ea82bb8c97d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:26.352772 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ec207-5f27-43a4-8bb4-ea82bb8c97d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:26.353184 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ec207-5f27-43a4-8bb4-ea82bb8c97d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:26.353451 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ec207-5f27-43a4-8bb4-ea82bb8c97d1 admin admin] PATH_INFO: `/v3/projects/177ba26010014be49d0e78d80ce6ede0/users/19db6485deb347158f0cd7c7bccbd3eb/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:26.360823 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 809/1605] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:58:26 2022] PUT /identity/v3/projects/799fb68a55084528ab5573051a1bf121/users/abcc58cb66804297b184e41726c281bb/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:26.365077 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d280a-0fee-42b0-8da4-1d14b0abc881 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:26.368943 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ec207-5f27-43a4-8bb4-ea82bb8c97d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=177ba26010014be49d0e78d80ce6ede0, user_id=19db6485deb347158f0cd7c7bccbd3eb, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:26.371803 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ec207-5f27-43a4-8bb4-ea82bb8c97d1 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:26.385377 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 797/1606] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:58:26 2022] PUT /identity/v3/projects/177ba26010014be49d0e78d80ce6ede0/users/19db6485deb347158f0cd7c7bccbd3eb/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:26.395772 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ec207-5f27-43a4-8bb4-ea82bb8c97d1 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:26.429087 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d280a-0fee-42b0-8da4-1d14b0abc881 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:26.448902 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ec207-5f27-43a4-8bb4-ea82bb8c97d1 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:26.453751 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7efcbe1-da06-483c-b62c-be49aae30a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:26.454626 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efcbe1-da06-483c-b62c-be49aae30a06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:26.454905 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efcbe1-da06-483c-b62c-be49aae30a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:26.455178 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efcbe1-da06-483c-b62c-be49aae30a06 admin admin] PATH_INFO: `/v3/projects/2c931d0d666d47c8a1c7bd1b3d83aec0/users/d25b6b5454bb4aa2b3c24ca97cef9c72/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:26.470166 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7efcbe1-da06-483c-b62c-be49aae30a06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c931d0d666d47c8a1c7bd1b3d83aec0, user_id=d25b6b5454bb4aa2b3c24ca97cef9c72, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:26.473350 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7efcbe1-da06-483c-b62c-be49aae30a06 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:26.485325 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af622f81-7472-4a7a-902a-a5c6bfbf56a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:26.486136 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 798/1607] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:58:26 2022] PUT /identity/v3/projects/2c931d0d666d47c8a1c7bd1b3d83aec0/users/d25b6b5454bb4aa2b3c24ca97cef9c72/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:26.497282 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af622f81-7472-4a7a-902a-a5c6bfbf56a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:26.497282 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af622f81-7472-4a7a-902a-a5c6bfbf56a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:26.497282 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af622f81-7472-4a7a-902a-a5c6bfbf56a1 admin admin] PATH_INFO: `/v3/projects/2722e33ceacf4fb38cf4389c2dffef5f/users/d360b227a26b4e399d08b39f6c91b3c3/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:26.497604 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04a706-064c-4a61-a5a6-09f4277dcf63 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:26.497604 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04a706-064c-4a61-a5a6-09f4277dcf63 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:26.497604 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04a706-064c-4a61-a5a6-09f4277dcf63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:26.501845 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af622f81-7472-4a7a-902a-a5c6bfbf56a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2722e33ceacf4fb38cf4389c2dffef5f, user_id=d360b227a26b4e399d08b39f6c91b3c3, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:26.504646 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af622f81-7472-4a7a-902a-a5c6bfbf56a1 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:26.519036 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 810/1608] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:58:26 2022] PUT /identity/v3/projects/2722e33ceacf4fb38cf4389c2dffef5f/users/d360b227a26b4e399d08b39f6c91b3c3/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:26.519633 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-5a04a706-064c-4a61-a5a6-09f4277dcf63 None None] MFA Rules not processed for user `f8ca2eac0d21457ca347f2a48e5727f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:26.520358 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c97f0-ee9a-43f7-af7e-0fb2e83d877d None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:26.520636 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c97f0-ee9a-43f7-af7e-0fb2e83d877d None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:26.520919 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c97f0-ee9a-43f7-af7e-0fb2e83d877d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:26.521275 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-5a04a706-064c-4a61-a5a6-09f4277dcf63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:26.538497 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-421c97f0-ee9a-43f7-af7e-0fb2e83d877d None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:26.539799 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-421c97f0-ee9a-43f7-af7e-0fb2e83d877d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:26.588716 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 799/1609] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:26.589368 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04a706-064c-4a61-a5a6-09f4277dcf63 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:26.607261 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 811/1610] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:26.608159 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c97f0-ee9a-43f7-af7e-0fb2e83d877d None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:26.617900 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c97f0-ee9a-43f7-af7e-0fb2e83d877d None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:26.620926 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:26.624324 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdfc3b-0004-48ee-8207-9beca504e84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:26.626164 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdfc3b-0004-48ee-8207-9beca504e84f admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:26.626461 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdfc3b-0004-48ee-8207-9beca504e84f admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:26.626745 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdfc3b-0004-48ee-8207-9beca504e84f admin admin] PATH_INFO: `/v3/projects/89467b1c15334264bf384b711292808b/users/b76f9ea7268a4e70a402f3c9ea6220e7/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:26.643745 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbdfc3b-0004-48ee-8207-9beca504e84f admin admin] RBAC: Authorizing `identity:create_grant(project_id=89467b1c15334264bf384b711292808b, user_id=b76f9ea7268a4e70a402f3c9ea6220e7, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:26.646408 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbdfc3b-0004-48ee-8207-9beca504e84f admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:26.659411 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 812/1611] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:58:26 2022] PUT /identity/v3/projects/89467b1c15334264bf384b711292808b/users/b76f9ea7268a4e70a402f3c9ea6220e7/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:26.663314 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04a706-064c-4a61-a5a6-09f4277dcf63 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:26.664092 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbfd007-cc04-490f-9f38-66f325c84e56 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:26.664387 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbfd007-cc04-490f-9f38-66f325c84e56 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:26.664671 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbfd007-cc04-490f-9f38-66f325c84e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:26.670213 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:26.685444 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-acbfd007-cc04-490f-9f38-66f325c84e56 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:26.686648 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-acbfd007-cc04-490f-9f38-66f325c84e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:26.720544 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a381b7-1966-463d-bc6b-0db7df8d5dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:26.721202 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a381b7-1966-463d-bc6b-0db7df8d5dbd admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:26.721486 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a381b7-1966-463d-bc6b-0db7df8d5dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:26.721756 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a381b7-1966-463d-bc6b-0db7df8d5dbd admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:26.722432 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a381b7-1966-463d-bc6b-0db7df8d5dbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:26.724366 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a381b7-1966-463d-bc6b-0db7df8d5dbd admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:26.745652 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 813/1612] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:26.747153 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2eccf3-f159-4128-bc72-f62f698ed818 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:26.747445 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2eccf3-f159-4128-bc72-f62f698ed818 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:26.747757 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2eccf3-f159-4128-bc72-f62f698ed818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:26.753099 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 800/1613] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:58:26 2022] POST /identity/v3/projects => generated 391 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:58:26.754261 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b50e4-a64a-45a2-96b3-c777691f3c40 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:26.754555 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b50e4-a64a-45a2-96b3-c777691f3c40 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:26.754832 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b50e4-a64a-45a2-96b3-c777691f3c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:26.777399 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-ef2eccf3-f159-4128-bc72-f62f698ed818 None None] MFA Rules not processed for user `19db6485deb347158f0cd7c7bccbd3eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:26.778591 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-ef2eccf3-f159-4128-bc72-f62f698ed818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:26.781423 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-ab4b50e4-a64a-45a2-96b3-c777691f3c40 None None] MFA Rules not processed for user `d25b6b5454bb4aa2b3c24ca97cef9c72`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:26.782687 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-ab4b50e4-a64a-45a2-96b3-c777691f3c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:26.843916 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 814/1614] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:26.844833 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2eccf3-f159-4128-bc72-f62f698ed818 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:26.851671 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 801/1615] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:26.853050 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d645180-8853-4c91-b4c0-cda39a06ca44 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:26.853452 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d645180-8853-4c91-b4c0-cda39a06ca44 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:26.853628 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d645180-8853-4c91-b4c0-cda39a06ca44 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:26.854903 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 802/1616] 10.222.0.15 () {54 vars in 961 bytes} [Fri Jun 3 11:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:58:26.855620 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d645180-8853-4c91-b4c0-cda39a06ca44 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:26.857231 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-3d645180-8853-4c91-b4c0-cda39a06ca44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:26.914123 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:26.921965 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2eccf3-f159-4128-bc72-f62f698ed818 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:26.926614 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c26c1-d0f3-48bd-839c-fba9a12c1c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:26.927091 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d645180-8853-4c91-b4c0-cda39a06ca44 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:26.927283 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c26c1-d0f3-48bd-839c-fba9a12c1c88 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:26.927593 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c26c1-d0f3-48bd-839c-fba9a12c1c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:26.927873 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c26c1-d0f3-48bd-839c-fba9a12c1c88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:26.928599 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73c26c1-d0f3-48bd-839c-fba9a12c1c88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:26.930183 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73c26c1-d0f3-48bd-839c-fba9a12c1c88 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:26.931779 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f62fbd-9f90-445a-8fc2-c819d2172a8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:26.932663 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f62fbd-9f90-445a-8fc2-c819d2172a8d service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:26.933003 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f62fbd-9f90-445a-8fc2-c819d2172a8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:26.933374 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f62fbd-9f90-445a-8fc2-c819d2172a8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:26.940608 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 815/1617] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:58:26.941785 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887dcdc-9cec-4282-967b-8e5b173f62be None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:26.942065 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887dcdc-9cec-4282-967b-8e5b173f62be None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:26.942343 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887dcdc-9cec-4282-967b-8e5b173f62be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:26.946096 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f62fbd-9f90-445a-8fc2-c819d2172a8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:26.947570 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f62fbd-9f90-445a-8fc2-c819d2172a8d service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:26.957488 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 803/1618] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:58:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:58:26.958245 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f62fbd-9f90-445a-8fc2-c819d2172a8d service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:26.959083 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-f887dcdc-9cec-4282-967b-8e5b173f62be None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:26.960348 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-f887dcdc-9cec-4282-967b-8e5b173f62be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:26.967165 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f62fbd-9f90-445a-8fc2-c819d2172a8d service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:26.971190 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 816/1619] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:26.971190 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887dcdc-9cec-4282-967b-8e5b173f62be None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:26.976059 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291816f-859a-42c5-bb2b-0162f9de31c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:26.976732 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291816f-859a-42c5-bb2b-0162f9de31c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:26.977017 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291816f-859a-42c5-bb2b-0162f9de31c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:26.977297 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291816f-859a-42c5-bb2b-0162f9de31c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:26.978494 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291816f-859a-42c5-bb2b-0162f9de31c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:26.980545 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291816f-859a-42c5-bb2b-0162f9de31c5 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:26.984562 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887dcdc-9cec-4282-967b-8e5b173f62be None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:26.988446 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d2ea5-67cf-4be3-ad7e-d54888bcafc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:26.989193 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d2ea5-67cf-4be3-ad7e-d54888bcafc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:26.989478 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d2ea5-67cf-4be3-ad7e-d54888bcafc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:26.989795 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d2ea5-67cf-4be3-ad7e-d54888bcafc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:27.002535 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85d2ea5-67cf-4be3-ad7e-d54888bcafc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:27.002972 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 804/1620] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:58:26 2022] POST /identity/v3/users => generated 302 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:58:27.002972 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291816f-859a-42c5-bb2b-0162f9de31c5 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:27.006092 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85d2ea5-67cf-4be3-ad7e-d54888bcafc5 service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:27.016109 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 817/1621] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:58:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:58:27.016415 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291816f-859a-42c5-bb2b-0162f9de31c5 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:27.017362 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d54f0-fcef-4b11-8f02-b8522ea855fb None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:27.017647 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d54f0-fcef-4b11-8f02-b8522ea855fb None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:27.017918 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d54f0-fcef-4b11-8f02-b8522ea855fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:27.021338 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2f736-4ee0-42d8-b689-bc75d5178e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:27.022061 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2f736-4ee0-42d8-b689-bc75d5178e44 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:27.022413 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2f736-4ee0-42d8-b689-bc75d5178e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:27.023017 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2f736-4ee0-42d8-b689-bc75d5178e44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:27.023918 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2f736-4ee0-42d8-b689-bc75d5178e44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:27.026940 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2f736-4ee0-42d8-b689-bc75d5178e44 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:27.037983 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-7b8d54f0-fcef-4b11-8f02-b8522ea855fb None None] MFA Rules not processed for user `6247bfb7aebd45eeb97ba5933be44c6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:27.039258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-7b8d54f0-fcef-4b11-8f02-b8522ea855fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:27.046005 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:27.062740 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 805/1622] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:58:27 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:58:27.062740 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4be37-3660-473b-82f4-2b5da9926873 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:27.062740 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4be37-3660-473b-82f4-2b5da9926873 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:27.062740 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4be37-3660-473b-82f4-2b5da9926873 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:27.063622 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 806/1623] 10.222.0.15 () {54 vars in 961 bytes} [Fri Jun 3 11:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:58:27.064350 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4be37-3660-473b-82f4-2b5da9926873 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:27.121148 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 818/1624] 10.222.0.15 () {58 vars in 1058 bytes} [Fri Jun 3 11:58:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:27.125416 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d54f0-fcef-4b11-8f02-b8522ea855fb None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:27.142075 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4be37-3660-473b-82f4-2b5da9926873 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:27.145543 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d54f0-fcef-4b11-8f02-b8522ea855fb None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:27.148819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1178ef-8329-4ed2-a62a-9d17daf40325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:27.149837 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1178ef-8329-4ed2-a62a-9d17daf40325 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:27.150251 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1178ef-8329-4ed2-a62a-9d17daf40325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:27.150706 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1178ef-8329-4ed2-a62a-9d17daf40325 admin admin] PATH_INFO: `/v3/projects/2722e33ceacf4fb38cf4389c2dffef5f/users/d360b227a26b4e399d08b39f6c91b3c3/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:27.153110 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1178ef-8329-4ed2-a62a-9d17daf40325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2722e33ceacf4fb38cf4389c2dffef5f, user_id=d360b227a26b4e399d08b39f6c91b3c3, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:27.155963 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1178ef-8329-4ed2-a62a-9d17daf40325 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:27.171894 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 807/1625] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:58:27 2022] PUT /identity/v3/projects/2722e33ceacf4fb38cf4389c2dffef5f/users/d360b227a26b4e399d08b39f6c91b3c3/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:27.172890 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1178ef-8329-4ed2-a62a-9d17daf40325 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:27.218933 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de15b5-2e8b-4d31-b5ca-7746f4ea3fbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:27.219731 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de15b5-2e8b-4d31-b5ca-7746f4ea3fbc service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:27.220467 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de15b5-2e8b-4d31-b5ca-7746f4ea3fbc service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:27.220467 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de15b5-2e8b-4d31-b5ca-7746f4ea3fbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:27.232200 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de15b5-2e8b-4d31-b5ca-7746f4ea3fbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:27.233774 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de15b5-2e8b-4d31-b5ca-7746f4ea3fbc service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:27.246071 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 819/1626] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:58:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:58:27.247122 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de15b5-2e8b-4d31-b5ca-7746f4ea3fbc service neutron] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:27.248847 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1178ef-8329-4ed2-a62a-9d17daf40325 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:27.254301 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff80205-bc40-4560-9415-8a47f236bc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:27.255068 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff80205-bc40-4560-9415-8a47f236bc2d admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:27.255420 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff80205-bc40-4560-9415-8a47f236bc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:27.255786 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff80205-bc40-4560-9415-8a47f236bc2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:27.256653 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff80205-bc40-4560-9415-8a47f236bc2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:27.258370 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de15b5-2e8b-4d31-b5ca-7746f4ea3fbc service neutron] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:27.258520 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff80205-bc40-4560-9415-8a47f236bc2d admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:27.264700 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5c994-a182-4791-b411-62f49d4986a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:27.265481 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5c994-a182-4791-b411-62f49d4986a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:27.265797 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5c994-a182-4791-b411-62f49d4986a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:27.266688 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5c994-a182-4791-b411-62f49d4986a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:27.267544 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a5c994-a182-4791-b411-62f49d4986a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:27.269478 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a5c994-a182-4791-b411-62f49d4986a4 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:27.270120 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 808/1627] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:58:27.270120 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9aa1ee-e1b7-4b3f-b5d4-e04ac54503b4 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:27.270120 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9aa1ee-e1b7-4b3f-b5d4-e04ac54503b4 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:27.270120 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9aa1ee-e1b7-4b3f-b5d4-e04ac54503b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:27.294975 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-6c9aa1ee-e1b7-4b3f-b5d4-e04ac54503b4 None None] MFA Rules not processed for user `6247bfb7aebd45eeb97ba5933be44c6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:27.296330 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-6c9aa1ee-e1b7-4b3f-b5d4-e04ac54503b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:27.302067 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 820/1628] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:58:27 2022] POST /identity/v3/users => generated 293 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:58:27.303849 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5c994-a182-4791-b411-62f49d4986a4 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:27.351894 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:27.402028 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 809/1629] 10.222.0.15 () {58 vars in 1058 bytes} [Fri Jun 3 11:58:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:27.404970 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9255ab-ad7e-4054-b095-22503651d251 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:27.405118 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9255ab-ad7e-4054-b095-22503651d251 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:27.405398 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9255ab-ad7e-4054-b095-22503651d251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:27.423689 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5c994-a182-4791-b411-62f49d4986a4 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:27.431617 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf12f34-fe1b-4c36-86ce-f18ad6925a7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:27.432484 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf12f34-fe1b-4c36-86ce-f18ad6925a7a service nova] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:27.432951 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf12f34-fe1b-4c36-86ce-f18ad6925a7a service nova] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:27.433302 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf12f34-fe1b-4c36-86ce-f18ad6925a7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:27.446892 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-7e9255ab-ad7e-4054-b095-22503651d251 None None] MFA Rules not processed for user `d360b227a26b4e399d08b39f6c91b3c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:27.448540 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-7e9255ab-ad7e-4054-b095-22503651d251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:27.496166 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:27.542773 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf12f34-fe1b-4c36-86ce-f18ad6925a7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:27.544567 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf12f34-fe1b-4c36-86ce-f18ad6925a7a service nova] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:27.546544 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 810/1630] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:27 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:27.547613 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9255ab-ad7e-4054-b095-22503651d251 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:27.570349 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 821/1631] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:58:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:58:27.571189 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf12f34-fe1b-4c36-86ce-f18ad6925a7a service nova] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:27.575197 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9255ab-ad7e-4054-b095-22503651d251 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:27.583042 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd5b79-4ef0-4aef-a03c-f7ba7a67bc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:27.584112 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd5b79-4ef0-4aef-a03c-f7ba7a67bc76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:27.584495 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd5b79-4ef0-4aef-a03c-f7ba7a67bc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:27.585767 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd5b79-4ef0-4aef-a03c-f7ba7a67bc76 admin admin] PATH_INFO: `/v3/projects/5009317ef9274b6f8cbb440dac20a3fe/users/aae5bd454f6642f9bd0b0b03875da8c8/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:27.592314 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf12f34-fe1b-4c36-86ce-f18ad6925a7a service nova] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:27.606621 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe403f-7017-4ad1-9cb4-e55dafbd102b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:27.607300 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe403f-7017-4ad1-9cb4-e55dafbd102b admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:27.607628 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe403f-7017-4ad1-9cb4-e55dafbd102b admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:27.607957 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe403f-7017-4ad1-9cb4-e55dafbd102b admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:27.608701 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe403f-7017-4ad1-9cb4-e55dafbd102b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:27.612495 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe403f-7017-4ad1-9cb4-e55dafbd102b admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:27.615433 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dd5b79-4ef0-4aef-a03c-f7ba7a67bc76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5009317ef9274b6f8cbb440dac20a3fe, user_id=aae5bd454f6642f9bd0b0b03875da8c8, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:27.620011 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dd5b79-4ef0-4aef-a03c-f7ba7a67bc76 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:27.650733 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 822/1632] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:58:27.656877 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 811/1633] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:58:27 2022] PUT /identity/v3/projects/5009317ef9274b6f8cbb440dac20a3fe/users/aae5bd454f6642f9bd0b0b03875da8c8/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:27.656877 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd5b79-4ef0-4aef-a03c-f7ba7a67bc76 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:27.659009 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe403f-7017-4ad1-9cb4-e55dafbd102b admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:27.752283 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe403f-7017-4ad1-9cb4-e55dafbd102b admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:27.842058 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd5b79-4ef0-4aef-a03c-f7ba7a67bc76 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:27.860798 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef3763-64ca-4f9c-b377-c956fc5e9b5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:27.862487 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef3763-64ca-4f9c-b377-c956fc5e9b5a service nova] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:27.862970 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef3763-64ca-4f9c-b377-c956fc5e9b5a service nova] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:27.863883 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef3763-64ca-4f9c-b377-c956fc5e9b5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:27.873698 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8b19a-a041-40d2-a557-08f2a5974e07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:27.874329 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8b19a-a041-40d2-a557-08f2a5974e07 service cinder] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:27.874620 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8b19a-a041-40d2-a557-08f2a5974e07 service cinder] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:27.874927 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8b19a-a041-40d2-a557-08f2a5974e07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:27.927694 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:27.984840 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab8b19a-a041-40d2-a557-08f2a5974e07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:27.986327 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef3763-64ca-4f9c-b377-c956fc5e9b5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:27.986472 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab8b19a-a041-40d2-a557-08f2a5974e07 service cinder] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:27.990993 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef3763-64ca-4f9c-b377-c956fc5e9b5a service nova] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:28.013047 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 823/1634] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:58:27 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:58:28.013047 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8b19a-a041-40d2-a557-08f2a5974e07 service cinder] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:28.016399 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 812/1635] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:58:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:58:28.016399 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef3763-64ca-4f9c-b377-c956fc5e9b5a service nova] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:28.059630 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:28.162043 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8b19a-a041-40d2-a557-08f2a5974e07 service cinder] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:28.168293 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4838d62-faae-4154-80d1-a5b04d48ab3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:28.169385 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4838d62-faae-4154-80d1-a5b04d48ab3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:28.169791 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4838d62-faae-4154-80d1-a5b04d48ab3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:28.170175 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4838d62-faae-4154-80d1-a5b04d48ab3c admin admin] PATH_INFO: `/v3/projects/f90c1356492b4cbcb5c3b29d9453f10e/users/954b3befe91043ae89d71bd4b06cbb6d/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:28.176514 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef3763-64ca-4f9c-b377-c956fc5e9b5a service nova] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:28.198110 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c84507-75a6-4c53-8328-dd92036f9260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:28.198882 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c84507-75a6-4c53-8328-dd92036f9260 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:28.199473 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4838d62-faae-4154-80d1-a5b04d48ab3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f90c1356492b4cbcb5c3b29d9453f10e, user_id=954b3befe91043ae89d71bd4b06cbb6d, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:28.202477 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c84507-75a6-4c53-8328-dd92036f9260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:28.202610 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c84507-75a6-4c53-8328-dd92036f9260 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:28.203426 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c84507-75a6-4c53-8328-dd92036f9260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:28.205165 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c84507-75a6-4c53-8328-dd92036f9260 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:28.205611 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4838d62-faae-4154-80d1-a5b04d48ab3c admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:28.226805 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 813/1637] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:58:28.228207 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c84507-75a6-4c53-8328-dd92036f9260 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:28.231360 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 824/1637] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:58:28 2022] PUT /identity/v3/projects/f90c1356492b4cbcb5c3b29d9453f10e/users/954b3befe91043ae89d71bd4b06cbb6d/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:28.232748 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f9147-197a-4627-8f2d-d47dd0bc493e None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:28.233130 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f9147-197a-4627-8f2d-d47dd0bc493e None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:28.233482 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f9147-197a-4627-8f2d-d47dd0bc493e None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:28.234928 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 825/1638] 10.222.0.15 () {54 vars in 912 bytes} [Fri Jun 3 11:58:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:58:28.235737 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f9147-197a-4627-8f2d-d47dd0bc493e None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:28.245981 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c84507-75a6-4c53-8328-dd92036f9260 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:28.340364 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f9147-197a-4627-8f2d-d47dd0bc493e None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:28.349399 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ec5cc-1e88-4a32-89d3-5d7468cc4eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:28.352260 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ec5cc-1e88-4a32-89d3-5d7468cc4eea admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:28.353326 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ec5cc-1e88-4a32-89d3-5d7468cc4eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:28.353939 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ec5cc-1e88-4a32-89d3-5d7468cc4eea admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:28.354901 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13ec5cc-1e88-4a32-89d3-5d7468cc4eea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:28.356909 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13ec5cc-1e88-4a32-89d3-5d7468cc4eea admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:28.364904 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba70031-3fe5-490f-8ff5-2a7ba4cb01c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:28.369182 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba70031-3fe5-490f-8ff5-2a7ba4cb01c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:28.369606 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba70031-3fe5-490f-8ff5-2a7ba4cb01c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:28.369860 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba70031-3fe5-490f-8ff5-2a7ba4cb01c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:28.386255 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 826/1639] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:58:28.390615 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ec5cc-1e88-4a32-89d3-5d7468cc4eea admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:28.407194 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ec5cc-1e88-4a32-89d3-5d7468cc4eea admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:28.419421 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d853e98-dc95-4b0c-9cb7-917733005de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:28.421016 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d853e98-dc95-4b0c-9cb7-917733005de6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:28.421508 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d853e98-dc95-4b0c-9cb7-917733005de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:28.422044 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d853e98-dc95-4b0c-9cb7-917733005de6 admin admin] PATH_INFO: `/v3/projects/5009317ef9274b6f8cbb440dac20a3fe/users/aae5bd454f6642f9bd0b0b03875da8c8/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:28.426622 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d853e98-dc95-4b0c-9cb7-917733005de6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5009317ef9274b6f8cbb440dac20a3fe, user_id=aae5bd454f6642f9bd0b0b03875da8c8, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:28.434416 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d853e98-dc95-4b0c-9cb7-917733005de6 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:28.456358 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 827/1640] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:58:28 2022] PUT /identity/v3/projects/5009317ef9274b6f8cbb440dac20a3fe/users/aae5bd454f6642f9bd0b0b03875da8c8/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:28.469055 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e888c9-0475-4cf5-a179-da3528262a60 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:28.469624 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e888c9-0475-4cf5-a179-da3528262a60 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:28.470060 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e888c9-0475-4cf5-a179-da3528262a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:28.509316 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-15e888c9-0475-4cf5-a179-da3528262a60 None None] MFA Rules not processed for user `6247bfb7aebd45eeb97ba5933be44c6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:28.511805 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-15e888c9-0475-4cf5-a179-da3528262a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:28.515613 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba70031-3fe5-490f-8ff5-2a7ba4cb01c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:28.517659 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba70031-3fe5-490f-8ff5-2a7ba4cb01c2 service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:28.548787 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 814/1641] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:58:28 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:58:28.551085 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba70031-3fe5-490f-8ff5-2a7ba4cb01c2 service cinder] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:28.573698 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba70031-3fe5-490f-8ff5-2a7ba4cb01c2 service cinder] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:28.609228 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:28.621456 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 828/1642] 10.222.0.15 () {58 vars in 1009 bytes} [Fri Jun 3 11:58:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:28.623298 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031a88b-ad93-49b8-8181-df7f11c5f06c None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:28.623835 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031a88b-ad93-49b8-8181-df7f11c5f06c None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:28.624325 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031a88b-ad93-49b8-8181-df7f11c5f06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:28.669288 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-3031a88b-ad93-49b8-8181-df7f11c5f06c None None] MFA Rules not processed for user `aae5bd454f6642f9bd0b0b03875da8c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:28.672567 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-3031a88b-ad93-49b8-8181-df7f11c5f06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:28.696931 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:28.719172 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a485d-66f1-4e33-9fe3-dc2d4998d0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:28.720206 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a485d-66f1-4e33-9fe3-dc2d4998d0c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:28.720512 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a485d-66f1-4e33-9fe3-dc2d4998d0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:28.720790 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a485d-66f1-4e33-9fe3-dc2d4998d0c3 admin admin] PATH_INFO: `/v3/projects/f90c1356492b4cbcb5c3b29d9453f10e/users/954b3befe91043ae89d71bd4b06cbb6d/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:28.723107 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a485d-66f1-4e33-9fe3-dc2d4998d0c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f90c1356492b4cbcb5c3b29d9453f10e, user_id=954b3befe91043ae89d71bd4b06cbb6d, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:28.730870 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a485d-66f1-4e33-9fe3-dc2d4998d0c3 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:28.776079 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 815/1643] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:58:28 2022] PUT /identity/v3/projects/f90c1356492b4cbcb5c3b29d9453f10e/users/954b3befe91043ae89d71bd4b06cbb6d/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:28.779328 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c4d79-1b7b-4700-8347-cf61a4a83e8e None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:28.784703 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c4d79-1b7b-4700-8347-cf61a4a83e8e None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:28.785355 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c4d79-1b7b-4700-8347-cf61a4a83e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:28.834521 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-113c4d79-1b7b-4700-8347-cf61a4a83e8e None None] MFA Rules not processed for user `8e1d264439b340c3af56cad54b7bc4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:28.836746 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-113c4d79-1b7b-4700-8347-cf61a4a83e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:28.862332 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 829/1644] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:28 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:28.864041 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee8ae9-1f90-4b27-953a-35e811f454ca None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:28.864483 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee8ae9-1f90-4b27-953a-35e811f454ca None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:28.864838 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee8ae9-1f90-4b27-953a-35e811f454ca None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:28.882054 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 830/1645] 10.222.0.15 () {54 vars in 912 bytes} [Fri Jun 3 11:58:28 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:58:28.883128 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee8ae9-1f90-4b27-953a-35e811f454ca None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:28.984707 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee8ae9-1f90-4b27-953a-35e811f454ca None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:28.998244 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b50151-5595-4d05-b12c-ec50970be836 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:28.998919 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b50151-5595-4d05-b12c-ec50970be836 service cinder] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:28.999253 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b50151-5595-4d05-b12c-ec50970be836 service cinder] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:28.999464 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b50151-5595-4d05-b12c-ec50970be836 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:29.000795 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 816/1646] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:29.002377 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ad589-4088-4c6a-a80e-143b7727f684 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:29.002867 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ad589-4088-4c6a-a80e-143b7727f684 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:29.003240 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ad589-4088-4c6a-a80e-143b7727f684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:29.065526 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-3e8ad589-4088-4c6a-a80e-143b7727f684 None None] MFA Rules not processed for user `954b3befe91043ae89d71bd4b06cbb6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:29.067276 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-3e8ad589-4088-4c6a-a80e-143b7727f684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:29.091271 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b50151-5595-4d05-b12c-ec50970be836 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:29.093267 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b50151-5595-4d05-b12c-ec50970be836 service cinder] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:29.107192 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 831/1647] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:58:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:58:29.108698 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c49920-b9fc-409e-8865-796e44ee7ad9 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:29.108973 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c49920-b9fc-409e-8865-796e44ee7ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:29.109204 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c49920-b9fc-409e-8865-796e44ee7ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:29.128151 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-59c49920-b9fc-409e-8865-796e44ee7ad9 None None] MFA Rules not processed for user `6247bfb7aebd45eeb97ba5933be44c6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:29.129531 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-59c49920-b9fc-409e-8865-796e44ee7ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:29.140805 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 832/1648] 10.222.0.15 () {58 vars in 1009 bytes} [Fri Jun 3 11:58:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:29.141945 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c49920-b9fc-409e-8865-796e44ee7ad9 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:29.152898 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c49920-b9fc-409e-8865-796e44ee7ad9 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:29.156970 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59563795-5e65-4bb7-989c-133e174cf5bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:29.157772 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59563795-5e65-4bb7-989c-133e174cf5bc service cinder] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:29.158064 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59563795-5e65-4bb7-989c-133e174cf5bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:29.158397 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59563795-5e65-4bb7-989c-133e174cf5bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:29.198697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:29.230785 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59563795-5e65-4bb7-989c-133e174cf5bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:29.232300 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59563795-5e65-4bb7-989c-133e174cf5bc service cinder] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:29.238404 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 817/1649] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:29 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:29.241416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a33623-e409-4e37-812f-8c3d4d512d9e None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:29.241717 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a33623-e409-4e37-812f-8c3d4d512d9e None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:29.241997 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a33623-e409-4e37-812f-8c3d4d512d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:29.242718 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 833/1650] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:58:29 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:58:29.277637 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-d1a33623-e409-4e37-812f-8c3d4d512d9e None None] MFA Rules not processed for user `8e1d264439b340c3af56cad54b7bc4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:29.279333 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-d1a33623-e409-4e37-812f-8c3d4d512d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:29.288262 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 818/1651] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:29.315855 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59563795-5e65-4bb7-989c-133e174cf5bc service cinder] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:29.339756 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59563795-5e65-4bb7-989c-133e174cf5bc service cinder] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:29.349309 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a33623-e409-4e37-812f-8c3d4d512d9e None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:29.371225 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a33623-e409-4e37-812f-8c3d4d512d9e None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:29.377762 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb67b0d-4edf-496a-ab8b-20148e14390b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:29.379722 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb67b0d-4edf-496a-ab8b-20148e14390b service nova] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:29.380117 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb67b0d-4edf-496a-ab8b-20148e14390b service nova] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:29.380991 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb67b0d-4edf-496a-ab8b-20148e14390b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:29.386235 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ff1ca-262d-4a41-9bf3-a3babc25c72d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:29.387199 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ff1ca-262d-4a41-9bf3-a3babc25c72d service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:29.387726 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ff1ca-262d-4a41-9bf3-a3babc25c72d service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:29.388167 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ff1ca-262d-4a41-9bf3-a3babc25c72d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:29.402651 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb67b0d-4edf-496a-ab8b-20148e14390b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:29.408256 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714ff1ca-262d-4a41-9bf3-a3babc25c72d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:29.409759 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714ff1ca-262d-4a41-9bf3-a3babc25c72d service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:29.410640 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb67b0d-4edf-496a-ab8b-20148e14390b service nova] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:29.426572 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 834/1652] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:58:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:58:29.427629 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb67b0d-4edf-496a-ab8b-20148e14390b service nova] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:29.437984 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb67b0d-4edf-496a-ab8b-20148e14390b service nova] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:29.438479 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 819/1653] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:58:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:58:29.444263 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2689a-6cc8-4cd2-9359-48dab8fc51cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:29.445085 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2689a-6cc8-4cd2-9359-48dab8fc51cf service cinder] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:29.445635 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2689a-6cc8-4cd2-9359-48dab8fc51cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:29.446015 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2689a-6cc8-4cd2-9359-48dab8fc51cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:29.460100 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2689a-6cc8-4cd2-9359-48dab8fc51cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:29.464940 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2689a-6cc8-4cd2-9359-48dab8fc51cf service cinder] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:29.479544 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 835/1654] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:58:29 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:58:29.548006 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ff1ca-262d-4a41-9bf3-a3babc25c72d service cinder] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:29.566816 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ff1ca-262d-4a41-9bf3-a3babc25c72d service cinder] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:29.570657 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aaeb5b-18e8-42d2-ad18-653aa105e775 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:29.571298 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aaeb5b-18e8-42d2-ad18-653aa105e775 service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:29.572236 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aaeb5b-18e8-42d2-ad18-653aa105e775 service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:29.572513 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aaeb5b-18e8-42d2-ad18-653aa105e775 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:29.581030 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:29.686626 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aaeb5b-18e8-42d2-ad18-653aa105e775 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:29.690069 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aaeb5b-18e8-42d2-ad18-653aa105e775 service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:29.717490 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 820/1655] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:58:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:58:30.073911 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65134f88-fb80-4938-b266-ce8f5a0dd769 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:30.074361 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65134f88-fb80-4938-b266-ce8f5a0dd769 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:30.074833 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65134f88-fb80-4938-b266-ce8f5a0dd769 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:30.078055 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 836/1656] 10.222.0.15 () {54 vars in 912 bytes} [Fri Jun 3 11:58:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:58:30.086021 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e71d26-c8fc-44c4-8278-ddde8836382f None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:30.086346 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e71d26-c8fc-44c4-8278-ddde8836382f None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:30.086643 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e71d26-c8fc-44c4-8278-ddde8836382f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:30.183949 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-00e71d26-c8fc-44c4-8278-ddde8836382f None None] MFA Rules not processed for user `a78b4284099546cd9c126a5739380b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:30.186371 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-00e71d26-c8fc-44c4-8278-ddde8836382f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:30.268529 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 821/1657] 10.222.0.15 () {58 vars in 1009 bytes} [Fri Jun 3 11:58:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:30.310690 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65134f88-fb80-4938-b266-ce8f5a0dd769 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:30.326349 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65134f88-fb80-4938-b266-ce8f5a0dd769 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:30.336144 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846ac0e-0d33-4abc-bca0-d2c81ae3ab67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:30.336801 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846ac0e-0d33-4abc-bca0-d2c81ae3ab67 service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:30.337604 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846ac0e-0d33-4abc-bca0-d2c81ae3ab67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:30.339885 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846ac0e-0d33-4abc-bca0-d2c81ae3ab67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:30.359574 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f846ac0e-0d33-4abc-bca0-d2c81ae3ab67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:30.361107 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f846ac0e-0d33-4abc-bca0-d2c81ae3ab67 service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:30.382885 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 837/1658] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:58:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:58:31.043064 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e71d26-c8fc-44c4-8278-ddde8836382f None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:31.200126 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e71d26-c8fc-44c4-8278-ddde8836382f None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:31.249300 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7ab5f-4502-465c-8c69-1caedc83f698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:31.249300 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7ab5f-4502-465c-8c69-1caedc83f698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:31.249300 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7ab5f-4502-465c-8c69-1caedc83f698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:31.249300 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7ab5f-4502-465c-8c69-1caedc83f698 admin admin] PATH_INFO: `/v3/users/f8ca2eac0d21457ca347f2a48e5727f8` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:31.249697 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf7ab5f-4502-465c-8c69-1caedc83f698 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8ca2eac0d21457ca347f2a48e5727f8)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:31.249697 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf7ab5f-4502-465c-8c69-1caedc83f698 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:31.361153 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:31.365660 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-cdf7ab5f-4502-465c-8c69-1caedc83f698 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8ca2eac0d21457ca347f2a48e5727f8'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:31.381572 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-cdf7ab5f-4502-465c-8c69-1caedc83f698 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8ca2eac0d21457ca347f2a48e5727f8'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:31.395174 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-cdf7ab5f-4502-465c-8c69-1caedc83f698 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8ca2eac0d21457ca347f2a48e5727f8'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:31.442548 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-cdf7ab5f-4502-465c-8c69-1caedc83f698 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8ca2eac0d21457ca347f2a48e5727f8'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:31.465226 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-cdf7ab5f-4502-465c-8c69-1caedc83f698 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8ca2eac0d21457ca347f2a48e5727f8'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:31.484801 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 822/1659] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 11:58:31 2022] DELETE /identity/v3/users/f8ca2eac0d21457ca347f2a48e5727f8 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:31.486799 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48214a31-f38f-4446-a0d8-dcbf2ee4e87b None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:31.487325 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48214a31-f38f-4446-a0d8-dcbf2ee4e87b None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:31.487410 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48214a31-f38f-4446-a0d8-dcbf2ee4e87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:31.502770 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7ab5f-4502-465c-8c69-1caedc83f698 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:31.504323 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-cdf7ab5f-4502-465c-8c69-1caedc83f698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:31.532731 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-48214a31-f38f-4446-a0d8-dcbf2ee4e87b None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:31.534161 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-48214a31-f38f-4446-a0d8-dcbf2ee4e87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:31.700938 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 838/1660] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 11:58:31.773140 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7ab5f-4502-465c-8c69-1caedc83f698 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:31.787378 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e49bc-558f-4a68-bf76-c65beaddcf6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:31.792001 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe56bc-d6c6-47ec-bf97-677b2090856e None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:31.792190 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e49bc-558f-4a68-bf76-c65beaddcf6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:31.792307 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe56bc-d6c6-47ec-bf97-677b2090856e None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:31.792563 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe56bc-d6c6-47ec-bf97-677b2090856e None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:31.792924 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e49bc-558f-4a68-bf76-c65beaddcf6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:31.793353 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e49bc-558f-4a68-bf76-c65beaddcf6c admin admin] PATH_INFO: `/v3/users/19db6485deb347158f0cd7c7bccbd3eb` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:31.793923 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 839/1661] 10.222.0.15 () {54 vars in 960 bytes} [Fri Jun 3 11:58:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 11:58:31.795232 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32e49bc-558f-4a68-bf76-c65beaddcf6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=19db6485deb347158f0cd7c7bccbd3eb)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:31.799648 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32e49bc-558f-4a68-bf76-c65beaddcf6c admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:31.801761 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026b6b7-2eab-4b25-a78a-3f589e47b933 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:31.802048 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026b6b7-2eab-4b25-a78a-3f589e47b933 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:31.802478 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026b6b7-2eab-4b25-a78a-3f589e47b933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:31.828354 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-3026b6b7-2eab-4b25-a78a-3f589e47b933 None None] MFA Rules not processed for user `eb5a91437dd64e2491ce41b4d12d4835`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:31.829598 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-3026b6b7-2eab-4b25-a78a-3f589e47b933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:31.895042 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e32e49bc-558f-4a68-bf76-c65beaddcf6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19db6485deb347158f0cd7c7bccbd3eb'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:31.916964 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e32e49bc-558f-4a68-bf76-c65beaddcf6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19db6485deb347158f0cd7c7bccbd3eb'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:31.918108 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e32e49bc-558f-4a68-bf76-c65beaddcf6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19db6485deb347158f0cd7c7bccbd3eb'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:31.938499 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 840/1662] 10.222.0.15 () {58 vars in 1057 bytes} [Fri Jun 3 11:58:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 11:58:31.940531 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026b6b7-2eab-4b25-a78a-3f589e47b933 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:31.942828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-3026b6b7-2eab-4b25-a78a-3f589e47b933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:32.007122 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e32e49bc-558f-4a68-bf76-c65beaddcf6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19db6485deb347158f0cd7c7bccbd3eb'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:32.027484 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e32e49bc-558f-4a68-bf76-c65beaddcf6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19db6485deb347158f0cd7c7bccbd3eb'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:32.035865 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 823/1663] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 11:58:31 2022] DELETE /identity/v3/users/19db6485deb347158f0cd7c7bccbd3eb => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:32.036674 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:32.038369 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e49bc-558f-4a68-bf76-c65beaddcf6c admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:32.122911 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026b6b7-2eab-4b25-a78a-3f589e47b933 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:32.163862 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:32.215837 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e49bc-558f-4a68-bf76-c65beaddcf6c admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:32.227211 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d32ba-eeec-418f-af7b-959cf3c6c58a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5a91437dd64e2491ce41b4d12d4835', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:32.230002 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d32ba-eeec-418f-af7b-959cf3c6c58a service placement] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:32.230281 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d32ba-eeec-418f-af7b-959cf3c6c58a service placement] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:32.230625 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d32ba-eeec-418f-af7b-959cf3c6c58a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:32.239545 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-817d32ba-eeec-418f-af7b-959cf3c6c58a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:32.271559 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae0d8e-91f6-44d0-933e-da48f2aeab8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:32.272057 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d32ba-eeec-418f-af7b-959cf3c6c58a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:32.273643 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae0d8e-91f6-44d0-933e-da48f2aeab8b service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:32.273643 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae0d8e-91f6-44d0-933e-da48f2aeab8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:32.273937 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d32ba-eeec-418f-af7b-959cf3c6c58a service placement] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:32.274327 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae0d8e-91f6-44d0-933e-da48f2aeab8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:32.280955 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-44ae0d8e-91f6-44d0-933e-da48f2aeab8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:32.312012 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 824/1664] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:58:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:58:32.314715 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86d75c-03e0-400b-b736-bb150dd29110 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:32.315020 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86d75c-03e0-400b-b736-bb150dd29110 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:32.315296 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86d75c-03e0-400b-b736-bb150dd29110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:32.397167 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-bd86d75c-03e0-400b-b736-bb150dd29110 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:32.405829 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-bd86d75c-03e0-400b-b736-bb150dd29110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:32.505276 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae0d8e-91f6-44d0-933e-da48f2aeab8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:32.507116 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae0d8e-91f6-44d0-933e-da48f2aeab8b service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:32.542082 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 841/1665] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:58:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:58:32.674689 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 825/1666] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:32.763567 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae0d8e-91f6-44d0-933e-da48f2aeab8b service neutron] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:32.765693 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-44ae0d8e-91f6-44d0-933e-da48f2aeab8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:32.799645 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae0d8e-91f6-44d0-933e-da48f2aeab8b service neutron] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:32.820875 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c27f7-8b96-47c9-86be-3314fa05cd70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:32.826787 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c27f7-8b96-47c9-86be-3314fa05cd70 service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:32.830472 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c27f7-8b96-47c9-86be-3314fa05cd70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:32.832059 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c27f7-8b96-47c9-86be-3314fa05cd70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:32.879216 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c27f7-8b96-47c9-86be-3314fa05cd70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:32.889147 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c27f7-8b96-47c9-86be-3314fa05cd70 service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:32.970231 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 842/1667] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:58:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 11:58:34.405890 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86d75c-03e0-400b-b736-bb150dd29110 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:34.406683 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-bd86d75c-03e0-400b-b736-bb150dd29110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:34.440360 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86d75c-03e0-400b-b736-bb150dd29110 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:34.456262 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a0adb-81f8-4563-8934-ad40ad52d449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:34.457158 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a0adb-81f8-4563-8934-ad40ad52d449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:34.457440 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a0adb-81f8-4563-8934-ad40ad52d449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:34.457721 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a0adb-81f8-4563-8934-ad40ad52d449 admin admin] PATH_INFO: `/v3/projects/932d50c10e154de1a975be797066af93` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:34.461358 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a0adb-81f8-4563-8934-ad40ad52d449 admin admin] RBAC: Authorizing `identity:delete_project(project_id=932d50c10e154de1a975be797066af93)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:34.462432 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: WARNING py.warnings [None req-740a0adb-81f8-4563-8934-ad40ad52d449 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 11:58:34.462432 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: warnings.warn(msg) Jun 03 11:58:34.462432 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: Jun 03 11:58:34.463678 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a0adb-81f8-4563-8934-ad40ad52d449 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:34.639384 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-740a0adb-81f8-4563-8934-ad40ad52d449 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '932d50c10e154de1a975be797066af93', 'request_id': 'req-740a0adb-81f8-4563-8934-ad40ad52d449'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:34.653481 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-740a0adb-81f8-4563-8934-ad40ad52d449 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '932d50c10e154de1a975be797066af93', 'request_id': 'req-740a0adb-81f8-4563-8934-ad40ad52d449'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:34.666931 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c27f7-8b96-47c9-86be-3314fa05cd70 service neutron] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:34.668670 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-477c27f7-8b96-47c9-86be-3314fa05cd70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:34.670380 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-740a0adb-81f8-4563-8934-ad40ad52d449 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '932d50c10e154de1a975be797066af93', 'request_id': 'req-740a0adb-81f8-4563-8934-ad40ad52d449'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:34.698853 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c27f7-8b96-47c9-86be-3314fa05cd70 service neutron] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:34.726997 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-740a0adb-81f8-4563-8934-ad40ad52d449 admin admin] The token cache is being invalidate because project 932d50c10e154de1a975be797066af93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 11:58:34.728066 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-740a0adb-81f8-4563-8934-ad40ad52d449 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:34.729024 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-740a0adb-81f8-4563-8934-ad40ad52d449 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:34.731268 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 826/1668] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 11:58:34 2022] DELETE /identity/v3/projects/932d50c10e154de1a975be797066af93 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:34.736002 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ffd77-5288-41bf-9154-44f60d2070f1 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:34.736937 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ffd77-5288-41bf-9154-44f60d2070f1 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:34.737399 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ffd77-5288-41bf-9154-44f60d2070f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:34.784713 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-d28ffd77-5288-41bf-9154-44f60d2070f1 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:34.792479 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-d28ffd77-5288-41bf-9154-44f60d2070f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:34.833873 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bfd17b-1226-4983-978a-08c6bc6a1fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:34.834976 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfd17b-1226-4983-978a-08c6bc6a1fab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:34.835563 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfd17b-1226-4983-978a-08c6bc6a1fab admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:34.835914 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfd17b-1226-4983-978a-08c6bc6a1fab admin admin] PATH_INFO: `/v3/projects/177ba26010014be49d0e78d80ce6ede0` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:34.838307 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bfd17b-1226-4983-978a-08c6bc6a1fab admin admin] RBAC: Authorizing `identity:delete_project(project_id=177ba26010014be49d0e78d80ce6ede0)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:34.845514 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bfd17b-1226-4983-978a-08c6bc6a1fab admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:34.907288 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:34.917720 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:34.948342 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 827/1669] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 11:58:34.957460 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c2794-c826-4e65-a0c6-48f42e41b3c0 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:34.957816 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c2794-c826-4e65-a0c6-48f42e41b3c0 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:34.958294 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c2794-c826-4e65-a0c6-48f42e41b3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:34.967734 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-e7bfd17b-1226-4983-978a-08c6bc6a1fab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '177ba26010014be49d0e78d80ce6ede0', 'request_id': 'req-e7bfd17b-1226-4983-978a-08c6bc6a1fab'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:34.975425 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-e7bfd17b-1226-4983-978a-08c6bc6a1fab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '177ba26010014be49d0e78d80ce6ede0', 'request_id': 'req-e7bfd17b-1226-4983-978a-08c6bc6a1fab'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:34.995372 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-e7bfd17b-1226-4983-978a-08c6bc6a1fab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '177ba26010014be49d0e78d80ce6ede0', 'request_id': 'req-e7bfd17b-1226-4983-978a-08c6bc6a1fab'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:34.998833 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-de5c2794-c826-4e65-a0c6-48f42e41b3c0 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:35.000447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-de5c2794-c826-4e65-a0c6-48f42e41b3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:35.024982 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-e7bfd17b-1226-4983-978a-08c6bc6a1fab admin admin] The token cache is being invalidate because project 177ba26010014be49d0e78d80ce6ede0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 11:58:35.025280 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-e7bfd17b-1226-4983-978a-08c6bc6a1fab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:35.028349 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-e7bfd17b-1226-4983-978a-08c6bc6a1fab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:35.030292 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 843/1670] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 11:58:34 2022] DELETE /identity/v3/projects/177ba26010014be49d0e78d80ce6ede0 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:35.034053 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bfd17b-1226-4983-978a-08c6bc6a1fab admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:35.041204 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-e7bfd17b-1226-4983-978a-08c6bc6a1fab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:35.123361 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 828/1671] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:35.132882 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c2794-c826-4e65-a0c6-48f42e41b3c0 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:35.156342 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c2794-c826-4e65-a0c6-48f42e41b3c0 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:35.173422 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b4b17-2494-4358-ab28-1864d05b5739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:35.174105 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b4b17-2494-4358-ab28-1864d05b5739 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:35.174386 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b4b17-2494-4358-ab28-1864d05b5739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:35.174660 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b4b17-2494-4358-ab28-1864d05b5739 admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:35.175392 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b4b17-2494-4358-ab28-1864d05b5739 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:58:35.175756 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b4b17-2494-4358-ab28-1864d05b5739 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:35.177374 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b4b17-2494-4358-ab28-1864d05b5739 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:35.194332 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 829/1672] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 11:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:58:35.199105 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bfd17b-1226-4983-978a-08c6bc6a1fab admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:35.209475 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b4b17-2494-4358-ab28-1864d05b5739 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:35.210616 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c011cd0-2c9f-4ff7-a120-b27277a85115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:35.211336 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c011cd0-2c9f-4ff7-a120-b27277a85115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:35.211720 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c011cd0-2c9f-4ff7-a120-b27277a85115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:35.212626 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c011cd0-2c9f-4ff7-a120-b27277a85115 admin admin] PATH_INFO: `/v3/users/954b3befe91043ae89d71bd4b06cbb6d` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:35.215888 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c011cd0-2c9f-4ff7-a120-b27277a85115 admin admin] RBAC: Authorizing `identity:delete_user(user_id=954b3befe91043ae89d71bd4b06cbb6d)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:35.218742 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: WARNING py.warnings [None req-0c011cd0-2c9f-4ff7-a120-b27277a85115 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 03 11:58:35.218742 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: warnings.warn(msg) Jun 03 11:58:35.218742 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: Jun 03 11:58:35.222048 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c011cd0-2c9f-4ff7-a120-b27277a85115 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:35.230449 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b4b17-2494-4358-ab28-1864d05b5739 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:35.257610 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f73a0-c265-4c15-8300-e9ed0e672637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:35.262088 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f73a0-c265-4c15-8300-e9ed0e672637 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:35.262243 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f73a0-c265-4c15-8300-e9ed0e672637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:35.262509 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f73a0-c265-4c15-8300-e9ed0e672637 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:35.263248 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5f73a0-c265-4c15-8300-e9ed0e672637 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:35.276054 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5f73a0-c265-4c15-8300-e9ed0e672637 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:35.353258 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 830/1673] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:58:35 2022] POST /identity/v3/projects => generated 405 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:58:35.354400 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f73a0-c265-4c15-8300-e9ed0e672637 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:35.371380 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-0c011cd0-2c9f-4ff7-a120-b27277a85115 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '954b3befe91043ae89d71bd4b06cbb6d'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:35.372534 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-0c011cd0-2c9f-4ff7-a120-b27277a85115 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '954b3befe91043ae89d71bd4b06cbb6d'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:35.452303 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-0c011cd0-2c9f-4ff7-a120-b27277a85115 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '954b3befe91043ae89d71bd4b06cbb6d'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:35.485471 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-0c011cd0-2c9f-4ff7-a120-b27277a85115 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '954b3befe91043ae89d71bd4b06cbb6d'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:35.510293 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-0c011cd0-2c9f-4ff7-a120-b27277a85115 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '954b3befe91043ae89d71bd4b06cbb6d'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:35.522397 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 844/1674] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 11:58:35 2022] DELETE /identity/v3/users/954b3befe91043ae89d71bd4b06cbb6d => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:35.544858 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f73a0-c265-4c15-8300-e9ed0e672637 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:35.655817 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4182439-de20-4106-abf6-86ad9156385b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:35.656625 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4182439-de20-4106-abf6-86ad9156385b admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:35.657538 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4182439-de20-4106-abf6-86ad9156385b admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:35.657887 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4182439-de20-4106-abf6-86ad9156385b admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:35.658673 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4182439-de20-4106-abf6-86ad9156385b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:35.661704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4182439-de20-4106-abf6-86ad9156385b admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:35.692042 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:35.718563 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c011cd0-2c9f-4ff7-a120-b27277a85115 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:35.719045 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 831/1675] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:58:35 2022] POST /identity/v3/users => generated 303 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:58:35.720096 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-0c011cd0-2c9f-4ff7-a120-b27277a85115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:35.741666 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c011cd0-2c9f-4ff7-a120-b27277a85115 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:35.756155 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1abd62-efb2-4ed7-836f-f837dc6b336b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:35.759717 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1abd62-efb2-4ed7-836f-f837dc6b336b admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:35.760067 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1abd62-efb2-4ed7-836f-f837dc6b336b admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:35.760411 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1abd62-efb2-4ed7-836f-f837dc6b336b admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:35.761252 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1abd62-efb2-4ed7-836f-f837dc6b336b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:35.762966 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1abd62-efb2-4ed7-836f-f837dc6b336b admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:35.789687 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 845/1676] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:58:35.796176 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4182439-de20-4106-abf6-86ad9156385b admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:35.813973 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4182439-de20-4106-abf6-86ad9156385b admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:35.825638 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9be8d-812b-4a60-af06-cb394e98b0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:35.826903 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9be8d-812b-4a60-af06-cb394e98b0bb admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:35.827334 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9be8d-812b-4a60-af06-cb394e98b0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:35.827785 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9be8d-812b-4a60-af06-cb394e98b0bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:35.828673 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e9be8d-812b-4a60-af06-cb394e98b0bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:35.837880 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e9be8d-812b-4a60-af06-cb394e98b0bb admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:35.872627 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 832/1677] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:58:35.872727 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1abd62-efb2-4ed7-836f-f837dc6b336b admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:35.893873 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1abd62-efb2-4ed7-836f-f837dc6b336b admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:35.914213 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689c08d2-64fd-44fd-9203-4f54144f21c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:35.916284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c08d2-64fd-44fd-9203-4f54144f21c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:35.916908 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c08d2-64fd-44fd-9203-4f54144f21c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:35.917393 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c08d2-64fd-44fd-9203-4f54144f21c7 admin admin] PATH_INFO: `/v3/projects/2e1ce8a0d4fc4154bca8e21fb512810d/users/9c86b8369a8c461499d887ee2d5cb6d5/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:35.965137 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689c08d2-64fd-44fd-9203-4f54144f21c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e1ce8a0d4fc4154bca8e21fb512810d, user_id=9c86b8369a8c461499d887ee2d5cb6d5, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:35.968198 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689c08d2-64fd-44fd-9203-4f54144f21c7 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:35.974362 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:35.996289 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 846/1678] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:58:35 2022] PUT /identity/v3/projects/2e1ce8a0d4fc4154bca8e21fb512810d/users/9c86b8369a8c461499d887ee2d5cb6d5/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:36.006597 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d319f31-f668-4aa4-8e9c-7cceffbd9f69 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:36.006888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d319f31-f668-4aa4-8e9c-7cceffbd9f69 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:36.007169 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d319f31-f668-4aa4-8e9c-7cceffbd9f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:36.088621 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-0d319f31-f668-4aa4-8e9c-7cceffbd9f69 None None] MFA Rules not processed for user `9c86b8369a8c461499d887ee2d5cb6d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:36.089885 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-0d319f31-f668-4aa4-8e9c-7cceffbd9f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:36.187093 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f5121-bbf9-4b76-b644-c4066876b45d None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:36.187398 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f5121-bbf9-4b76-b644-c4066876b45d None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:36.187705 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f5121-bbf9-4b76-b644-c4066876b45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:36.221312 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-962f5121-bbf9-4b76-b644-c4066876b45d None None] MFA Rules not processed for user `b76f9ea7268a4e70a402f3c9ea6220e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:36.222535 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-962f5121-bbf9-4b76-b644-c4066876b45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:36.329813 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 833/1679] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:36 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:36.332655 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d319f31-f668-4aa4-8e9c-7cceffbd9f69 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:36.360451 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 847/1680] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:36.373502 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f5121-bbf9-4b76-b644-c4066876b45d None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:36.375156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-962f5121-bbf9-4b76-b644-c4066876b45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:36.561942 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d319f31-f668-4aa4-8e9c-7cceffbd9f69 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:36.567862 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990182c9-be89-468f-a2df-15ea280801b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:36.569126 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990182c9-be89-468f-a2df-15ea280801b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:36.569786 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990182c9-be89-468f-a2df-15ea280801b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:36.570196 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990182c9-be89-468f-a2df-15ea280801b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:36.571617 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990182c9-be89-468f-a2df-15ea280801b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:36.574939 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990182c9-be89-468f-a2df-15ea280801b7 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:36.600487 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f5121-bbf9-4b76-b644-c4066876b45d None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:36.607995 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54eb9af-438e-470a-9fe1-7b23d4c0039c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:36.608870 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54eb9af-438e-470a-9fe1-7b23d4c0039c service nova] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:36.609572 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54eb9af-438e-470a-9fe1-7b23d4c0039c service nova] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:36.609997 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54eb9af-438e-470a-9fe1-7b23d4c0039c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:36.623223 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54eb9af-438e-470a-9fe1-7b23d4c0039c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:36.626063 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54eb9af-438e-470a-9fe1-7b23d4c0039c service nova] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:36.640900 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 848/1681] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:58:36 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 11:58:36.641919 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54eb9af-438e-470a-9fe1-7b23d4c0039c service nova] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:36.643433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-f54eb9af-438e-470a-9fe1-7b23d4c0039c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:36.664871 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54eb9af-438e-470a-9fe1-7b23d4c0039c service nova] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:36.666443 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 834/1682] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:58:36 2022] POST /identity/v3/projects => generated 405 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:58:36.668518 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990182c9-be89-468f-a2df-15ea280801b7 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:36.771311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990182c9-be89-468f-a2df-15ea280801b7 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:36.778331 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48c27a-74f9-4c32-addf-9f32123ce35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:36.779321 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48c27a-74f9-4c32-addf-9f32123ce35d admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:36.779693 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48c27a-74f9-4c32-addf-9f32123ce35d admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:36.779979 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48c27a-74f9-4c32-addf-9f32123ce35d admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:36.780922 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb48c27a-74f9-4c32-addf-9f32123ce35d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:36.783153 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb48c27a-74f9-4c32-addf-9f32123ce35d admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:36.792386 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:36.822076 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452bc08-5b2c-44ed-b163-1a079cbc8e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:36.824150 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452bc08-5b2c-44ed-b163-1a079cbc8e8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:36.825242 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452bc08-5b2c-44ed-b163-1a079cbc8e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:36.825681 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452bc08-5b2c-44ed-b163-1a079cbc8e8e admin admin] PATH_INFO: `/v3/projects/f90c1356492b4cbcb5c3b29d9453f10e` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:36.827851 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c452bc08-5b2c-44ed-b163-1a079cbc8e8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f90c1356492b4cbcb5c3b29d9453f10e)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:36.829996 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c452bc08-5b2c-44ed-b163-1a079cbc8e8e admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:36.837462 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 835/1683] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:58:36 2022] POST /identity/v3/users => generated 309 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:58:36.838689 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48c27a-74f9-4c32-addf-9f32123ce35d admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:36.844845 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:36.874600 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48c27a-74f9-4c32-addf-9f32123ce35d admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:36.888443 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f3282-7e61-45cb-8f6e-54675d75e806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:36.889022 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f3282-7e61-45cb-8f6e-54675d75e806 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:36.889374 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f3282-7e61-45cb-8f6e-54675d75e806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:36.889747 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f3282-7e61-45cb-8f6e-54675d75e806 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:36.890570 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f3282-7e61-45cb-8f6e-54675d75e806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:36.896419 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f3282-7e61-45cb-8f6e-54675d75e806 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:36.914566 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 836/1684] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 11:58:36.920715 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f3282-7e61-45cb-8f6e-54675d75e806 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:36.938852 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-c452bc08-5b2c-44ed-b163-1a079cbc8e8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f90c1356492b4cbcb5c3b29d9453f10e', 'request_id': 'req-c452bc08-5b2c-44ed-b163-1a079cbc8e8e'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:36.939794 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f3282-7e61-45cb-8f6e-54675d75e806 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:36.947304 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-c452bc08-5b2c-44ed-b163-1a079cbc8e8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f90c1356492b4cbcb5c3b29d9453f10e', 'request_id': 'req-c452bc08-5b2c-44ed-b163-1a079cbc8e8e'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:36.967770 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-c452bc08-5b2c-44ed-b163-1a079cbc8e8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f90c1356492b4cbcb5c3b29d9453f10e', 'request_id': 'req-c452bc08-5b2c-44ed-b163-1a079cbc8e8e'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:36.999032 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-c452bc08-5b2c-44ed-b163-1a079cbc8e8e admin admin] The token cache is being invalidate because project f90c1356492b4cbcb5c3b29d9453f10e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 11:58:36.999357 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-c452bc08-5b2c-44ed-b163-1a079cbc8e8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:37.001852 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-c452bc08-5b2c-44ed-b163-1a079cbc8e8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:37.006122 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 849/1685] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 11:58:36 2022] DELETE /identity/v3/projects/f90c1356492b4cbcb5c3b29d9453f10e => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:37.012135 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d528e-471f-4533-b514-4926e7d690c9 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:37.012415 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d528e-471f-4533-b514-4926e7d690c9 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:37.012718 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d528e-471f-4533-b514-4926e7d690c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:37.055106 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-5e3d528e-471f-4533-b514-4926e7d690c9 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:37.057206 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-5e3d528e-471f-4533-b514-4926e7d690c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:37.099825 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c582184-7d96-44ad-8502-b8f9182375fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:37.101672 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c582184-7d96-44ad-8502-b8f9182375fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:37.101962 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c582184-7d96-44ad-8502-b8f9182375fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:37.102481 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c582184-7d96-44ad-8502-b8f9182375fa admin admin] PATH_INFO: `/v3/projects/07723184e8584c47b993ec713096f107/users/220880f1a5184424a3f712b9cbfa77c9/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:37.146759 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c582184-7d96-44ad-8502-b8f9182375fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=07723184e8584c47b993ec713096f107, user_id=220880f1a5184424a3f712b9cbfa77c9, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:37.152365 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c582184-7d96-44ad-8502-b8f9182375fa admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:37.186695 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 837/1686] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:58:36 2022] PUT /identity/v3/projects/07723184e8584c47b993ec713096f107/users/220880f1a5184424a3f712b9cbfa77c9/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:37.188091 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c582184-7d96-44ad-8502-b8f9182375fa admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:37.191084 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-7c582184-7d96-44ad-8502-b8f9182375fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:37.221594 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 850/1687] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 11:58:37.229330 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341e70c-3477-4e09-aecd-bcd0f7691bf7 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:37.229649 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341e70c-3477-4e09-aecd-bcd0f7691bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:37.229919 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341e70c-3477-4e09-aecd-bcd0f7691bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:37.259544 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-0341e70c-3477-4e09-aecd-bcd0f7691bf7 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:37.260767 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-0341e70c-3477-4e09-aecd-bcd0f7691bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:37.346984 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c582184-7d96-44ad-8502-b8f9182375fa admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:37.357962 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5048e70-68bb-45c4-a1c0-cf1c378b1f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:37.358773 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5048e70-68bb-45c4-a1c0-cf1c378b1f4b admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:37.361107 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5048e70-68bb-45c4-a1c0-cf1c378b1f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:37.361605 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5048e70-68bb-45c4-a1c0-cf1c378b1f4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:37.362505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5048e70-68bb-45c4-a1c0-cf1c378b1f4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:37.366420 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5048e70-68bb-45c4-a1c0-cf1c378b1f4b admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:37.391861 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 851/1688] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 11:58:37.392066 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 838/1689] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:58:37 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:58:37.393032 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341e70c-3477-4e09-aecd-bcd0f7691bf7 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:37.394354 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5048e70-68bb-45c4-a1c0-cf1c378b1f4b admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:37.406444 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341e70c-3477-4e09-aecd-bcd0f7691bf7 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:37.414309 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfafda2-cc49-4482-9424-577102a1f146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:37.418482 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfafda2-cc49-4482-9424-577102a1f146 admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:37.418776 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfafda2-cc49-4482-9424-577102a1f146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:37.419058 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfafda2-cc49-4482-9424-577102a1f146 admin admin] PATH_INFO: `/v3/projects/07723184e8584c47b993ec713096f107/users/220880f1a5184424a3f712b9cbfa77c9/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:37.422269 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5048e70-68bb-45c4-a1c0-cf1c378b1f4b admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:37.425220 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfafda2-cc49-4482-9424-577102a1f146 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07723184e8584c47b993ec713096f107, user_id=220880f1a5184424a3f712b9cbfa77c9, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:37.428393 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfafda2-cc49-4482-9424-577102a1f146 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:37.436043 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db11076-5b2b-42f3-9770-e3b3fbbc03ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:37.436715 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db11076-5b2b-42f3-9770-e3b3fbbc03ea admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:37.436998 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db11076-5b2b-42f3-9770-e3b3fbbc03ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:37.437277 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db11076-5b2b-42f3-9770-e3b3fbbc03ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:37.438008 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db11076-5b2b-42f3-9770-e3b3fbbc03ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:58:37.438315 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db11076-5b2b-42f3-9770-e3b3fbbc03ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:37.439954 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db11076-5b2b-42f3-9770-e3b3fbbc03ea admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:37.452177 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 852/1690] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:58:37 2022] PUT /identity/v3/projects/07723184e8584c47b993ec713096f107/users/220880f1a5184424a3f712b9cbfa77c9/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:37.456043 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79613c-e92c-464c-b6dd-8a98d1792fc5 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:37.456316 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79613c-e92c-464c-b6dd-8a98d1792fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:37.456672 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79613c-e92c-464c-b6dd-8a98d1792fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:37.469998 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 839/1691] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 11:58:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:58:37.471021 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db11076-5b2b-42f3-9770-e3b3fbbc03ea admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:37.495165 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db11076-5b2b-42f3-9770-e3b3fbbc03ea admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:37.503214 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-ba79613c-e92c-464c-b6dd-8a98d1792fc5 None None] MFA Rules not processed for user `220880f1a5184424a3f712b9cbfa77c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:37.506162 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-ba79613c-e92c-464c-b6dd-8a98d1792fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:37.533203 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:37.609411 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:37.638597 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df85cf-753e-4f93-9128-d6fc2533bff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:37.639601 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df85cf-753e-4f93-9128-d6fc2533bff3 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:37.640014 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df85cf-753e-4f93-9128-d6fc2533bff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:37.640399 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df85cf-753e-4f93-9128-d6fc2533bff3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:37.641572 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1df85cf-753e-4f93-9128-d6fc2533bff3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:37.645155 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1df85cf-753e-4f93-9128-d6fc2533bff3 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:37.653690 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 853/1692] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:37 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:37.662227 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79613c-e92c-464c-b6dd-8a98d1792fc5 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:37.667107 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-ba79613c-e92c-464c-b6dd-8a98d1792fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:37.766041 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 840/1693] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:58:37 2022] POST /identity/v3/projects => generated 387 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:58:37.766943 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df85cf-753e-4f93-9128-d6fc2533bff3 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:37.802240 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79613c-e92c-464c-b6dd-8a98d1792fc5 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:37.912350 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e747ad-5416-4c8c-a902-797cad21017d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:37.912951 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e747ad-5416-4c8c-a902-797cad21017d service cinder] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:37.913218 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e747ad-5416-4c8c-a902-797cad21017d service cinder] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:37.913528 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e747ad-5416-4c8c-a902-797cad21017d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:37.916354 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df85cf-753e-4f93-9128-d6fc2533bff3 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:37.931641 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae0ed6-a87f-4735-9286-7b784600c47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:37.932675 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae0ed6-a87f-4735-9286-7b784600c47e admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:37.933036 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae0ed6-a87f-4735-9286-7b784600c47e admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:37.934893 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae0ed6-a87f-4735-9286-7b784600c47e admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:37.935803 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcae0ed6-a87f-4735-9286-7b784600c47e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:37.938060 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcae0ed6-a87f-4735-9286-7b784600c47e admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:37.996252 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 841/1694] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:58:37 2022] POST /identity/v3/users => generated 294 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:58:38.002506 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae0ed6-a87f-4735-9286-7b784600c47e admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:38.021809 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae0ed6-a87f-4735-9286-7b784600c47e admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:38.035929 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b15e9-de66-45ab-80de-425f43fe2a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:38.036893 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b15e9-de66-45ab-80de-425f43fe2a3c admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:38.037369 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b15e9-de66-45ab-80de-425f43fe2a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:38.037824 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b15e9-de66-45ab-80de-425f43fe2a3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:38.038734 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b15e9-de66-45ab-80de-425f43fe2a3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:38.041249 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b15e9-de66-45ab-80de-425f43fe2a3c admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:38.052551 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e747ad-5416-4c8c-a902-797cad21017d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:38.057025 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e747ad-5416-4c8c-a902-797cad21017d service cinder] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:38.071183 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 842/1695] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:58:38.072390 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b15e9-de66-45ab-80de-425f43fe2a3c admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:38.099710 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b15e9-de66-45ab-80de-425f43fe2a3c admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:38.104654 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 854/1696] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:58:37 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:58:38.117478 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7242024-0fd0-4a2f-bd26-47c5a5f2630b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:38.118977 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7242024-0fd0-4a2f-bd26-47c5a5f2630b admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:38.119585 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7242024-0fd0-4a2f-bd26-47c5a5f2630b admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:38.120568 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7242024-0fd0-4a2f-bd26-47c5a5f2630b admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:38.121632 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7242024-0fd0-4a2f-bd26-47c5a5f2630b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:38.123779 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7242024-0fd0-4a2f-bd26-47c5a5f2630b admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:38.170631 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 843/1697] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:58:38.175098 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e747ad-5416-4c8c-a902-797cad21017d service cinder] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:38.229579 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e747ad-5416-4c8c-a902-797cad21017d service cinder] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:38.244209 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6dc6dd-f39e-41b7-b570-167ab6f9ef65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:38.244209 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6dc6dd-f39e-41b7-b570-167ab6f9ef65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:38.244209 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6dc6dd-f39e-41b7-b570-167ab6f9ef65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:38.244209 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6dc6dd-f39e-41b7-b570-167ab6f9ef65 admin admin] PATH_INFO: `/v3/projects/3232b9c258d544c895c3080ba7a061bf/users/a99dc22459e04df1a6a58ff0acf8ec8b/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:38.282466 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6dc6dd-f39e-41b7-b570-167ab6f9ef65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3232b9c258d544c895c3080ba7a061bf, user_id=a99dc22459e04df1a6a58ff0acf8ec8b, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:38.288008 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6dc6dd-f39e-41b7-b570-167ab6f9ef65 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:38.292393 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:38.322467 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 855/1698] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:58:38 2022] PUT /identity/v3/projects/3232b9c258d544c895c3080ba7a061bf/users/a99dc22459e04df1a6a58ff0acf8ec8b/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:38.333646 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b23fc-27b6-4b33-a43a-c35b4e62b1ce None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:38.333966 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b23fc-27b6-4b33-a43a-c35b4e62b1ce None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:38.334212 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b23fc-27b6-4b33-a43a-c35b4e62b1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:38.408402 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-875b23fc-27b6-4b33-a43a-c35b4e62b1ce None None] MFA Rules not processed for user `a99dc22459e04df1a6a58ff0acf8ec8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:38.409787 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-875b23fc-27b6-4b33-a43a-c35b4e62b1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:38.554183 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 844/1699] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:38.556055 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6dc6dd-f39e-41b7-b570-167ab6f9ef65 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:38.565797 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe2e6c-fb8b-4701-95ce-648b74325b66 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:38.566086 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe2e6c-fb8b-4701-95ce-648b74325b66 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:38.568630 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe2e6c-fb8b-4701-95ce-648b74325b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:38.637409 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-0dfe2e6c-fb8b-4701-95ce-648b74325b66 None None] MFA Rules not processed for user `abcc58cb66804297b184e41726c281bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:38.639102 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-0dfe2e6c-fb8b-4701-95ce-648b74325b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:38.702761 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:38.730541 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6dc6dd-f39e-41b7-b570-167ab6f9ef65 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:38.748098 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe9e8f-40fc-4f26-affb-508c0b7fcb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:38.750400 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe9e8f-40fc-4f26-affb-508c0b7fcb25 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:38.750400 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe9e8f-40fc-4f26-affb-508c0b7fcb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:38.750585 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe9e8f-40fc-4f26-affb-508c0b7fcb25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:38.751262 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe9e8f-40fc-4f26-affb-508c0b7fcb25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:38.753225 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe9e8f-40fc-4f26-affb-508c0b7fcb25 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:38.828541 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 856/1700] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:58:38 2022] POST /identity/v3/projects => generated 387 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:58:38.830519 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe9e8f-40fc-4f26-affb-508c0b7fcb25 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:38.858253 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 845/1701] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:38.859378 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe2e6c-fb8b-4701-95ce-648b74325b66 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:38.879137 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe2e6c-fb8b-4701-95ce-648b74325b66 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:38.996402 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9369499-17c9-4179-9ae7-c84a75031891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:38.997142 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9369499-17c9-4179-9ae7-c84a75031891 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:38.997427 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9369499-17c9-4179-9ae7-c84a75031891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:38.997705 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9369499-17c9-4179-9ae7-c84a75031891 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:38.998717 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9369499-17c9-4179-9ae7-c84a75031891 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:39.003205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9369499-17c9-4179-9ae7-c84a75031891 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:39.019749 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe9e8f-40fc-4f26-affb-508c0b7fcb25 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:39.037211 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 846/1702] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:58:38 2022] POST /identity/v3/users => generated 300 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:58:39.039024 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafe4ee-5bad-41ca-beb5-fa3ac74e6475 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:39.039385 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafe4ee-5bad-41ca-beb5-fa3ac74e6475 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:39.039777 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafe4ee-5bad-41ca-beb5-fa3ac74e6475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:39.041528 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991792a4-6238-46c3-97d8-060220a074df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:39.042237 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991792a4-6238-46c3-97d8-060220a074df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:39.042591 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991792a4-6238-46c3-97d8-060220a074df admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:39.043173 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991792a4-6238-46c3-97d8-060220a074df admin admin] PATH_INFO: `/v3/users/9c86b8369a8c461499d887ee2d5cb6d5` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:39.044307 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991792a4-6238-46c3-97d8-060220a074df admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c86b8369a8c461499d887ee2d5cb6d5)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:39.046433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991792a4-6238-46c3-97d8-060220a074df admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:39.072005 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-1fafe4ee-5bad-41ca-beb5-fa3ac74e6475 None None] MFA Rules not processed for user `abcc58cb66804297b184e41726c281bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:39.075284 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-1fafe4ee-5bad-41ca-beb5-fa3ac74e6475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:39.186621 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-991792a4-6238-46c3-97d8-060220a074df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c86b8369a8c461499d887ee2d5cb6d5'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:39.187688 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-991792a4-6238-46c3-97d8-060220a074df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c86b8369a8c461499d887ee2d5cb6d5'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:39.200118 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 847/1703] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:39.204097 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fafe4ee-5bad-41ca-beb5-fa3ac74e6475 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:39.207901 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-1fafe4ee-5bad-41ca-beb5-fa3ac74e6475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:39.213342 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-991792a4-6238-46c3-97d8-060220a074df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c86b8369a8c461499d887ee2d5cb6d5'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:39.252159 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fafe4ee-5bad-41ca-beb5-fa3ac74e6475 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:39.255847 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-991792a4-6238-46c3-97d8-060220a074df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c86b8369a8c461499d887ee2d5cb6d5'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:39.262155 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991c55f-4918-483d-9149-6b6bdc5c359d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:39.265094 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991c55f-4918-483d-9149-6b6bdc5c359d admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:39.266183 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991c55f-4918-483d-9149-6b6bdc5c359d admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:39.266687 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991c55f-4918-483d-9149-6b6bdc5c359d admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:39.267694 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f991c55f-4918-483d-9149-6b6bdc5c359d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:39.269563 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f991c55f-4918-483d-9149-6b6bdc5c359d admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:39.285010 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-991792a4-6238-46c3-97d8-060220a074df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c86b8369a8c461499d887ee2d5cb6d5'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:39.287127 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:39.298570 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 857/1704] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 11:58:38 2022] DELETE /identity/v3/users/9c86b8369a8c461499d887ee2d5cb6d5 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:39.299859 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991792a4-6238-46c3-97d8-060220a074df admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:39.302643 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-991792a4-6238-46c3-97d8-060220a074df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:39.309791 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 848/1705] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:58:39.312580 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954902c-4bfe-42cb-bf5c-80d63f2d4ff4 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:39.316001 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954902c-4bfe-42cb-bf5c-80d63f2d4ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:39.316708 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954902c-4bfe-42cb-bf5c-80d63f2d4ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:39.352176 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-1954902c-4bfe-42cb-bf5c-80d63f2d4ff4 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:39.356990 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-1954902c-4bfe-42cb-bf5c-80d63f2d4ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:39.425459 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:39.467750 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991792a4-6238-46c3-97d8-060220a074df admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:39.482631 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444b09b-1c19-497d-94b2-4b7dd6fca74b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:39.483384 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444b09b-1c19-497d-94b2-4b7dd6fca74b service nova] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:39.483705 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444b09b-1c19-497d-94b2-4b7dd6fca74b service nova] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:39.483989 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444b09b-1c19-497d-94b2-4b7dd6fca74b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:39.488978 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-7444b09b-1c19-497d-94b2-4b7dd6fca74b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:39.490905 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 849/1706] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:39.491990 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954902c-4bfe-42cb-bf5c-80d63f2d4ff4 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:39.511943 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954902c-4bfe-42cb-bf5c-80d63f2d4ff4 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:39.523649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6667c9-78c6-4b1b-bc0c-5e67c9c5a961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:39.524971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6667c9-78c6-4b1b-bc0c-5e67c9c5a961 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:39.525459 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6667c9-78c6-4b1b-bc0c-5e67c9c5a961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:39.525939 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6667c9-78c6-4b1b-bc0c-5e67c9c5a961 admin admin] PATH_INFO: `/v3/projects/d357a3587492423190588cdbe6350346/users/62b6f4b1658b4373870e810bd03672d8/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:39.559287 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6667c9-78c6-4b1b-bc0c-5e67c9c5a961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d357a3587492423190588cdbe6350346, user_id=62b6f4b1658b4373870e810bd03672d8, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:39.562795 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6667c9-78c6-4b1b-bc0c-5e67c9c5a961 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:39.583740 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 850/1707] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:58:39 2022] PUT /identity/v3/projects/d357a3587492423190588cdbe6350346/users/62b6f4b1658b4373870e810bd03672d8/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:39.584786 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6667c9-78c6-4b1b-bc0c-5e67c9c5a961 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:39.593091 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-1d6667c9-78c6-4b1b-bc0c-5e67c9c5a961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:39.618651 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7444b09b-1c19-497d-94b2-4b7dd6fca74b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:39.621513 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7444b09b-1c19-497d-94b2-4b7dd6fca74b service nova] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:39.645707 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 858/1708] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:58:39 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:58:39.648465 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444b09b-1c19-497d-94b2-4b7dd6fca74b service nova] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:39.669773 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444b09b-1c19-497d-94b2-4b7dd6fca74b service nova] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:39.815459 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6667c9-78c6-4b1b-bc0c-5e67c9c5a961 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:39.839934 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057435d-3f1c-4d73-b034-ef787c40cbbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:39.840887 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057435d-3f1c-4d73-b034-ef787c40cbbe service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:39.841239 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057435d-3f1c-4d73-b034-ef787c40cbbe service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:39.843848 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057435d-3f1c-4d73-b034-ef787c40cbbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:39.884324 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db6700-4822-436d-8681-d92559ea3e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:39.886780 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db6700-4822-436d-8681-d92559ea3e12 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:39.887185 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db6700-4822-436d-8681-d92559ea3e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:39.887938 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db6700-4822-436d-8681-d92559ea3e12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:39.905781 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6db6700-4822-436d-8681-d92559ea3e12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:39.908637 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6db6700-4822-436d-8681-d92559ea3e12 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:39.950722 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 859/1709] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:58:39.952055 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba197a-19a1-46c6-b394-ee9a24d6d5b9 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:39.952412 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba197a-19a1-46c6-b394-ee9a24d6d5b9 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:39.953516 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba197a-19a1-46c6-b394-ee9a24d6d5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:40.036815 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-34ba197a-19a1-46c6-b394-ee9a24d6d5b9 None None] MFA Rules not processed for user `b76f9ea7268a4e70a402f3c9ea6220e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:40.039390 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-34ba197a-19a1-46c6-b394-ee9a24d6d5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:40.138235 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f057435d-3f1c-4d73-b034-ef787c40cbbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:40.139818 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f057435d-3f1c-4d73-b034-ef787c40cbbe service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:40.148857 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:40.174632 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 851/1710] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:58:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:58:40.175825 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057435d-3f1c-4d73-b034-ef787c40cbbe service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:40.210928 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057435d-3f1c-4d73-b034-ef787c40cbbe service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:40.239272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011d93d-0779-41d7-9f57-21891a35f8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:40.240224 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011d93d-0779-41d7-9f57-21891a35f8be admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:40.240504 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011d93d-0779-41d7-9f57-21891a35f8be admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:40.241456 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011d93d-0779-41d7-9f57-21891a35f8be admin admin] PATH_INFO: `/v3/projects/d357a3587492423190588cdbe6350346/users/62b6f4b1658b4373870e810bd03672d8/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:40.248837 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011d93d-0779-41d7-9f57-21891a35f8be admin admin] RBAC: Authorizing `identity:create_grant(project_id=d357a3587492423190588cdbe6350346, user_id=62b6f4b1658b4373870e810bd03672d8, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:40.253997 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011d93d-0779-41d7-9f57-21891a35f8be admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:40.296826 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 860/1711] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:40.298944 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 852/1712] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:58:40 2022] PUT /identity/v3/projects/d357a3587492423190588cdbe6350346/users/62b6f4b1658b4373870e810bd03672d8/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:40.320054 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fae0c-12c5-4595-a9b6-6943c73e254f None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:40.320870 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fae0c-12c5-4595-a9b6-6943c73e254f None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:40.322103 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fae0c-12c5-4595-a9b6-6943c73e254f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:40.404269 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-1b9fae0c-12c5-4595-a9b6-6943c73e254f None None] MFA Rules not processed for user `62b6f4b1658b4373870e810bd03672d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:40.407017 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-1b9fae0c-12c5-4595-a9b6-6943c73e254f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:40.447743 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4396194-965d-4a82-9521-45fc6ec037d1 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:40.448035 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4396194-965d-4a82-9521-45fc6ec037d1 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:40.448313 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4396194-965d-4a82-9521-45fc6ec037d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:40.494346 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-a4396194-965d-4a82-9521-45fc6ec037d1 None None] MFA Rules not processed for user `a55cbe88e78e4f3a82b8703a3b1804e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:40.503585 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-a4396194-965d-4a82-9521-45fc6ec037d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:40.648001 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:40.674992 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 861/1713] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:40 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:40.677094 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 853/1714] 10.222.0.15 () {58 vars in 1009 bytes} [Fri Jun 3 11:58:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 11:58:40.719103 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fae0c-12c5-4595-a9b6-6943c73e254f None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:40.720596 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-1b9fae0c-12c5-4595-a9b6-6943c73e254f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:40.758963 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1f133-b222-4f11-a34e-aac6232cfb39 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:40.760024 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1f133-b222-4f11-a34e-aac6232cfb39 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:40.760328 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1f133-b222-4f11-a34e-aac6232cfb39 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:40.761869 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 854/1715] 10.222.0.15 () {54 vars in 912 bytes} [Fri Jun 3 11:58:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:58:40.768367 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cec99d-1cdd-4475-8207-ab8c66087c3e None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:40.768656 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cec99d-1cdd-4475-8207-ab8c66087c3e None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:40.768945 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cec99d-1cdd-4475-8207-ab8c66087c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:40.806999 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-90cec99d-1cdd-4475-8207-ab8c66087c3e None None] MFA Rules not processed for user `a78b4284099546cd9c126a5739380b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:40.813459 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-90cec99d-1cdd-4475-8207-ab8c66087c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:40.908489 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fae0c-12c5-4595-a9b6-6943c73e254f None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:40.923825 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7e045-f84d-47f7-b607-083d13a6fea8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:40.925599 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7e045-f84d-47f7-b607-083d13a6fea8 service cinder] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:40.926501 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7e045-f84d-47f7-b607-083d13a6fea8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:40.927263 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7e045-f84d-47f7-b607-083d13a6fea8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:40.958057 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee7e045-f84d-47f7-b607-083d13a6fea8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:40.963111 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee7e045-f84d-47f7-b607-083d13a6fea8 service cinder] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:40.984098 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 855/1716] 10.222.0.15 () {58 vars in 1009 bytes} [Fri Jun 3 11:58:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 11:58:40.993114 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 862/1717] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:58:40 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:58:41.002187 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cec99d-1cdd-4475-8207-ab8c66087c3e None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:41.008951 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-90cec99d-1cdd-4475-8207-ab8c66087c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:41.010200 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7e045-f84d-47f7-b607-083d13a6fea8 service cinder] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:41.012840 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-cee7e045-f84d-47f7-b607-083d13a6fea8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:41.035399 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7e045-f84d-47f7-b607-083d13a6fea8 service cinder] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:41.051734 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbcd694-6e97-4dc0-940f-547ea19eef8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:41.053653 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbcd694-6e97-4dc0-940f-547ea19eef8c service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:41.054192 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbcd694-6e97-4dc0-940f-547ea19eef8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:41.054775 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbcd694-6e97-4dc0-940f-547ea19eef8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:41.073208 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbcd694-6e97-4dc0-940f-547ea19eef8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:41.076789 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbcd694-6e97-4dc0-940f-547ea19eef8c service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:41.099697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 863/1718] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:58:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:58:41.105134 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbcd694-6e97-4dc0-940f-547ea19eef8c service neutron] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:41.108284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-2bbcd694-6e97-4dc0-940f-547ea19eef8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:41.172695 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cec99d-1cdd-4475-8207-ab8c66087c3e None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:41.190144 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edbecbb-9290-44cf-a205-87583be371e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:41.191020 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbecbb-9290-44cf-a205-87583be371e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:41.191345 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbecbb-9290-44cf-a205-87583be371e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:41.191661 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbecbb-9290-44cf-a205-87583be371e8 admin admin] PATH_INFO: `/v3/users/a3f1e1d5983645ae9e4f5c8248a677af` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:41.192947 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edbecbb-9290-44cf-a205-87583be371e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3f1e1d5983645ae9e4f5c8248a677af)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:41.194890 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edbecbb-9290-44cf-a205-87583be371e8 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:41.298789 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-6edbecbb-9290-44cf-a205-87583be371e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3f1e1d5983645ae9e4f5c8248a677af'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:41.303462 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:41.325077 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-6edbecbb-9290-44cf-a205-87583be371e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3f1e1d5983645ae9e4f5c8248a677af'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:41.325887 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-6edbecbb-9290-44cf-a205-87583be371e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3f1e1d5983645ae9e4f5c8248a677af'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:41.356172 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-6edbecbb-9290-44cf-a205-87583be371e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3f1e1d5983645ae9e4f5c8248a677af'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:41.376062 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-6edbecbb-9290-44cf-a205-87583be371e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3f1e1d5983645ae9e4f5c8248a677af'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:41.379181 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbcd694-6e97-4dc0-940f-547ea19eef8c service neutron] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:41.407812 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 856/1719] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 11:58:41 2022] DELETE /identity/v3/users/a3f1e1d5983645ae9e4f5c8248a677af => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:41.410758 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edbecbb-9290-44cf-a205-87583be371e8 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:41.412164 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dfd27e-49ca-4540-90dc-490a69ac5ef9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f52901fe535420bb0019272d4eafe72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:41.413056 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dfd27e-49ca-4540-90dc-490a69ac5ef9 service swift] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:41.413270 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dfd27e-49ca-4540-90dc-490a69ac5ef9 service swift] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:41.413522 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dfd27e-49ca-4540-90dc-490a69ac5ef9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:41.414048 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-6edbecbb-9290-44cf-a205-87583be371e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:41.421625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-62dfd27e-49ca-4540-90dc-490a69ac5ef9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:41.452682 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dfd27e-49ca-4540-90dc-490a69ac5ef9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:41.454274 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dfd27e-49ca-4540-90dc-490a69ac5ef9 service swift] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:41.476833 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 864/1720] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Jun 3 11:58:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 11:58:41.477579 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335473c6-2ba8-49c4-bf7d-68df70c2ecf3 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:41.481121 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335473c6-2ba8-49c4-bf7d-68df70c2ecf3 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:41.481471 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335473c6-2ba8-49c4-bf7d-68df70c2ecf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:41.536513 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-335473c6-2ba8-49c4-bf7d-68df70c2ecf3 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:41.545309 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-335473c6-2ba8-49c4-bf7d-68df70c2ecf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:41.547717 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:41.697393 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edbecbb-9290-44cf-a205-87583be371e8 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:41.726415 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35acc7d3-6a40-40cd-8b2d-2e823536dbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:41.727393 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35acc7d3-6a40-40cd-8b2d-2e823536dbb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:41.727721 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35acc7d3-6a40-40cd-8b2d-2e823536dbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:41.728003 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35acc7d3-6a40-40cd-8b2d-2e823536dbb7 admin admin] PATH_INFO: `/v3/users/a99dc22459e04df1a6a58ff0acf8ec8b` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:41.736657 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35acc7d3-6a40-40cd-8b2d-2e823536dbb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a99dc22459e04df1a6a58ff0acf8ec8b)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:41.749193 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35acc7d3-6a40-40cd-8b2d-2e823536dbb7 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:41.795674 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 865/1721] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:41.800858 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335473c6-2ba8-49c4-bf7d-68df70c2ecf3 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:41.806438 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-335473c6-2ba8-49c4-bf7d-68df70c2ecf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:41.879297 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-35acc7d3-6a40-40cd-8b2d-2e823536dbb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a99dc22459e04df1a6a58ff0acf8ec8b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:41.897973 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-35acc7d3-6a40-40cd-8b2d-2e823536dbb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a99dc22459e04df1a6a58ff0acf8ec8b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:41.899475 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-35acc7d3-6a40-40cd-8b2d-2e823536dbb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a99dc22459e04df1a6a58ff0acf8ec8b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:41.925613 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-35acc7d3-6a40-40cd-8b2d-2e823536dbb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a99dc22459e04df1a6a58ff0acf8ec8b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:41.944912 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-35acc7d3-6a40-40cd-8b2d-2e823536dbb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a99dc22459e04df1a6a58ff0acf8ec8b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:41.961480 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335473c6-2ba8-49c4-bf7d-68df70c2ecf3 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:41.966897 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 857/1722] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 11:58:41 2022] DELETE /identity/v3/users/a99dc22459e04df1a6a58ff0acf8ec8b => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:41.979266 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf67518-0352-4f70-98fb-eedf037a7c96 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:41.979843 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf67518-0352-4f70-98fb-eedf037a7c96 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:41.981069 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf67518-0352-4f70-98fb-eedf037a7c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:42.023121 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-0bf67518-0352-4f70-98fb-eedf037a7c96 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:42.026468 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-0bf67518-0352-4f70-98fb-eedf037a7c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:42.091145 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd8076-cf1b-4ccc-abab-ddcf0b5f12f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:42.091949 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd8076-cf1b-4ccc-abab-ddcf0b5f12f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:42.092350 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd8076-cf1b-4ccc-abab-ddcf0b5f12f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:42.092733 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd8076-cf1b-4ccc-abab-ddcf0b5f12f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:42.095807 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-fadd8076-cf1b-4ccc-abab-ddcf0b5f12f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:42.203064 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 858/1723] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:42.216680 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf67518-0352-4f70-98fb-eedf037a7c96 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:42.218405 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-0bf67518-0352-4f70-98fb-eedf037a7c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:42.258496 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf67518-0352-4f70-98fb-eedf037a7c96 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:42.275298 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664582d-6179-466a-9a59-a50645cb7375 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:42.275298 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664582d-6179-466a-9a59-a50645cb7375 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:42.275298 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664582d-6179-466a-9a59-a50645cb7375 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:42.275298 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664582d-6179-466a-9a59-a50645cb7375 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:42.311361 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:42.324165 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e664582d-6179-466a-9a59-a50645cb7375 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:42.333876 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e664582d-6179-466a-9a59-a50645cb7375 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:42.388152 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd8076-cf1b-4ccc-abab-ddcf0b5f12f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:42.389665 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd8076-cf1b-4ccc-abab-ddcf0b5f12f6 service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:42.393232 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 859/1724] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:58:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:58:42.431983 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 866/1725] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:58:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 11:58:43.122408 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed362228-562b-4583-bea6-5129fb43a81d None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:43.122923 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed362228-562b-4583-bea6-5129fb43a81d None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:43.122923 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed362228-562b-4583-bea6-5129fb43a81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:43.204609 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-ed362228-562b-4583-bea6-5129fb43a81d None None] MFA Rules not processed for user `abcc58cb66804297b184e41726c281bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:43.205890 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-ed362228-562b-4583-bea6-5129fb43a81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:43.309433 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:43.431910 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 860/1726] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:44.519039 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd8076-cf1b-4ccc-abab-ddcf0b5f12f6 service neutron] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:44.521092 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-fadd8076-cf1b-4ccc-abab-ddcf0b5f12f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:44.557906 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd8076-cf1b-4ccc-abab-ddcf0b5f12f6 service neutron] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:44.569112 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed362228-562b-4583-bea6-5129fb43a81d None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:44.570739 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-ed362228-562b-4583-bea6-5129fb43a81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:44.583799 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c63333-27d3-47a4-bf6b-6b85bb312a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:44.584788 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c63333-27d3-47a4-bf6b-6b85bb312a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:44.588458 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c63333-27d3-47a4-bf6b-6b85bb312a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:44.588836 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c63333-27d3-47a4-bf6b-6b85bb312a13 admin admin] PATH_INFO: `/v3/projects/8af67916348c49ec9bb1b61a26e07849` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:44.593709 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c63333-27d3-47a4-bf6b-6b85bb312a13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8af67916348c49ec9bb1b61a26e07849)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:44.599287 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c63333-27d3-47a4-bf6b-6b85bb312a13 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:44.603791 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed362228-562b-4583-bea6-5129fb43a81d None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:44.639348 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607eaa98-d4bf-4692-b943-9b2ad7a9face admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:44.640424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607eaa98-d4bf-4692-b943-9b2ad7a9face admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:44.640823 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607eaa98-d4bf-4692-b943-9b2ad7a9face admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:44.641213 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607eaa98-d4bf-4692-b943-9b2ad7a9face admin admin] PATH_INFO: `/v3/projects/2e1ce8a0d4fc4154bca8e21fb512810d` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:44.642971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607eaa98-d4bf-4692-b943-9b2ad7a9face admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e1ce8a0d4fc4154bca8e21fb512810d)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:44.652483 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607eaa98-d4bf-4692-b943-9b2ad7a9face admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:44.834479 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-f7c63333-27d3-47a4-bf6b-6b85bb312a13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8af67916348c49ec9bb1b61a26e07849', 'request_id': 'req-f7c63333-27d3-47a4-bf6b-6b85bb312a13'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:44.854240 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-f7c63333-27d3-47a4-bf6b-6b85bb312a13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8af67916348c49ec9bb1b61a26e07849', 'request_id': 'req-f7c63333-27d3-47a4-bf6b-6b85bb312a13'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:44.864988 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-607eaa98-d4bf-4692-b943-9b2ad7a9face admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e1ce8a0d4fc4154bca8e21fb512810d', 'request_id': 'req-607eaa98-d4bf-4692-b943-9b2ad7a9face'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:44.886876 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-607eaa98-d4bf-4692-b943-9b2ad7a9face admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e1ce8a0d4fc4154bca8e21fb512810d', 'request_id': 'req-607eaa98-d4bf-4692-b943-9b2ad7a9face'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:44.889025 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-f7c63333-27d3-47a4-bf6b-6b85bb312a13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8af67916348c49ec9bb1b61a26e07849', 'request_id': 'req-f7c63333-27d3-47a4-bf6b-6b85bb312a13'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:44.919123 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-607eaa98-d4bf-4692-b943-9b2ad7a9face admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e1ce8a0d4fc4154bca8e21fb512810d', 'request_id': 'req-607eaa98-d4bf-4692-b943-9b2ad7a9face'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:44.925789 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-f7c63333-27d3-47a4-bf6b-6b85bb312a13 admin admin] The token cache is being invalidate because project 8af67916348c49ec9bb1b61a26e07849 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 11:58:44.926296 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-f7c63333-27d3-47a4-bf6b-6b85bb312a13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:44.928747 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-f7c63333-27d3-47a4-bf6b-6b85bb312a13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:44.934236 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 867/1727] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 11:58:44 2022] DELETE /identity/v3/projects/8af67916348c49ec9bb1b61a26e07849 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:44.934236 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb75c4-e57e-451b-94de-90d535eefab2 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:44.934236 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb75c4-e57e-451b-94de-90d535eefab2 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:44.934236 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb75c4-e57e-451b-94de-90d535eefab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:44.968294 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-607eaa98-d4bf-4692-b943-9b2ad7a9face admin admin] The token cache is being invalidate because project 2e1ce8a0d4fc4154bca8e21fb512810d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 11:58:44.969877 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-607eaa98-d4bf-4692-b943-9b2ad7a9face admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:44.970703 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-607eaa98-d4bf-4692-b943-9b2ad7a9face admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:44.993218 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 861/1728] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 11:58:44 2022] DELETE /identity/v3/projects/2e1ce8a0d4fc4154bca8e21fb512810d => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 11:58:44.997481 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607eaa98-d4bf-4692-b943-9b2ad7a9face admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:45.003068 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-607eaa98-d4bf-4692-b943-9b2ad7a9face admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:45.012353 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-4acb75c4-e57e-451b-94de-90d535eefab2 None None] MFA Rules not processed for user `a78b4284099546cd9c126a5739380b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:45.014210 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-4acb75c4-e57e-451b-94de-90d535eefab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:45.235013 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607eaa98-d4bf-4692-b943-9b2ad7a9face admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:45.259994 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b8d27-53a6-4356-a684-ebc17f216dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:45.261782 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b8d27-53a6-4356-a684-ebc17f216dc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:45.262306 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b8d27-53a6-4356-a684-ebc17f216dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:45.262763 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b8d27-53a6-4356-a684-ebc17f216dc7 admin admin] PATH_INFO: `/v3/projects/3232b9c258d544c895c3080ba7a061bf` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:45.264446 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78b8d27-53a6-4356-a684-ebc17f216dc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3232b9c258d544c895c3080ba7a061bf)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:45.267423 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78b8d27-53a6-4356-a684-ebc17f216dc7 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:45.325432 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 868/1729] 10.222.0.32 () {58 vars in 1015 bytes} [Fri Jun 3 11:58:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:45.334635 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb75c4-e57e-451b-94de-90d535eefab2 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:45.341633 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-4acb75c4-e57e-451b-94de-90d535eefab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:45.417382 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb75c4-e57e-451b-94de-90d535eefab2 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:45.426098 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-d78b8d27-53a6-4356-a684-ebc17f216dc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3232b9c258d544c895c3080ba7a061bf', 'request_id': 'req-d78b8d27-53a6-4356-a684-ebc17f216dc7'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:45.453435 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-d78b8d27-53a6-4356-a684-ebc17f216dc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3232b9c258d544c895c3080ba7a061bf', 'request_id': 'req-d78b8d27-53a6-4356-a684-ebc17f216dc7'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:45.468891 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:45.479544 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-d78b8d27-53a6-4356-a684-ebc17f216dc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3232b9c258d544c895c3080ba7a061bf', 'request_id': 'req-d78b8d27-53a6-4356-a684-ebc17f216dc7'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:45.545551 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-d78b8d27-53a6-4356-a684-ebc17f216dc7 admin admin] The token cache is being invalidate because project 3232b9c258d544c895c3080ba7a061bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 11:58:45.545858 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-d78b8d27-53a6-4356-a684-ebc17f216dc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:45.546683 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-d78b8d27-53a6-4356-a684-ebc17f216dc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:45.548840 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 862/1730] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 11:58:44 2022] DELETE /identity/v3/projects/3232b9c258d544c895c3080ba7a061bf => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:45.551965 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b8d27-53a6-4356-a684-ebc17f216dc7 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:45.553891 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-d78b8d27-53a6-4356-a684-ebc17f216dc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:45.661991 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8408d85-94db-4f07-b70c-ad005794a9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:45.663682 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8408d85-94db-4f07-b70c-ad005794a9ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:45.664182 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8408d85-94db-4f07-b70c-ad005794a9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:45.665288 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8408d85-94db-4f07-b70c-ad005794a9ff admin admin] PATH_INFO: `/v3/users/aae5bd454f6642f9bd0b0b03875da8c8` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:45.697709 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8408d85-94db-4f07-b70c-ad005794a9ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=aae5bd454f6642f9bd0b0b03875da8c8)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:45.703003 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8408d85-94db-4f07-b70c-ad005794a9ff admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:45.756390 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:45.790913 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b8d27-53a6-4356-a684-ebc17f216dc7 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:45.827803 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd4ea8-9719-4b0d-a02e-2ec9fe96d55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:45.828296 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd4ea8-9719-4b0d-a02e-2ec9fe96d55f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:45.828672 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd4ea8-9719-4b0d-a02e-2ec9fe96d55f admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:45.829026 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd4ea8-9719-4b0d-a02e-2ec9fe96d55f admin admin] PATH_INFO: `/v3/users/220880f1a5184424a3f712b9cbfa77c9` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:45.831038 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd4ea8-9719-4b0d-a02e-2ec9fe96d55f admin admin] RBAC: Authorizing `identity:delete_user(user_id=220880f1a5184424a3f712b9cbfa77c9)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:45.839190 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd4ea8-9719-4b0d-a02e-2ec9fe96d55f admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:45.859158 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-f8408d85-94db-4f07-b70c-ad005794a9ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aae5bd454f6642f9bd0b0b03875da8c8'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:45.863972 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-f8408d85-94db-4f07-b70c-ad005794a9ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aae5bd454f6642f9bd0b0b03875da8c8'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:45.908744 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-f8408d85-94db-4f07-b70c-ad005794a9ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aae5bd454f6642f9bd0b0b03875da8c8'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:45.923294 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-f8408d85-94db-4f07-b70c-ad005794a9ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aae5bd454f6642f9bd0b0b03875da8c8'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:45.942188 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-f8408d85-94db-4f07-b70c-ad005794a9ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aae5bd454f6642f9bd0b0b03875da8c8'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:45.959877 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 869/1731] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 11:58:45 2022] DELETE /identity/v3/users/aae5bd454f6642f9bd0b0b03875da8c8 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:45.960856 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8408d85-94db-4f07-b70c-ad005794a9ff admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:45.973590 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-f8408d85-94db-4f07-b70c-ad005794a9ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:45.978969 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-8ddd4ea8-9719-4b0d-a02e-2ec9fe96d55f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '220880f1a5184424a3f712b9cbfa77c9'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:46.007003 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-8ddd4ea8-9719-4b0d-a02e-2ec9fe96d55f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '220880f1a5184424a3f712b9cbfa77c9'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:46.012110 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-8ddd4ea8-9719-4b0d-a02e-2ec9fe96d55f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '220880f1a5184424a3f712b9cbfa77c9'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:46.053422 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-8ddd4ea8-9719-4b0d-a02e-2ec9fe96d55f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '220880f1a5184424a3f712b9cbfa77c9'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:46.080604 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-8ddd4ea8-9719-4b0d-a02e-2ec9fe96d55f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '220880f1a5184424a3f712b9cbfa77c9'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:46.108503 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 863/1732] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 11:58:45 2022] DELETE /identity/v3/users/220880f1a5184424a3f712b9cbfa77c9 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:46.109539 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd4ea8-9719-4b0d-a02e-2ec9fe96d55f admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:46.117476 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-8ddd4ea8-9719-4b0d-a02e-2ec9fe96d55f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:46.181822 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8408d85-94db-4f07-b70c-ad005794a9ff admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:46.334957 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd4ea8-9719-4b0d-a02e-2ec9fe96d55f admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:46.346529 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9627265c-47e6-4ea8-9835-2eb59771a4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:46.347536 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627265c-47e6-4ea8-9835-2eb59771a4cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:46.347828 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627265c-47e6-4ea8-9835-2eb59771a4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:46.348105 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627265c-47e6-4ea8-9835-2eb59771a4cc admin admin] PATH_INFO: `/v3/users/62b6f4b1658b4373870e810bd03672d8` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:46.351299 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9627265c-47e6-4ea8-9835-2eb59771a4cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=62b6f4b1658b4373870e810bd03672d8)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:46.354796 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9627265c-47e6-4ea8-9835-2eb59771a4cc admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:46.398558 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:46.484889 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e213911-0a43-4357-b127-e260a3e83d2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:46.485849 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e213911-0a43-4357-b127-e260a3e83d2d service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:46.486332 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e213911-0a43-4357-b127-e260a3e83d2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:46.487881 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e213911-0a43-4357-b127-e260a3e83d2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:46.494630 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-4e213911-0a43-4357-b127-e260a3e83d2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:46.516445 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-9627265c-47e6-4ea8-9835-2eb59771a4cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62b6f4b1658b4373870e810bd03672d8'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:46.527672 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-9627265c-47e6-4ea8-9835-2eb59771a4cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62b6f4b1658b4373870e810bd03672d8'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:46.528264 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-9627265c-47e6-4ea8-9835-2eb59771a4cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62b6f4b1658b4373870e810bd03672d8'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:46.557735 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e213911-0a43-4357-b127-e260a3e83d2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:46.560159 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e213911-0a43-4357-b127-e260a3e83d2d service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:46.583278 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-9627265c-47e6-4ea8-9835-2eb59771a4cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62b6f4b1658b4373870e810bd03672d8'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:46.605725 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 870/1733] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:58:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 645 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:58:46.606314 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-9627265c-47e6-4ea8-9835-2eb59771a4cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62b6f4b1658b4373870e810bd03672d8'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:46.609605 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e213911-0a43-4357-b127-e260a3e83d2d service neutron] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:46.621422 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 864/1734] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 11:58:46 2022] DELETE /identity/v3/users/62b6f4b1658b4373870e810bd03672d8 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:46.624410 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-4e213911-0a43-4357-b127-e260a3e83d2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:46.688712 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e213911-0a43-4357-b127-e260a3e83d2d service neutron] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:46.884710 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:46.899861 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3cc298-c5bc-4df2-9ac1-8af12e33a642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:46.903167 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3cc298-c5bc-4df2-9ac1-8af12e33a642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:46.922203 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3cc298-c5bc-4df2-9ac1-8af12e33a642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:46.922889 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3cc298-c5bc-4df2-9ac1-8af12e33a642 admin admin] PATH_INFO: `/v3/users/d25b6b5454bb4aa2b3c24ca97cef9c72` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:46.932019 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3cc298-c5bc-4df2-9ac1-8af12e33a642 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d25b6b5454bb4aa2b3c24ca97cef9c72)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:46.936225 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3cc298-c5bc-4df2-9ac1-8af12e33a642 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:47.175472 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-8e3cc298-c5bc-4df2-9ac1-8af12e33a642 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd25b6b5454bb4aa2b3c24ca97cef9c72'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:47.177197 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-8e3cc298-c5bc-4df2-9ac1-8af12e33a642 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd25b6b5454bb4aa2b3c24ca97cef9c72'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:47.222327 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-8e3cc298-c5bc-4df2-9ac1-8af12e33a642 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd25b6b5454bb4aa2b3c24ca97cef9c72'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:47.242054 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-8e3cc298-c5bc-4df2-9ac1-8af12e33a642 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd25b6b5454bb4aa2b3c24ca97cef9c72'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:47.300364 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-8e3cc298-c5bc-4df2-9ac1-8af12e33a642 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd25b6b5454bb4aa2b3c24ca97cef9c72'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:47.333366 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9627265c-47e6-4ea8-9835-2eb59771a4cc admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:47.336053 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-9627265c-47e6-4ea8-9835-2eb59771a4cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:47.348589 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 871/1735] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 11:58:46 2022] DELETE /identity/v3/users/d25b6b5454bb4aa2b3c24ca97cef9c72 => generated 0 bytes in 738 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:47.352644 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843df36-2c58-4433-8d1c-c25b70529ef6 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:47.358989 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843df36-2c58-4433-8d1c-c25b70529ef6 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:47.359287 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843df36-2c58-4433-8d1c-c25b70529ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:47.366279 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9627265c-47e6-4ea8-9835-2eb59771a4cc admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:47.474699 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-5843df36-2c58-4433-8d1c-c25b70529ef6 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:47.478599 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874327eb-2e26-41fd-896a-0e45363ced10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:47.479831 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874327eb-2e26-41fd-896a-0e45363ced10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:47.480425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874327eb-2e26-41fd-896a-0e45363ced10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:47.483075 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874327eb-2e26-41fd-896a-0e45363ced10 admin admin] PATH_INFO: `/v3/projects/d357a3587492423190588cdbe6350346` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:47.483439 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874327eb-2e26-41fd-896a-0e45363ced10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d357a3587492423190588cdbe6350346)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:47.484160 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-5843df36-2c58-4433-8d1c-c25b70529ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:47.489249 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874327eb-2e26-41fd-896a-0e45363ced10 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:47.515680 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 872/1736] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:47.576515 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-874327eb-2e26-41fd-896a-0e45363ced10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd357a3587492423190588cdbe6350346', 'request_id': 'req-874327eb-2e26-41fd-896a-0e45363ced10'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:47.595307 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-874327eb-2e26-41fd-896a-0e45363ced10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd357a3587492423190588cdbe6350346', 'request_id': 'req-874327eb-2e26-41fd-896a-0e45363ced10'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:47.612609 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-874327eb-2e26-41fd-896a-0e45363ced10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd357a3587492423190588cdbe6350346', 'request_id': 'req-874327eb-2e26-41fd-896a-0e45363ced10'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:47.648686 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-874327eb-2e26-41fd-896a-0e45363ced10 admin admin] The token cache is being invalidate because project d357a3587492423190588cdbe6350346 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 11:58:47.649016 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-874327eb-2e26-41fd-896a-0e45363ced10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:47.651308 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-874327eb-2e26-41fd-896a-0e45363ced10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:47.653252 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 865/1737] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 11:58:47 2022] DELETE /identity/v3/projects/d357a3587492423190588cdbe6350346 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 11:58:47.658136 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb52b41-ff13-4f9d-98b4-0dab50ca3902 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:47.658562 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb52b41-ff13-4f9d-98b4-0dab50ca3902 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:47.658958 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb52b41-ff13-4f9d-98b4-0dab50ca3902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:47.699018 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-4bb52b41-ff13-4f9d-98b4-0dab50ca3902 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:47.703024 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-4bb52b41-ff13-4f9d-98b4-0dab50ca3902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:47.924130 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874327eb-2e26-41fd-896a-0e45363ced10 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:47.925815 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-874327eb-2e26-41fd-896a-0e45363ced10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:47.926202 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 873/1738] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:47.931254 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5581d43-2be9-4336-ae21-77cddf879bf2 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:47.931599 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5581d43-2be9-4336-ae21-77cddf879bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:47.931885 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5581d43-2be9-4336-ae21-77cddf879bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:47.964007 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-a5581d43-2be9-4336-ae21-77cddf879bf2 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:47.965943 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-a5581d43-2be9-4336-ae21-77cddf879bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:47.974793 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:47.979769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 874/1739] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:47.980696 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5581d43-2be9-4336-ae21-77cddf879bf2 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:47.991545 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5581d43-2be9-4336-ae21-77cddf879bf2 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:47.997725 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49ffeb-80b5-4e58-adae-425cd2df71d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:47.998390 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49ffeb-80b5-4e58-adae-425cd2df71d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:47.998671 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49ffeb-80b5-4e58-adae-425cd2df71d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:47.998949 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49ffeb-80b5-4e58-adae-425cd2df71d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:47.999850 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b49ffeb-80b5-4e58-adae-425cd2df71d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:58:48.000160 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b49ffeb-80b5-4e58-adae-425cd2df71d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:48.001772 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b49ffeb-80b5-4e58-adae-425cd2df71d6 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:48.039042 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 875/1740] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 11:58:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:58:48.043788 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49ffeb-80b5-4e58-adae-425cd2df71d6 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:48.058435 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49ffeb-80b5-4e58-adae-425cd2df71d6 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:48.073232 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874327eb-2e26-41fd-896a-0e45363ced10 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:48.084323 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb685226-b072-49ae-957b-193d860cb364 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:48.085007 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb685226-b072-49ae-957b-193d860cb364 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:48.085292 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb685226-b072-49ae-957b-193d860cb364 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:48.085569 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb685226-b072-49ae-957b-193d860cb364 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:48.088612 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d256374-322e-43e2-aee5-24ee75fcbf04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:48.090932 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-bb685226-b072-49ae-957b-193d860cb364 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:48.091200 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d256374-322e-43e2-aee5-24ee75fcbf04 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:48.092430 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d256374-322e-43e2-aee5-24ee75fcbf04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:48.093005 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d256374-322e-43e2-aee5-24ee75fcbf04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:48.096047 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d256374-322e-43e2-aee5-24ee75fcbf04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:48.101889 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d256374-322e-43e2-aee5-24ee75fcbf04 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:48.123415 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb685226-b072-49ae-957b-193d860cb364 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:48.124985 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb685226-b072-49ae-957b-193d860cb364 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:48.157223 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 866/1741] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:58:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 11:58:48.171674 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 876/1742] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:58:48 2022] POST /identity/v3/projects => generated 363 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:58:48.176037 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb685226-b072-49ae-957b-193d860cb364 service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:48.187813 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb685226-b072-49ae-957b-193d860cb364 service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:48.305678 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b3370-1d65-435b-a5dd-3c9febb9bfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:48.308563 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b3370-1d65-435b-a5dd-3c9febb9bfce admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:48.309243 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b3370-1d65-435b-a5dd-3c9febb9bfce admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:48.309626 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b3370-1d65-435b-a5dd-3c9febb9bfce admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:48.310498 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b3370-1d65-435b-a5dd-3c9febb9bfce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:48.312697 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b3370-1d65-435b-a5dd-3c9febb9bfce admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:48.383667 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 867/1743] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:58:48 2022] POST /identity/v3/users => generated 282 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:58:48.385894 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d256374-322e-43e2-aee5-24ee75fcbf04 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:48.444976 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d256374-322e-43e2-aee5-24ee75fcbf04 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:48.481141 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc333a-fc58-441a-a068-32f14f8f1263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:48.483458 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc333a-fc58-441a-a068-32f14f8f1263 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:48.484807 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc333a-fc58-441a-a068-32f14f8f1263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:48.485965 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc333a-fc58-441a-a068-32f14f8f1263 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:48.498538 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebc333a-fc58-441a-a068-32f14f8f1263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:48.505361 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebc333a-fc58-441a-a068-32f14f8f1263 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:48.556570 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b3370-1d65-435b-a5dd-3c9febb9bfce admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:48.563963 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 877/1744] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:58:48.569908 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b3370-1d65-435b-a5dd-3c9febb9bfce admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:48.581362 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32137218-e7c8-4dbe-8fe1-720e22a67f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:48.582288 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32137218-e7c8-4dbe-8fe1-720e22a67f97 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:48.582758 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32137218-e7c8-4dbe-8fe1-720e22a67f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:48.585610 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32137218-e7c8-4dbe-8fe1-720e22a67f97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:48.587117 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32137218-e7c8-4dbe-8fe1-720e22a67f97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:48.591259 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32137218-e7c8-4dbe-8fe1-720e22a67f97 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:48.634742 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc333a-fc58-441a-a068-32f14f8f1263 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:48.641980 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 868/1745] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:58:48.646180 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc333a-fc58-441a-a068-32f14f8f1263 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:48.661444 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64967516-c281-4897-92b2-12c0e726835c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:48.662343 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64967516-c281-4897-92b2-12c0e726835c admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:48.662627 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64967516-c281-4897-92b2-12c0e726835c admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:48.662881 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64967516-c281-4897-92b2-12c0e726835c admin admin] PATH_INFO: `/v3/projects/737a42eebb1345e4a179d2e1d6d103ee/users/eae970eb8fe340cb9e6f8e68b8efd73b/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:48.713880 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64967516-c281-4897-92b2-12c0e726835c admin admin] RBAC: Authorizing `identity:create_grant(project_id=737a42eebb1345e4a179d2e1d6d103ee, user_id=eae970eb8fe340cb9e6f8e68b8efd73b, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:48.716736 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64967516-c281-4897-92b2-12c0e726835c admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:48.719638 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:48.745618 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 878/1746] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:58:48 2022] PUT /identity/v3/projects/737a42eebb1345e4a179d2e1d6d103ee/users/eae970eb8fe340cb9e6f8e68b8efd73b/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:48.755400 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b3c0e-66fe-45af-b713-626d56ccf2c3 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:48.755718 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b3c0e-66fe-45af-b713-626d56ccf2c3 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:48.756005 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b3c0e-66fe-45af-b713-626d56ccf2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:48.836282 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-fe8b3c0e-66fe-45af-b713-626d56ccf2c3 None None] MFA Rules not processed for user `eae970eb8fe340cb9e6f8e68b8efd73b`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:48.838171 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-fe8b3c0e-66fe-45af-b713-626d56ccf2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:49.042208 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64967516-c281-4897-92b2-12c0e726835c admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:49.044997 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-64967516-c281-4897-92b2-12c0e726835c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:49.183401 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 869/1747] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:48 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:49.187812 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b3c0e-66fe-45af-b713-626d56ccf2c3 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:49.276054 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64967516-c281-4897-92b2-12c0e726835c admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:49.287127 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2bcf99-aca9-41c3-9818-ce766811d2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:49.288734 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bcf99-aca9-41c3-9818-ce766811d2bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:49.289034 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bcf99-aca9-41c3-9818-ce766811d2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:49.289367 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bcf99-aca9-41c3-9818-ce766811d2bb admin admin] PATH_INFO: `/v3/projects/5009317ef9274b6f8cbb440dac20a3fe` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:49.291173 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2bcf99-aca9-41c3-9818-ce766811d2bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5009317ef9274b6f8cbb440dac20a3fe)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:49.293419 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:49.294102 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2bcf99-aca9-41c3-9818-ce766811d2bb admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:49.374621 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b3c0e-66fe-45af-b713-626d56ccf2c3 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:49.391849 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031a688-13ca-426d-abb7-46e58904c0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:49.395030 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031a688-13ca-426d-abb7-46e58904c0e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:49.395541 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031a688-13ca-426d-abb7-46e58904c0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:49.396637 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031a688-13ca-426d-abb7-46e58904c0e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:49.397840 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f031a688-13ca-426d-abb7-46e58904c0e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:49.399835 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-eb2bcf99-aca9-41c3-9818-ce766811d2bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5009317ef9274b6f8cbb440dac20a3fe', 'request_id': 'req-eb2bcf99-aca9-41c3-9818-ce766811d2bb'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:49.401003 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f031a688-13ca-426d-abb7-46e58904c0e3 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:49.408120 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-eb2bcf99-aca9-41c3-9818-ce766811d2bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5009317ef9274b6f8cbb440dac20a3fe', 'request_id': 'req-eb2bcf99-aca9-41c3-9818-ce766811d2bb'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:49.420614 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-eb2bcf99-aca9-41c3-9818-ce766811d2bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5009317ef9274b6f8cbb440dac20a3fe', 'request_id': 'req-eb2bcf99-aca9-41c3-9818-ce766811d2bb'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:49.439580 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-eb2bcf99-aca9-41c3-9818-ce766811d2bb admin admin] The token cache is being invalidate because project 5009317ef9274b6f8cbb440dac20a3fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 11:58:49.439785 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-eb2bcf99-aca9-41c3-9818-ce766811d2bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:49.440440 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-eb2bcf99-aca9-41c3-9818-ce766811d2bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:49.453811 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 879/1748] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 11:58:49 2022] DELETE /identity/v3/projects/5009317ef9274b6f8cbb440dac20a3fe => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:49.474765 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 870/1749] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:58:49 2022] POST /identity/v3/projects => generated 365 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 11:58:49.478568 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031a688-13ca-426d-abb7-46e58904c0e3 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:49.484649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-f031a688-13ca-426d-abb7-46e58904c0e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:49.519686 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d5e47-0a03-4380-9512-661c8be947fe None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:49.521691 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d5e47-0a03-4380-9512-661c8be947fe None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:49.522921 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d5e47-0a03-4380-9512-661c8be947fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:49.599557 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-9c9d5e47-0a03-4380-9512-661c8be947fe None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:49.601669 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-9c9d5e47-0a03-4380-9512-661c8be947fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:49.761073 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 880/1750] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:49.762755 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbc90b-ff7c-458f-a07a-2d2f626f4a76 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:49.765831 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbc90b-ff7c-458f-a07a-2d2f626f4a76 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:49.766233 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbc90b-ff7c-458f-a07a-2d2f626f4a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:49.796063 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031a688-13ca-426d-abb7-46e58904c0e3 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:49.808391 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d369d9-280b-4aad-89f7-a2b8976ff6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:49.809353 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d369d9-280b-4aad-89f7-a2b8976ff6ea admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:49.809704 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-a1fbc90b-ff7c-458f-a07a-2d2f626f4a76 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:49.809976 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d369d9-280b-4aad-89f7-a2b8976ff6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:49.810420 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d369d9-280b-4aad-89f7-a2b8976ff6ea admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:49.811225 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-a1fbc90b-ff7c-458f-a07a-2d2f626f4a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:49.812250 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d369d9-280b-4aad-89f7-a2b8976ff6ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:49.814384 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d369d9-280b-4aad-89f7-a2b8976ff6ea admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:49.836185 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 881/1751] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:49.837888 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fbc90b-ff7c-458f-a07a-2d2f626f4a76 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:49.856567 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fbc90b-ff7c-458f-a07a-2d2f626f4a76 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:49.865552 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081680c-f382-43f0-b4b7-c972ac6192f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:49.866236 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081680c-f382-43f0-b4b7-c972ac6192f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:49.867637 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081680c-f382-43f0-b4b7-c972ac6192f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:49.868035 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081680c-f382-43f0-b4b7-c972ac6192f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:49.868941 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081680c-f382-43f0-b4b7-c972ac6192f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:58:49.869693 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081680c-f382-43f0-b4b7-c972ac6192f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:49.872041 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081680c-f382-43f0-b4b7-c972ac6192f5 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:49.883079 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 871/1752] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:58:49 2022] POST /identity/v3/users => generated 289 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 11:58:49.887166 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d369d9-280b-4aad-89f7-a2b8976ff6ea admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:49.909319 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 882/1753] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 11:58:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:58:49.910679 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081680c-f382-43f0-b4b7-c972ac6192f5 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:49.911694 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d369d9-280b-4aad-89f7-a2b8976ff6ea admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:49.928836 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae7582-8129-474b-9bb2-83c797ffc307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:49.929198 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:49.932693 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae7582-8129-474b-9bb2-83c797ffc307 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:49.932988 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae7582-8129-474b-9bb2-83c797ffc307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:49.933344 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae7582-8129-474b-9bb2-83c797ffc307 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:49.934006 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dae7582-8129-474b-9bb2-83c797ffc307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:49.938486 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081680c-f382-43f0-b4b7-c972ac6192f5 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:49.946248 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dae7582-8129-474b-9bb2-83c797ffc307 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:49.955375 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2deb9-8b10-4410-8b16-2123e4af9611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:49.956496 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2deb9-8b10-4410-8b16-2123e4af9611 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:49.960712 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2deb9-8b10-4410-8b16-2123e4af9611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:49.961238 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2deb9-8b10-4410-8b16-2123e4af9611 admin admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:49.971181 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2deb9-8b10-4410-8b16-2123e4af9611 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:49.973044 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 872/1754] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 11:58:49.973922 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae7582-8129-474b-9bb2-83c797ffc307 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:49.976076 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2deb9-8b10-4410-8b16-2123e4af9611 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:49.981338 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-2dae7582-8129-474b-9bb2-83c797ffc307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:50.007009 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae7582-8129-474b-9bb2-83c797ffc307 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:50.013902 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f72ab-2e19-4b1d-be45-72e5c9008a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:50.014754 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f72ab-2e19-4b1d-be45-72e5c9008a40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:50.018706 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f72ab-2e19-4b1d-be45-72e5c9008a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:50.018706 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f72ab-2e19-4b1d-be45-72e5c9008a40 admin admin] PATH_INFO: `/v3/projects/2c931d0d666d47c8a1c7bd1b3d83aec0` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:50.025168 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f72ab-2e19-4b1d-be45-72e5c9008a40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c931d0d666d47c8a1c7bd1b3d83aec0)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:50.027219 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f72ab-2e19-4b1d-be45-72e5c9008a40 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:50.047325 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 883/1755] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:58:49 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:58:50.049645 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2deb9-8b10-4410-8b16-2123e4af9611 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:50.134299 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-fe5f72ab-2e19-4b1d-be45-72e5c9008a40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c931d0d666d47c8a1c7bd1b3d83aec0', 'request_id': 'req-fe5f72ab-2e19-4b1d-be45-72e5c9008a40'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:50.144565 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-fe5f72ab-2e19-4b1d-be45-72e5c9008a40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c931d0d666d47c8a1c7bd1b3d83aec0', 'request_id': 'req-fe5f72ab-2e19-4b1d-be45-72e5c9008a40'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:50.180968 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-fe5f72ab-2e19-4b1d-be45-72e5c9008a40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c931d0d666d47c8a1c7bd1b3d83aec0', 'request_id': 'req-fe5f72ab-2e19-4b1d-be45-72e5c9008a40'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:50.201476 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-fe5f72ab-2e19-4b1d-be45-72e5c9008a40 admin admin] The token cache is being invalidate because project 2c931d0d666d47c8a1c7bd1b3d83aec0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 11:58:50.202013 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-fe5f72ab-2e19-4b1d-be45-72e5c9008a40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:50.204371 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-fe5f72ab-2e19-4b1d-be45-72e5c9008a40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:50.208884 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 873/1756] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 11:58:49 2022] DELETE /identity/v3/projects/2c931d0d666d47c8a1c7bd1b3d83aec0 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:50.209704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f72ab-2e19-4b1d-be45-72e5c9008a40 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:50.212910 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-fe5f72ab-2e19-4b1d-be45-72e5c9008a40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:50.253802 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:50.260838 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2deb9-8b10-4410-8b16-2123e4af9611 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:50.397327 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d897918-6ab1-4158-9b42-98e263a58a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:50.398256 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f72ab-2e19-4b1d-be45-72e5c9008a40 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:50.400290 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d897918-6ab1-4158-9b42-98e263a58a51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:50.402354 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d897918-6ab1-4158-9b42-98e263a58a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:50.402836 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d897918-6ab1-4158-9b42-98e263a58a51 admin admin] PATH_INFO: `/v3/projects/173fc0a98cec458698a15d173bdec6f9/users/6526ae625bec48c2af5bf5763e46b93a/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:50.416967 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f83112-5687-4b4a-bcaf-2380aaa12b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:50.418211 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f83112-5687-4b4a-bcaf-2380aaa12b56 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:50.418551 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f83112-5687-4b4a-bcaf-2380aaa12b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:50.418857 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f83112-5687-4b4a-bcaf-2380aaa12b56 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:50.420415 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f83112-5687-4b4a-bcaf-2380aaa12b56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:50.439830 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f83112-5687-4b4a-bcaf-2380aaa12b56 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:50.450787 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d897918-6ab1-4158-9b42-98e263a58a51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=173fc0a98cec458698a15d173bdec6f9, user_id=6526ae625bec48c2af5bf5763e46b93a, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:50.454907 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d897918-6ab1-4158-9b42-98e263a58a51 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:50.485319 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 874/1757] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:58:50 2022] POST /identity/v3/users => generated 293 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:58:50.490402 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6743e7-d86e-4561-8756-fe84b76d65cb None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:50.490699 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6743e7-d86e-4561-8756-fe84b76d65cb None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:50.490986 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6743e7-d86e-4561-8756-fe84b76d65cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:50.530350 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 884/1758] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:58:50 2022] PUT /identity/v3/projects/173fc0a98cec458698a15d173bdec6f9/users/6526ae625bec48c2af5bf5763e46b93a/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:50.532505 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d897918-6ab1-4158-9b42-98e263a58a51 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:50.536916 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-7d897918-6ab1-4158-9b42-98e263a58a51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:50.562092 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-0d6743e7-d86e-4561-8756-fe84b76d65cb None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:50.563331 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-0d6743e7-d86e-4561-8756-fe84b76d65cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:50.762383 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 875/1759] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:50.762383 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6743e7-d86e-4561-8756-fe84b76d65cb None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:50.767608 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d897918-6ab1-4158-9b42-98e263a58a51 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:50.785105 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f94d3-9dab-469e-8e4a-c8762a7686a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:50.786149 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f94d3-9dab-469e-8e4a-c8762a7686a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:50.786511 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f94d3-9dab-469e-8e4a-c8762a7686a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:50.786862 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f94d3-9dab-469e-8e4a-c8762a7686a3 admin admin] PATH_INFO: `/v3/projects/07723184e8584c47b993ec713096f107` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:50.788354 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f94d3-9dab-469e-8e4a-c8762a7686a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07723184e8584c47b993ec713096f107)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:50.791234 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f94d3-9dab-469e-8e4a-c8762a7686a3 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:50.806721 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6743e7-d86e-4561-8756-fe84b76d65cb None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:50.828857 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:50.829932 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1aef6-0fdb-4241-a81b-32785d09dfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:50.830621 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1aef6-0fdb-4241-a81b-32785d09dfd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:50.830908 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1aef6-0fdb-4241-a81b-32785d09dfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:50.831188 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1aef6-0fdb-4241-a81b-32785d09dfd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:50.832289 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c1aef6-0fdb-4241-a81b-32785d09dfd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:50.834071 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c1aef6-0fdb-4241-a81b-32785d09dfd2 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:50.873412 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 876/1760] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:58:50 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:58:50.874381 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1aef6-0fdb-4241-a81b-32785d09dfd2 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:50.884098 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-53c1aef6-0fdb-4241-a81b-32785d09dfd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:50.899712 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-cf5f94d3-9dab-469e-8e4a-c8762a7686a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07723184e8584c47b993ec713096f107', 'request_id': 'req-cf5f94d3-9dab-469e-8e4a-c8762a7686a3'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:50.917392 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-cf5f94d3-9dab-469e-8e4a-c8762a7686a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07723184e8584c47b993ec713096f107', 'request_id': 'req-cf5f94d3-9dab-469e-8e4a-c8762a7686a3'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:50.921241 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1aef6-0fdb-4241-a81b-32785d09dfd2 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:50.933783 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-cf5f94d3-9dab-469e-8e4a-c8762a7686a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07723184e8584c47b993ec713096f107', 'request_id': 'req-cf5f94d3-9dab-469e-8e4a-c8762a7686a3'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:50.951650 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-cf5f94d3-9dab-469e-8e4a-c8762a7686a3 admin admin] The token cache is being invalidate because project 07723184e8584c47b993ec713096f107 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 11:58:50.952334 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-cf5f94d3-9dab-469e-8e4a-c8762a7686a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:50.953517 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-cf5f94d3-9dab-469e-8e4a-c8762a7686a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:50.963925 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 885/1761] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 11:58:50 2022] DELETE /identity/v3/projects/07723184e8584c47b993ec713096f107 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:50.967869 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e8f61-8ca6-432b-8593-e7179fdcda2c None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:50.968781 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e8f61-8ca6-432b-8593-e7179fdcda2c None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:50.970146 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e8f61-8ca6-432b-8593-e7179fdcda2c None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:50.978762 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 886/1762] 10.222.0.15 () {54 vars in 921 bytes} [Fri Jun 3 11:58:50 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:58:50.980294 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c081b-bf2f-4ac9-b33b-5d862477e51e None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:50.980664 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c081b-bf2f-4ac9-b33b-5d862477e51e None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:50.981013 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c081b-bf2f-4ac9-b33b-5d862477e51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:51.010136 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-313c081b-bf2f-4ac9-b33b-5d862477e51e None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:51.011696 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-313c081b-bf2f-4ac9-b33b-5d862477e51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:51.061873 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d1ae2-2d71-45c7-809b-8d616331ce57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:51.062583 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d1ae2-2d71-45c7-809b-8d616331ce57 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:51.062871 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d1ae2-2d71-45c7-809b-8d616331ce57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:51.063157 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d1ae2-2d71-45c7-809b-8d616331ce57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:51.063936 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d1ae2-2d71-45c7-809b-8d616331ce57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:51.065588 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d1ae2-2d71-45c7-809b-8d616331ce57 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:51.099269 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 877/1763] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:58:50 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:58:51.100236 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d1ae2-2d71-45c7-809b-8d616331ce57 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:51.103785 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-159d1ae2-2d71-45c7-809b-8d616331ce57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:51.115627 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 887/1764] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:51.117445 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff473910-b523-4426-a5a0-fccf9d96e6f0 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:51.117777 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff473910-b523-4426-a5a0-fccf9d96e6f0 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:51.118059 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff473910-b523-4426-a5a0-fccf9d96e6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:51.125994 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d1ae2-2d71-45c7-809b-8d616331ce57 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:51.145464 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-ff473910-b523-4426-a5a0-fccf9d96e6f0 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:51.146904 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225bbd9c-f3a3-42fa-800a-0b4d84dd9985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:51.147757 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-ff473910-b523-4426-a5a0-fccf9d96e6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:51.147882 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bbd9c-f3a3-42fa-800a-0b4d84dd9985 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:51.148163 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bbd9c-f3a3-42fa-800a-0b4d84dd9985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:51.148442 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bbd9c-f3a3-42fa-800a-0b4d84dd9985 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:51.149761 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225bbd9c-f3a3-42fa-800a-0b4d84dd9985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:51.151374 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225bbd9c-f3a3-42fa-800a-0b4d84dd9985 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:51.165452 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 888/1765] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:51.166602 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff473910-b523-4426-a5a0-fccf9d96e6f0 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:51.168538 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-ff473910-b523-4426-a5a0-fccf9d96e6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:51.184696 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff473910-b523-4426-a5a0-fccf9d96e6f0 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:51.189641 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 878/1766] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:58:51.190556 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225bbd9c-f3a3-42fa-800a-0b4d84dd9985 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:51.196661 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e72d6d-8344-45fd-90ef-47d22cfe8365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:51.198117 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e72d6d-8344-45fd-90ef-47d22cfe8365 admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:51.198412 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e72d6d-8344-45fd-90ef-47d22cfe8365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:51.198799 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e72d6d-8344-45fd-90ef-47d22cfe8365 admin admin] PATH_INFO: `/v3/projects/173fc0a98cec458698a15d173bdec6f9/users/6526ae625bec48c2af5bf5763e46b93a/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:51.201543 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e72d6d-8344-45fd-90ef-47d22cfe8365 admin admin] RBAC: Authorizing `identity:create_grant(project_id=173fc0a98cec458698a15d173bdec6f9, user_id=6526ae625bec48c2af5bf5763e46b93a, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:51.202660 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225bbd9c-f3a3-42fa-800a-0b4d84dd9985 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:51.204395 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e72d6d-8344-45fd-90ef-47d22cfe8365 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:51.208129 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb955bc-ed76-47ef-85cf-d5fec619bf20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:51.208795 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb955bc-ed76-47ef-85cf-d5fec619bf20 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:51.209079 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb955bc-ed76-47ef-85cf-d5fec619bf20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:51.209350 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb955bc-ed76-47ef-85cf-d5fec619bf20 admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:51.210075 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb955bc-ed76-47ef-85cf-d5fec619bf20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:58:51.210381 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb955bc-ed76-47ef-85cf-d5fec619bf20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:51.212602 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb955bc-ed76-47ef-85cf-d5fec619bf20 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:51.219980 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 889/1767] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:58:51 2022] PUT /identity/v3/projects/173fc0a98cec458698a15d173bdec6f9/users/6526ae625bec48c2af5bf5763e46b93a/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:51.221615 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75bc49-6026-4c43-b86c-b9c3e6165b26 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:51.221909 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75bc49-6026-4c43-b86c-b9c3e6165b26 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:51.222274 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75bc49-6026-4c43-b86c-b9c3e6165b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:51.227335 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 879/1768] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 11:58:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:58:51.228976 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e32b1-3401-43e9-8009-fa6eef5c7919 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:51.229276 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e32b1-3401-43e9-8009-fa6eef5c7919 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:51.229558 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e32b1-3401-43e9-8009-fa6eef5c7919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:51.254544 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-8b75bc49-6026-4c43-b86c-b9c3e6165b26 None None] MFA Rules not processed for user `6247bfb7aebd45eeb97ba5933be44c6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:51.255990 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-8b75bc49-6026-4c43-b86c-b9c3e6165b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:51.279283 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-2f7e32b1-3401-43e9-8009-fa6eef5c7919 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:51.280549 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-2f7e32b1-3401-43e9-8009-fa6eef5c7919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:51.285822 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:51.378445 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 880/1769] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:51.379291 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e32b1-3401-43e9-8009-fa6eef5c7919 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:51.391354 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e32b1-3401-43e9-8009-fa6eef5c7919 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:51.399466 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f6773-ce60-43b5-b102-2f73d0ddac7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:51.400715 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f6773-ce60-43b5-b102-2f73d0ddac7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:51.401170 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f6773-ce60-43b5-b102-2f73d0ddac7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:51.401606 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f6773-ce60-43b5-b102-2f73d0ddac7e admin admin] PATH_INFO: `/v3/projects/b7c72c55ca164996829e935e7fc3b598/users/d72ae65a9faa4b719b4343e83051cdd1/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:51.427023 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f6773-ce60-43b5-b102-2f73d0ddac7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7c72c55ca164996829e935e7fc3b598, user_id=d72ae65a9faa4b719b4343e83051cdd1, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:51.431194 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f6773-ce60-43b5-b102-2f73d0ddac7e admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:51.432924 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 890/1770] 10.222.0.15 () {58 vars in 1018 bytes} [Fri Jun 3 11:58:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:51.434359 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34181fe-79c2-477b-8416-eff9ca1f4bcb None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:51.434733 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34181fe-79c2-477b-8416-eff9ca1f4bcb None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:51.435097 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34181fe-79c2-477b-8416-eff9ca1f4bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:51.470382 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 881/1771] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:58:51 2022] PUT /identity/v3/projects/b7c72c55ca164996829e935e7fc3b598/users/d72ae65a9faa4b719b4343e83051cdd1/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:51.470382 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f6773-ce60-43b5-b102-2f73d0ddac7e admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:51.498838 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-e34181fe-79c2-477b-8416-eff9ca1f4bcb None None] MFA Rules not processed for user `6526ae625bec48c2af5bf5763e46b93a`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:51.500180 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-e34181fe-79c2-477b-8416-eff9ca1f4bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:51.511123 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:51.628005 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f6773-ce60-43b5-b102-2f73d0ddac7e admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:51.641259 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c56b3-72e5-40cb-a682-7fa6952e620d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:51.641919 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c56b3-72e5-40cb-a682-7fa6952e620d admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:51.642385 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c56b3-72e5-40cb-a682-7fa6952e620d admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:51.642830 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c56b3-72e5-40cb-a682-7fa6952e620d admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:51.644945 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c56b3-72e5-40cb-a682-7fa6952e620d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:51.648515 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c56b3-72e5-40cb-a682-7fa6952e620d admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:51.682415 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 891/1772] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:51 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:51.689395 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34181fe-79c2-477b-8416-eff9ca1f4bcb None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:51.717157 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 882/1773] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:58:51 2022] POST /identity/v3/projects => generated 367 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:58:51.719530 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a44b07-e886-49ef-a876-ffb1809b36d6 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:51.719530 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a44b07-e886-49ef-a876-ffb1809b36d6 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:51.719530 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a44b07-e886-49ef-a876-ffb1809b36d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:51.723904 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34181fe-79c2-477b-8416-eff9ca1f4bcb None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:51.808638 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-c1a44b07-e886-49ef-a876-ffb1809b36d6 None None] MFA Rules not processed for user `d72ae65a9faa4b719b4343e83051cdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:51.815736 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-c1a44b07-e886-49ef-a876-ffb1809b36d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:51.879397 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa45821-24df-4aa5-8025-afa89e0e936e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:51.880976 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa45821-24df-4aa5-8025-afa89e0e936e admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:51.881528 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa45821-24df-4aa5-8025-afa89e0e936e admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:51.882071 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa45821-24df-4aa5-8025-afa89e0e936e admin admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:51.883641 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa45821-24df-4aa5-8025-afa89e0e936e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:58:51.884160 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa45821-24df-4aa5-8025-afa89e0e936e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:51.886156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa45821-24df-4aa5-8025-afa89e0e936e admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:51.925546 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 892/1774] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 11:58:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:58:51.926753 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa45821-24df-4aa5-8025-afa89e0e936e admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:51.928738 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-faa45821-24df-4aa5-8025-afa89e0e936e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:52.051038 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa45821-24df-4aa5-8025-afa89e0e936e admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:52.060271 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf2088-a32c-4452-b802-f9dd2d9ec8ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:52.061134 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf2088-a32c-4452-b802-f9dd2d9ec8ca service nova] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:52.061536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf2088-a32c-4452-b802-f9dd2d9ec8ca service nova] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:52.062026 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf2088-a32c-4452-b802-f9dd2d9ec8ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:52.076315 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:52.086586 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf2088-a32c-4452-b802-f9dd2d9ec8ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:52.091740 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf2088-a32c-4452-b802-f9dd2d9ec8ca service nova] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:52.091917 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 883/1775] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:52.094364 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a44b07-e886-49ef-a876-ffb1809b36d6 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:52.100225 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-c1a44b07-e886-49ef-a876-ffb1809b36d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:52.109727 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 893/1776] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:58:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:58:52.124020 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf2088-a32c-4452-b802-f9dd2d9ec8ca service nova] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:52.157491 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf2088-a32c-4452-b802-f9dd2d9ec8ca service nova] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:52.174704 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a969dc-301a-43c7-9152-f055e0a0e7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:52.176628 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a969dc-301a-43c7-9152-f055e0a0e7b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:52.176920 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a969dc-301a-43c7-9152-f055e0a0e7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:52.177202 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a969dc-301a-43c7-9152-f055e0a0e7b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:52.180984 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a969dc-301a-43c7-9152-f055e0a0e7b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:52.186030 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a969dc-301a-43c7-9152-f055e0a0e7b9 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:52.238849 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 894/1777] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:58:52 2022] POST /identity/v3/users => generated 284 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:58:52.239853 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a969dc-301a-43c7-9152-f055e0a0e7b9 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:52.255664 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:52.300401 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a969dc-301a-43c7-9152-f055e0a0e7b9 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:52.307706 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80c524-9e73-47ce-ab59-267e75c068cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:52.308685 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80c524-9e73-47ce-ab59-267e75c068cb admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:52.308903 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80c524-9e73-47ce-ab59-267e75c068cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:52.309194 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80c524-9e73-47ce-ab59-267e75c068cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:52.310530 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80c524-9e73-47ce-ab59-267e75c068cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:52.314105 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80c524-9e73-47ce-ab59-267e75c068cb admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:52.362592 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 895/1778] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:58:52 2022] POST /identity/v3/projects => generated 373 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:58:52.364597 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80c524-9e73-47ce-ab59-267e75c068cb admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:52.375421 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a44b07-e886-49ef-a876-ffb1809b36d6 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:52.516654 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80c524-9e73-47ce-ab59-267e75c068cb admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:52.531098 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c7638-1927-4d0d-8a20-6a53154afbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:52.535178 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c7638-1927-4d0d-8a20-6a53154afbd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:52.535463 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c7638-1927-4d0d-8a20-6a53154afbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:52.535885 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c7638-1927-4d0d-8a20-6a53154afbd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:52.537284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c7638-1927-4d0d-8a20-6a53154afbd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:52.541931 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c7638-1927-4d0d-8a20-6a53154afbd2 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:52.582311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9aeb83-a96d-4f58-a3d3-b79690b3f16a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:52.583041 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9aeb83-a96d-4f58-a3d3-b79690b3f16a service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:52.583293 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9aeb83-a96d-4f58-a3d3-b79690b3f16a service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:52.590388 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9aeb83-a96d-4f58-a3d3-b79690b3f16a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:52.597978 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 896/1779] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:58:52 2022] POST /identity/v3/projects => generated 383 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:58:52.598956 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c7638-1927-4d0d-8a20-6a53154afbd2 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:52.776109 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9aeb83-a96d-4f58-a3d3-b79690b3f16a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:52.777580 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9aeb83-a96d-4f58-a3d3-b79690b3f16a service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:52.795040 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c7638-1927-4d0d-8a20-6a53154afbd2 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:52.817209 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f6c7a-6c4c-4dcf-90dc-f73f50448e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:52.817706 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 884/1780] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:58:52 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 724 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:58:52.818586 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9aeb83-a96d-4f58-a3d3-b79690b3f16a service cinder] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:52.819166 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f6c7a-6c4c-4dcf-90dc-f73f50448e7a admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:52.819454 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f6c7a-6c4c-4dcf-90dc-f73f50448e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:52.821404 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f6c7a-6c4c-4dcf-90dc-f73f50448e7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:52.822164 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f6c7a-6c4c-4dcf-90dc-f73f50448e7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:52.824470 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f6c7a-6c4c-4dcf-90dc-f73f50448e7a admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:52.839215 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9aeb83-a96d-4f58-a3d3-b79690b3f16a service cinder] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:52.843985 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 897/1781] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:58:52.844150 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e84cea-3879-4f4f-92d3-f58ddb25e39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:52.844810 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e84cea-3879-4f4f-92d3-f58ddb25e39a admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:52.845099 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e84cea-3879-4f4f-92d3-f58ddb25e39a admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:52.845384 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e84cea-3879-4f4f-92d3-f58ddb25e39a admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:52.846149 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e84cea-3879-4f4f-92d3-f58ddb25e39a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:52.846642 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f6c7a-6c4c-4dcf-90dc-f73f50448e7a admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:52.848495 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e84cea-3879-4f4f-92d3-f58ddb25e39a admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:52.866091 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f6c7a-6c4c-4dcf-90dc-f73f50448e7a admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:52.881348 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af125f-32ec-4a6c-86a5-b1f79819382e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:52.882267 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af125f-32ec-4a6c-86a5-b1f79819382e admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:52.882841 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 885/1782] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:58:52 2022] POST /identity/v3/users => generated 287 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:58:52.884958 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08beda88-b087-439a-a833-cfbf3d33d239 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:52.885423 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08beda88-b087-439a-a833-cfbf3d33d239 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:52.886278 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08beda88-b087-439a-a833-cfbf3d33d239 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:52.888223 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 886/1783] 10.222.0.15 () {54 vars in 921 bytes} [Fri Jun 3 11:58:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:58:52.889156 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08beda88-b087-439a-a833-cfbf3d33d239 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:52.889280 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af125f-32ec-4a6c-86a5-b1f79819382e admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:52.889544 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af125f-32ec-4a6c-86a5-b1f79819382e admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:52.891213 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af125f-32ec-4a6c-86a5-b1f79819382e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:52.895367 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af125f-32ec-4a6c-86a5-b1f79819382e admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:52.941250 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08beda88-b087-439a-a833-cfbf3d33d239 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:52.952050 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a614374-9a26-46c1-bc90-1fa97cda7e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:52.955353 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a614374-9a26-46c1-bc90-1fa97cda7e85 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:52.955687 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a614374-9a26-46c1-bc90-1fa97cda7e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:52.955991 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a614374-9a26-46c1-bc90-1fa97cda7e85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:52.956707 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a614374-9a26-46c1-bc90-1fa97cda7e85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:52.958348 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a614374-9a26-46c1-bc90-1fa97cda7e85 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:52.982630 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 887/1784] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:58:52.983803 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a614374-9a26-46c1-bc90-1fa97cda7e85 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:52.988449 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 898/1785] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:58:52 2022] POST /identity/v3/users => generated 298 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:58:52.990846 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af125f-32ec-4a6c-86a5-b1f79819382e admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:53.002850 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a614374-9a26-46c1-bc90-1fa97cda7e85 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:53.015201 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b6d8ad-40f8-441a-bb6e-593fb3f50920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:53.016031 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6d8ad-40f8-441a-bb6e-593fb3f50920 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:53.016476 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6d8ad-40f8-441a-bb6e-593fb3f50920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:53.016845 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6d8ad-40f8-441a-bb6e-593fb3f50920 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:53.018172 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b6d8ad-40f8-441a-bb6e-593fb3f50920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:53.020792 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b6d8ad-40f8-441a-bb6e-593fb3f50920 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:53.045285 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 888/1786] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:58:53.045285 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b6d8ad-40f8-441a-bb6e-593fb3f50920 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:53.068349 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b6d8ad-40f8-441a-bb6e-593fb3f50920 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:53.074189 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9393222-607f-439f-aab7-fd7dec4191aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:53.075359 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9393222-607f-439f-aab7-fd7dec4191aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:53.075700 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9393222-607f-439f-aab7-fd7dec4191aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:53.076048 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9393222-607f-439f-aab7-fd7dec4191aa admin admin] PATH_INFO: `/v3/projects/3149246548fb417ca1913caa30b1e221/users/041cd25528a540cb9d06de2e577cbfc8/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:53.097326 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9393222-607f-439f-aab7-fd7dec4191aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=3149246548fb417ca1913caa30b1e221, user_id=041cd25528a540cb9d06de2e577cbfc8, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:53.100411 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9393222-607f-439f-aab7-fd7dec4191aa admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:53.139914 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 889/1787] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:58:53 2022] PUT /identity/v3/projects/3149246548fb417ca1913caa30b1e221/users/041cd25528a540cb9d06de2e577cbfc8/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:53.139914 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9393222-607f-439f-aab7-fd7dec4191aa admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:53.144904 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:53.147284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:53.173649 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af125f-32ec-4a6c-86a5-b1f79819382e admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:53.308393 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b02acd-0a51-44bb-b731-840eae8def22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:53.308601 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9393222-607f-439f-aab7-fd7dec4191aa admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:53.308991 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b02acd-0a51-44bb-b731-840eae8def22 service cinder] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:53.309293 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b02acd-0a51-44bb-b731-840eae8def22 service cinder] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:53.309571 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b02acd-0a51-44bb-b731-840eae8def22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:53.317622 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-53b02acd-0a51-44bb-b731-840eae8def22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:53.325670 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361185b8-ed66-4937-b176-d50d24175eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:53.326398 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361185b8-ed66-4937-b176-d50d24175eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:53.326690 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361185b8-ed66-4937-b176-d50d24175eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:53.326976 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361185b8-ed66-4937-b176-d50d24175eb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:53.327754 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361185b8-ed66-4937-b176-d50d24175eb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:53.338219 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361185b8-ed66-4937-b176-d50d24175eb5 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:53.381754 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 890/1788] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:58:53.382704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361185b8-ed66-4937-b176-d50d24175eb5 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:53.400482 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361185b8-ed66-4937-b176-d50d24175eb5 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:53.415001 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94a5dd-2912-48a3-93d4-5f365508489f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:53.416314 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94a5dd-2912-48a3-93d4-5f365508489f admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:53.416456 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94a5dd-2912-48a3-93d4-5f365508489f admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:53.416988 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94a5dd-2912-48a3-93d4-5f365508489f admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:53.417457 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd94a5dd-2912-48a3-93d4-5f365508489f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:53.419103 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd94a5dd-2912-48a3-93d4-5f365508489f admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:53.444258 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 891/1789] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:58:53.445788 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76c887-d629-41a7-a976-5e4b8799d995 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:53.446052 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76c887-d629-41a7-a976-5e4b8799d995 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:53.446336 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76c887-d629-41a7-a976-5e4b8799d995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:53.454203 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b02acd-0a51-44bb-b731-840eae8def22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:53.456825 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b02acd-0a51-44bb-b731-840eae8def22 service cinder] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:53.476681 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 899/1790] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:58:52 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:58:53.494432 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841b391-f991-4119-a7d7-93619c8e101e None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:53.494432 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841b391-f991-4119-a7d7-93619c8e101e None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:53.499753 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841b391-f991-4119-a7d7-93619c8e101e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:53.528367 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-fc76c887-d629-41a7-a976-5e4b8799d995 None None] MFA Rules not processed for user `6247bfb7aebd45eeb97ba5933be44c6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:53.529617 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-fc76c887-d629-41a7-a976-5e4b8799d995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:53.643127 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-2841b391-f991-4119-a7d7-93619c8e101e None None] MFA Rules not processed for user `041cd25528a540cb9d06de2e577cbfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:53.644455 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-2841b391-f991-4119-a7d7-93619c8e101e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:53.747399 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 892/1791] 10.222.0.15 () {58 vars in 1018 bytes} [Fri Jun 3 11:58:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:53.748339 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc76c887-d629-41a7-a976-5e4b8799d995 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:53.784864 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc76c887-d629-41a7-a976-5e4b8799d995 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:53.793593 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e60944-3e50-43e7-9f47-a1299301730e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:53.795486 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e60944-3e50-43e7-9f47-a1299301730e admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:53.796129 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e60944-3e50-43e7-9f47-a1299301730e admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:53.796777 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e60944-3e50-43e7-9f47-a1299301730e admin admin] PATH_INFO: `/v3/projects/adfa79c362244703aa90f4652c11d348/users/64f6fc4542f648429bb1df84187da7c6/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:53.856053 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 900/1792] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:53 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:53.856053 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841b391-f991-4119-a7d7-93619c8e101e None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:53.866139 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e60944-3e50-43e7-9f47-a1299301730e admin admin] RBAC: Authorizing `identity:create_grant(project_id=adfa79c362244703aa90f4652c11d348, user_id=64f6fc4542f648429bb1df84187da7c6, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:53.875252 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e60944-3e50-43e7-9f47-a1299301730e admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:53.888204 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841b391-f991-4119-a7d7-93619c8e101e None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:53.925446 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 893/1793] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:58:53 2022] PUT /identity/v3/projects/adfa79c362244703aa90f4652c11d348/users/64f6fc4542f648429bb1df84187da7c6/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:53.929226 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e60944-3e50-43e7-9f47-a1299301730e admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:53.934264 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1092e5-d0f9-4097-aa35-e6128c7266c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:53.935196 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1092e5-d0f9-4097-aa35-e6128c7266c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:53.935631 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1092e5-d0f9-4097-aa35-e6128c7266c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:53.935920 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1092e5-d0f9-4097-aa35-e6128c7266c2 admin admin] PATH_INFO: `/v3/projects/80a8b8c000fa49e2be57b1a0e5e7cc45/users/0da34c8683a64189a0fc2958957de2b7/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:53.970671 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1092e5-d0f9-4097-aa35-e6128c7266c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80a8b8c000fa49e2be57b1a0e5e7cc45, user_id=0da34c8683a64189a0fc2958957de2b7, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:53.973491 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1092e5-d0f9-4097-aa35-e6128c7266c2 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:54.022358 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 901/1794] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:58:53 2022] PUT /identity/v3/projects/80a8b8c000fa49e2be57b1a0e5e7cc45/users/0da34c8683a64189a0fc2958957de2b7/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:54.028842 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1092e5-d0f9-4097-aa35-e6128c7266c2 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:54.110303 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:54.115244 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:54.135394 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e60944-3e50-43e7-9f47-a1299301730e admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:54.263838 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1092e5-d0f9-4097-aa35-e6128c7266c2 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:54.293781 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b0613b-eda8-4450-8a97-dc1e68ec783b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:54.295005 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0613b-eda8-4450-8a97-dc1e68ec783b admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:54.295316 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0613b-eda8-4450-8a97-dc1e68ec783b admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:54.295790 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0613b-eda8-4450-8a97-dc1e68ec783b admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:54.297895 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b0613b-eda8-4450-8a97-dc1e68ec783b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:54.299906 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b0613b-eda8-4450-8a97-dc1e68ec783b admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:54.321174 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 902/1795] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:58:54.322897 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487766b-bc85-40a7-a089-52388487d42e None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:54.323191 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487766b-bc85-40a7-a089-52388487d42e None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:54.323652 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487766b-bc85-40a7-a089-52388487d42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:54.407408 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffed38f-1a62-450b-aec5-158e07abe69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:54.408859 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffed38f-1a62-450b-aec5-158e07abe69e admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:54.410245 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffed38f-1a62-450b-aec5-158e07abe69e admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:54.410688 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffed38f-1a62-450b-aec5-158e07abe69e admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:54.411592 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffed38f-1a62-450b-aec5-158e07abe69e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:54.413726 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffed38f-1a62-450b-aec5-158e07abe69e admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:54.430348 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-8487766b-bc85-40a7-a089-52388487d42e None None] MFA Rules not processed for user `0da34c8683a64189a0fc2958957de2b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:54.436256 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-8487766b-bc85-40a7-a089-52388487d42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:54.505241 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 894/1796] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:58:53 2022] POST /identity/v3/projects => generated 367 bytes in 577 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:58:54.505241 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffed38f-1a62-450b-aec5-158e07abe69e admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:54.696279 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffed38f-1a62-450b-aec5-158e07abe69e admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:54.699336 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 903/1797] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:54.701552 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487766b-bc85-40a7-a089-52388487d42e None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:54.710952 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807eb3b-27e8-473a-9a45-bc9605053f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:54.712784 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807eb3b-27e8-473a-9a45-bc9605053f5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:54.713214 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807eb3b-27e8-473a-9a45-bc9605053f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:54.713653 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807eb3b-27e8-473a-9a45-bc9605053f5f admin admin] PATH_INFO: `/v3/projects/adfa79c362244703aa90f4652c11d348/users/64f6fc4542f648429bb1df84187da7c6/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:54.717783 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7807eb3b-27e8-473a-9a45-bc9605053f5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=adfa79c362244703aa90f4652c11d348, user_id=64f6fc4542f648429bb1df84187da7c6, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:54.721309 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7807eb3b-27e8-473a-9a45-bc9605053f5f admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:54.743860 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487766b-bc85-40a7-a089-52388487d42e None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:54.755912 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 895/1798] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:58:54 2022] PUT /identity/v3/projects/adfa79c362244703aa90f4652c11d348/users/64f6fc4542f648429bb1df84187da7c6/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:54.757526 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807eb3b-27e8-473a-9a45-bc9605053f5f admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:54.917748 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084a0eb-8111-4c3d-82d0-bdf6688c07f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:54.918695 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084a0eb-8111-4c3d-82d0-bdf6688c07f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:54.919715 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084a0eb-8111-4c3d-82d0-bdf6688c07f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:54.920148 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084a0eb-8111-4c3d-82d0-bdf6688c07f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:54.920982 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084a0eb-8111-4c3d-82d0-bdf6688c07f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:54.923536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084a0eb-8111-4c3d-82d0-bdf6688c07f9 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:54.942988 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807eb3b-27e8-473a-9a45-bc9605053f5f admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:54.956425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de79e3-0fe4-482c-a04d-e700b4c70200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:54.957173 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de79e3-0fe4-482c-a04d-e700b4c70200 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:54.957457 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de79e3-0fe4-482c-a04d-e700b4c70200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:54.957731 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de79e3-0fe4-482c-a04d-e700b4c70200 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:54.958430 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de79e3-0fe4-482c-a04d-e700b4c70200 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:54.962345 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 904/1799] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:58:54 2022] POST /identity/v3/users => generated 290 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:58:54.965136 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc1892-32ed-4512-bc03-4a052d4b72bb None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:54.965938 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc1892-32ed-4512-bc03-4a052d4b72bb None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:54.966538 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc1892-32ed-4512-bc03-4a052d4b72bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:54.970325 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de79e3-0fe4-482c-a04d-e700b4c70200 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:55.012232 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-aefc1892-32ed-4512-bc03-4a052d4b72bb None None] MFA Rules not processed for user `64f6fc4542f648429bb1df84187da7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:55.014629 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-aefc1892-32ed-4512-bc03-4a052d4b72bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:55.033207 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 896/1800] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:58:54 2022] POST /identity/v3/projects => generated 373 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:58:55.034175 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de79e3-0fe4-482c-a04d-e700b4c70200 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:55.060032 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:55.064726 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:55.145568 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de79e3-0fe4-482c-a04d-e700b4c70200 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:55.152067 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445962e7-72ab-44b2-9576-d3b17c82b919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:55.153053 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445962e7-72ab-44b2-9576-d3b17c82b919 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:55.153343 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445962e7-72ab-44b2-9576-d3b17c82b919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:55.153628 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445962e7-72ab-44b2-9576-d3b17c82b919 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:55.154373 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445962e7-72ab-44b2-9576-d3b17c82b919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:55.156373 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445962e7-72ab-44b2-9576-d3b17c82b919 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:55.171052 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 897/1801] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:58:55 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:58:55.172618 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445962e7-72ab-44b2-9576-d3b17c82b919 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:55.176618 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 905/1802] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:54 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:55.177710 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc1892-32ed-4512-bc03-4a052d4b72bb None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:55.192717 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445962e7-72ab-44b2-9576-d3b17c82b919 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:55.198636 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dabfbc-1bcf-4a37-8f5f-175e3693b777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:55.199320 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dabfbc-1bcf-4a37-8f5f-175e3693b777 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:55.199640 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dabfbc-1bcf-4a37-8f5f-175e3693b777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:55.199925 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dabfbc-1bcf-4a37-8f5f-175e3693b777 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:55.200622 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dabfbc-1bcf-4a37-8f5f-175e3693b777 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:55.202836 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dabfbc-1bcf-4a37-8f5f-175e3693b777 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:55.246064 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 898/1803] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:58:55 2022] POST /identity/v3/users => generated 293 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:58:55.247034 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dabfbc-1bcf-4a37-8f5f-175e3693b777 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:55.259763 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dabfbc-1bcf-4a37-8f5f-175e3693b777 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:55.271479 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d56391-a972-4340-b797-573e4143d4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:55.272782 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d56391-a972-4340-b797-573e4143d4f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:55.272939 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d56391-a972-4340-b797-573e4143d4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:55.273232 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d56391-a972-4340-b797-573e4143d4f0 admin admin] PATH_INFO: `/v3/projects/b7fef8fb7bf84e2b8d0e01c2e9f9d05b/users/c42efe0253de430e847ffc23b3185f49/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:55.290017 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d56391-a972-4340-b797-573e4143d4f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7fef8fb7bf84e2b8d0e01c2e9f9d05b, user_id=c42efe0253de430e847ffc23b3185f49, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:55.293300 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d56391-a972-4340-b797-573e4143d4f0 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:55.295131 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc1892-32ed-4512-bc03-4a052d4b72bb None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:55.312613 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 899/1804] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:58:55 2022] PUT /identity/v3/projects/b7fef8fb7bf84e2b8d0e01c2e9f9d05b/users/c42efe0253de430e847ffc23b3185f49/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:55.313466 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d56391-a972-4340-b797-573e4143d4f0 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:55.404209 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d56391-a972-4340-b797-573e4143d4f0 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:55.406552 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31598f0-c8d9-42d0-b92f-dcca582348c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:55.407453 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31598f0-c8d9-42d0-b92f-dcca582348c9 service nova] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:55.407771 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31598f0-c8d9-42d0-b92f-dcca582348c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:55.408051 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31598f0-c8d9-42d0-b92f-dcca582348c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:55.408909 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10160c5b-574d-4e82-9ef8-9b4cf6c52182 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:55.409563 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10160c5b-574d-4e82-9ef8-9b4cf6c52182 service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:55.409847 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10160c5b-574d-4e82-9ef8-9b4cf6c52182 service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:55.410309 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10160c5b-574d-4e82-9ef8-9b4cf6c52182 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:55.425224 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31598f0-c8d9-42d0-b92f-dcca582348c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:55.428706 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31598f0-c8d9-42d0-b92f-dcca582348c9 service nova] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:55.450214 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 906/1805] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:58:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:58:55.451246 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31598f0-c8d9-42d0-b92f-dcca582348c9 service nova] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:55.463844 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31598f0-c8d9-42d0-b92f-dcca582348c9 service nova] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:55.514277 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10160c5b-574d-4e82-9ef8-9b4cf6c52182 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:55.516260 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10160c5b-574d-4e82-9ef8-9b4cf6c52182 service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:55.538818 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 900/1806] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:58:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:58:55.541055 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10160c5b-574d-4e82-9ef8-9b4cf6c52182 service cinder] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:55.551775 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:55.583095 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:55.608113 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e4ef8-899d-4149-9498-6653c4f42b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:55.609447 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e4ef8-899d-4149-9498-6653c4f42b08 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:55.610080 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e4ef8-899d-4149-9498-6653c4f42b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:55.610385 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e4ef8-899d-4149-9498-6653c4f42b08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:55.612001 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e4ef8-899d-4149-9498-6653c4f42b08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:55.613978 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e4ef8-899d-4149-9498-6653c4f42b08 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:55.630283 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 907/1807] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:58:55 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:58:55.634561 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e4ef8-899d-4149-9498-6653c4f42b08 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:55.653518 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e4ef8-899d-4149-9498-6653c4f42b08 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:55.658798 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6df07b-1b23-4809-881e-bc78be7a712f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:55.660973 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6df07b-1b23-4809-881e-bc78be7a712f admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:55.661648 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6df07b-1b23-4809-881e-bc78be7a712f admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:55.662133 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6df07b-1b23-4809-881e-bc78be7a712f admin admin] PATH_INFO: `/v3/projects/a394617910734c32a751c17495e11137/users/872bb87752df4c22996d123ce0febf9d/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:55.685324 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10160c5b-574d-4e82-9ef8-9b4cf6c52182 service cinder] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:55.692989 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6df07b-1b23-4809-881e-bc78be7a712f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a394617910734c32a751c17495e11137, user_id=872bb87752df4c22996d123ce0febf9d, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:55.698998 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79e72a-a70c-4d37-b1b5-073e3673f007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:55.702016 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79e72a-a70c-4d37-b1b5-073e3673f007 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:55.702403 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6df07b-1b23-4809-881e-bc78be7a712f admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:55.704084 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79e72a-a70c-4d37-b1b5-073e3673f007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:55.704420 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79e72a-a70c-4d37-b1b5-073e3673f007 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:55.705345 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe79e72a-a70c-4d37-b1b5-073e3673f007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:55.710968 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe79e72a-a70c-4d37-b1b5-073e3673f007 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:55.741996 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 908/1808] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:58:55 2022] PUT /identity/v3/projects/a394617910734c32a751c17495e11137/users/872bb87752df4c22996d123ce0febf9d/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:55.743647 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6df07b-1b23-4809-881e-bc78be7a712f admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:55.744703 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 901/1809] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:58:55 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:58:55.754981 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79e72a-a70c-4d37-b1b5-073e3673f007 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:55.777784 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79e72a-a70c-4d37-b1b5-073e3673f007 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:55.914124 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6df07b-1b23-4809-881e-bc78be7a712f admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:55.925419 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7da1d8-69af-406d-98a7-a267ef776f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:55.928402 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0e8dc-7571-467b-b412-6301c19cd23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:55.928914 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7da1d8-69af-406d-98a7-a267ef776f03 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:55.928914 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7da1d8-69af-406d-98a7-a267ef776f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:55.928914 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7da1d8-69af-406d-98a7-a267ef776f03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:55.929973 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7da1d8-69af-406d-98a7-a267ef776f03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:55.930378 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0e8dc-7571-467b-b412-6301c19cd23f admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:55.930584 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0e8dc-7571-467b-b412-6301c19cd23f admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:55.931804 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0e8dc-7571-467b-b412-6301c19cd23f admin admin] PATH_INFO: `/v3/projects/b7fef8fb7bf84e2b8d0e01c2e9f9d05b/users/c42efe0253de430e847ffc23b3185f49/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:55.933867 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7da1d8-69af-406d-98a7-a267ef776f03 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:55.936924 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd0e8dc-7571-467b-b412-6301c19cd23f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7fef8fb7bf84e2b8d0e01c2e9f9d05b, user_id=c42efe0253de430e847ffc23b3185f49, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:55.945560 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd0e8dc-7571-467b-b412-6301c19cd23f admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:55.968654 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 902/1810] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:58:55 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:58:55.973322 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7da1d8-69af-406d-98a7-a267ef776f03 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:55.994005 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 909/1811] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:58:55 2022] PUT /identity/v3/projects/b7fef8fb7bf84e2b8d0e01c2e9f9d05b/users/c42efe0253de430e847ffc23b3185f49/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:55.996299 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dae2f6-4cbd-450b-ac6f-3b593ab68251 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:55.999464 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dae2f6-4cbd-450b-ac6f-3b593ab68251 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:56.000053 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dae2f6-4cbd-450b-ac6f-3b593ab68251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:56.008821 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7da1d8-69af-406d-98a7-a267ef776f03 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:56.063626 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-66dae2f6-4cbd-450b-ac6f-3b593ab68251 None None] MFA Rules not processed for user `c42efe0253de430e847ffc23b3185f49`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:56.065121 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-66dae2f6-4cbd-450b-ac6f-3b593ab68251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:56.129834 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23235e-0a9e-43d0-809c-afb4c66b21d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:56.130753 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23235e-0a9e-43d0-809c-afb4c66b21d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:56.131039 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23235e-0a9e-43d0-809c-afb4c66b21d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:56.131320 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23235e-0a9e-43d0-809c-afb4c66b21d3 admin admin] PATH_INFO: `/v3/projects/a394617910734c32a751c17495e11137/users/872bb87752df4c22996d123ce0febf9d/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:56.136987 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a23235e-0a9e-43d0-809c-afb4c66b21d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a394617910734c32a751c17495e11137, user_id=872bb87752df4c22996d123ce0febf9d, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:56.149349 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a23235e-0a9e-43d0-809c-afb4c66b21d3 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:56.223164 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 903/1812] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:58:55 2022] PUT /identity/v3/projects/a394617910734c32a751c17495e11137/users/872bb87752df4c22996d123ce0febf9d/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 11:58:56.228066 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7e81d-62f9-4241-9603-621debbb2731 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:56.228532 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7e81d-62f9-4241-9603-621debbb2731 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:56.228839 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7e81d-62f9-4241-9603-621debbb2731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:56.295689 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 910/1813] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:55 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:56.301878 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-19f7e81d-62f9-4241-9603-621debbb2731 None None] MFA Rules not processed for user `872bb87752df4c22996d123ce0febf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:56.305930 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-19f7e81d-62f9-4241-9603-621debbb2731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:56.351882 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dae2f6-4cbd-450b-ac6f-3b593ab68251 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:56.432189 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:56.441797 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:56.483086 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dae2f6-4cbd-450b-ac6f-3b593ab68251 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:56.501062 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 904/1814] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:56 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 11:58:56.511807 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7e81d-62f9-4241-9603-621debbb2731 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:56.513883 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-19f7e81d-62f9-4241-9603-621debbb2731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:56.587747 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25fd50-7f71-4c5a-bd98-ecea8a9c4edf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:56.588487 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25fd50-7f71-4c5a-bd98-ecea8a9c4edf service cinder] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:56.589082 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25fd50-7f71-4c5a-bd98-ecea8a9c4edf service cinder] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:56.589550 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25fd50-7f71-4c5a-bd98-ecea8a9c4edf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:56.602640 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7e81d-62f9-4241-9603-621debbb2731 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:56.610914 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80183a9f-ee9e-448d-ba92-44ae3c5e8ddf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:56.611698 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80183a9f-ee9e-448d-ba92-44ae3c5e8ddf service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:56.612061 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80183a9f-ee9e-448d-ba92-44ae3c5e8ddf service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:56.612409 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80183a9f-ee9e-448d-ba92-44ae3c5e8ddf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:56.630384 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80183a9f-ee9e-448d-ba92-44ae3c5e8ddf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:56.631966 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80183a9f-ee9e-448d-ba92-44ae3c5e8ddf service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:56.643382 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 905/1815] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:58:56 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:58:56.663405 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d25fd50-7f71-4c5a-bd98-ecea8a9c4edf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:56.665002 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d25fd50-7f71-4c5a-bd98-ecea8a9c4edf service cinder] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:56.679367 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 911/1816] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:58:56 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:58:56.781163 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80183a9f-ee9e-448d-ba92-44ae3c5e8ddf service cinder] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:56.790046 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80183a9f-ee9e-448d-ba92-44ae3c5e8ddf service cinder] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:56.794243 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed4fdbe-3180-4005-bcfb-5f2f70692ce3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:56.794885 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4fdbe-3180-4005-bcfb-5f2f70692ce3 service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:56.795242 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4fdbe-3180-4005-bcfb-5f2f70692ce3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:56.795534 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4fdbe-3180-4005-bcfb-5f2f70692ce3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:56.865013 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed4fdbe-3180-4005-bcfb-5f2f70692ce3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:56.866455 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed4fdbe-3180-4005-bcfb-5f2f70692ce3 service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:56.876163 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 906/1817] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:58:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 11:58:56.956613 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25fd50-7f71-4c5a-bd98-ecea8a9c4edf service cinder] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:56.958755 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-8d25fd50-7f71-4c5a-bd98-ecea8a9c4edf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:57.063824 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25fd50-7f71-4c5a-bd98-ecea8a9c4edf service cinder] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:57.068838 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f1eca-2645-4c46-adcb-d126fbc1812f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:57.069896 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f1eca-2645-4c46-adcb-d126fbc1812f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:57.070205 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f1eca-2645-4c46-adcb-d126fbc1812f admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:57.070547 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f1eca-2645-4c46-adcb-d126fbc1812f admin admin] PATH_INFO: `/v3/users/fd203c30da624663942daa16da7f52d7` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:57.073400 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61f1eca-2645-4c46-adcb-d126fbc1812f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd203c30da624663942daa16da7f52d7)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:57.075424 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61f1eca-2645-4c46-adcb-d126fbc1812f admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:57.143759 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:57.149135 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-b61f1eca-2645-4c46-adcb-d126fbc1812f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd203c30da624663942daa16da7f52d7'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:57.149836 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-b61f1eca-2645-4c46-adcb-d126fbc1812f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd203c30da624663942daa16da7f52d7'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:57.164716 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-b61f1eca-2645-4c46-adcb-d126fbc1812f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd203c30da624663942daa16da7f52d7'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:57.172656 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-b61f1eca-2645-4c46-adcb-d126fbc1812f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd203c30da624663942daa16da7f52d7'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:57.191407 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-b61f1eca-2645-4c46-adcb-d126fbc1812f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd203c30da624663942daa16da7f52d7'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:57.207445 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 912/1818] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 11:58:56 2022] DELETE /identity/v3/users/fd203c30da624663942daa16da7f52d7 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:57.209610 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816ab8e-0a99-41e7-b736-fe7c76bd6eba None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:57.210266 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816ab8e-0a99-41e7-b736-fe7c76bd6eba None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:57.210661 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816ab8e-0a99-41e7-b736-fe7c76bd6eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:57.238065 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-0816ab8e-0a99-41e7-b736-fe7c76bd6eba None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:57.239488 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-0816ab8e-0a99-41e7-b736-fe7c76bd6eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:57.353860 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 907/1819] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:57.378501 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f1eca-2645-4c46-adcb-d126fbc1812f admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:57.380050 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-b61f1eca-2645-4c46-adcb-d126fbc1812f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:57.532237 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f1eca-2645-4c46-adcb-d126fbc1812f admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:57.548962 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59cbcbb-9ea2-4b15-be27-e0dae326b73f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:57.550233 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59cbcbb-9ea2-4b15-be27-e0dae326b73f service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:57.550808 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59cbcbb-9ea2-4b15-be27-e0dae326b73f service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:57.551090 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59cbcbb-9ea2-4b15-be27-e0dae326b73f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:57.567056 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59cbcbb-9ea2-4b15-be27-e0dae326b73f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:57.568686 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59cbcbb-9ea2-4b15-be27-e0dae326b73f service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:57.594362 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 913/1820] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:58:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:58:58.536858 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0816ab8e-0a99-41e7-b736-fe7c76bd6eba None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:58.538829 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-0816ab8e-0a99-41e7-b736-fe7c76bd6eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:58.568843 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0816ab8e-0a99-41e7-b736-fe7c76bd6eba None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:58.580580 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e68259-e226-4c4d-b900-60e1a413b1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:58.583785 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e68259-e226-4c4d-b900-60e1a413b1d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:58.584344 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e68259-e226-4c4d-b900-60e1a413b1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:58.586772 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e68259-e226-4c4d-b900-60e1a413b1d4 admin admin] PATH_INFO: `/v3/projects/8b87f5539aa64ca4bfdaa22476c23704` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:58.594705 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e68259-e226-4c4d-b900-60e1a413b1d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b87f5539aa64ca4bfdaa22476c23704)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:58.602961 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e68259-e226-4c4d-b900-60e1a413b1d4 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:58.620879 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:58.721576 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-a8e68259-e226-4c4d-b900-60e1a413b1d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b87f5539aa64ca4bfdaa22476c23704', 'request_id': 'req-a8e68259-e226-4c4d-b900-60e1a413b1d4'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:58.736960 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-a8e68259-e226-4c4d-b900-60e1a413b1d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b87f5539aa64ca4bfdaa22476c23704', 'request_id': 'req-a8e68259-e226-4c4d-b900-60e1a413b1d4'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:58.798118 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-a8e68259-e226-4c4d-b900-60e1a413b1d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b87f5539aa64ca4bfdaa22476c23704', 'request_id': 'req-a8e68259-e226-4c4d-b900-60e1a413b1d4'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:58.831757 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-a8e68259-e226-4c4d-b900-60e1a413b1d4 admin admin] The token cache is being invalidate because project 8b87f5539aa64ca4bfdaa22476c23704 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 11:58:58.831757 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-a8e68259-e226-4c4d-b900-60e1a413b1d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:58.832401 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-a8e68259-e226-4c4d-b900-60e1a413b1d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:58.838703 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 908/1821] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 11:58:58 2022] DELETE /identity/v3/projects/8b87f5539aa64ca4bfdaa22476c23704 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:58.842665 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59cbcbb-9ea2-4b15-be27-e0dae326b73f service neutron] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:58.855574 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59cbcbb-9ea2-4b15-be27-e0dae326b73f service neutron] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:58.999072 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03c6b0-d740-42f7-bfcc-0c2f6625bdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:59.000449 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03c6b0-d740-42f7-bfcc-0c2f6625bdfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:59.000992 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03c6b0-d740-42f7-bfcc-0c2f6625bdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:59.001412 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03c6b0-d740-42f7-bfcc-0c2f6625bdfd admin admin] PATH_INFO: `/v3/users/d360b227a26b4e399d08b39f6c91b3c3` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:59.009834 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a03c6b0-d740-42f7-bfcc-0c2f6625bdfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d360b227a26b4e399d08b39f6c91b3c3)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:59.012977 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a03c6b0-d740-42f7-bfcc-0c2f6625bdfd admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:59.071764 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-5a03c6b0-d740-42f7-bfcc-0c2f6625bdfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd360b227a26b4e399d08b39f6c91b3c3'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:59.072442 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-5a03c6b0-d740-42f7-bfcc-0c2f6625bdfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd360b227a26b4e399d08b39f6c91b3c3'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:59.116946 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-5a03c6b0-d740-42f7-bfcc-0c2f6625bdfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd360b227a26b4e399d08b39f6c91b3c3'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:59.118514 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:59.141204 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-5a03c6b0-d740-42f7-bfcc-0c2f6625bdfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd360b227a26b4e399d08b39f6c91b3c3'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:59.155078 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-5a03c6b0-d740-42f7-bfcc-0c2f6625bdfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd360b227a26b4e399d08b39f6c91b3c3'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:59.170964 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 914/1822] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 11:58:58 2022] DELETE /identity/v3/users/d360b227a26b4e399d08b39f6c91b3c3 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:58:59.635762 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e68259-e226-4c4d-b900-60e1a413b1d4 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:59.637570 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-a8e68259-e226-4c4d-b900-60e1a413b1d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:59.651728 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e68259-e226-4c4d-b900-60e1a413b1d4 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:59.660812 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03c6b0-d740-42f7-bfcc-0c2f6625bdfd admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:59.662246 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-5a03c6b0-d740-42f7-bfcc-0c2f6625bdfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:59.715823 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80e48d-d837-4151-9ff9-bf4f9f852448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:59.716702 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80e48d-d837-4151-9ff9-bf4f9f852448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:59.716983 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80e48d-d837-4151-9ff9-bf4f9f852448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:59.717292 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80e48d-d837-4151-9ff9-bf4f9f852448 admin admin] PATH_INFO: `/v3/users/041cd25528a540cb9d06de2e577cbfc8` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:59.718493 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80e48d-d837-4151-9ff9-bf4f9f852448 admin admin] RBAC: Authorizing `identity:delete_user(user_id=041cd25528a540cb9d06de2e577cbfc8)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:59.720445 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80e48d-d837-4151-9ff9-bf4f9f852448 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:59.734297 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03c6b0-d740-42f7-bfcc-0c2f6625bdfd admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:58:59.738912 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e73a6d-f73b-42a7-bdb5-bdcdc514670c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:58:59.739811 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e73a6d-f73b-42a7-bdb5-bdcdc514670c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:59.740100 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e73a6d-f73b-42a7-bdb5-bdcdc514670c admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:59.740377 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e73a6d-f73b-42a7-bdb5-bdcdc514670c admin admin] PATH_INFO: `/v3/projects/2722e33ceacf4fb38cf4389c2dffef5f` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:59.741613 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e73a6d-f73b-42a7-bdb5-bdcdc514670c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2722e33ceacf4fb38cf4389c2dffef5f)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:58:59.744167 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e73a6d-f73b-42a7-bdb5-bdcdc514670c admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:58:59.777792 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-ac80e48d-d837-4151-9ff9-bf4f9f852448 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '041cd25528a540cb9d06de2e577cbfc8'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:59.785084 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-ac80e48d-d837-4151-9ff9-bf4f9f852448 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '041cd25528a540cb9d06de2e577cbfc8'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:59.785822 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-ac80e48d-d837-4151-9ff9-bf4f9f852448 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '041cd25528a540cb9d06de2e577cbfc8'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:59.799982 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-ac80e48d-d837-4151-9ff9-bf4f9f852448 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '041cd25528a540cb9d06de2e577cbfc8'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:59.802500 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-03e73a6d-f73b-42a7-bdb5-bdcdc514670c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2722e33ceacf4fb38cf4389c2dffef5f', 'request_id': 'req-03e73a6d-f73b-42a7-bdb5-bdcdc514670c'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:59.812087 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-ac80e48d-d837-4151-9ff9-bf4f9f852448 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '041cd25528a540cb9d06de2e577cbfc8'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:59.814801 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-03e73a6d-f73b-42a7-bdb5-bdcdc514670c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2722e33ceacf4fb38cf4389c2dffef5f', 'request_id': 'req-03e73a6d-f73b-42a7-bdb5-bdcdc514670c'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:59.824198 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 909/1823] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 11:58:59 2022] DELETE /identity/v3/users/041cd25528a540cb9d06de2e577cbfc8 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 11:58:59.824426 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-03e73a6d-f73b-42a7-bdb5-bdcdc514670c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2722e33ceacf4fb38cf4389c2dffef5f', 'request_id': 'req-03e73a6d-f73b-42a7-bdb5-bdcdc514670c'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:59.828336 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02e66f-f9d8-4d33-8120-e4b4e28cc01d None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:59.828812 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02e66f-f9d8-4d33-8120-e4b4e28cc01d None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:59.829258 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02e66f-f9d8-4d33-8120-e4b4e28cc01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:59.837004 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-03e73a6d-f73b-42a7-bdb5-bdcdc514670c admin admin] The token cache is being invalidate because project 2722e33ceacf4fb38cf4389c2dffef5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 11:58:59.838299 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-03e73a6d-f73b-42a7-bdb5-bdcdc514670c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:59.838986 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-03e73a6d-f73b-42a7-bdb5-bdcdc514670c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:58:59.840767 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 915/1824] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 11:58:59 2022] DELETE /identity/v3/projects/2722e33ceacf4fb38cf4389c2dffef5f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 11:58:59.845571 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ff06e-fbd3-4ffb-a0aa-fc88a520cf61 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:59.846155 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ff06e-fbd3-4ffb-a0aa-fc88a520cf61 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:59.846155 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ff06e-fbd3-4ffb-a0aa-fc88a520cf61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:59.850719 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-1f02e66f-f9d8-4d33-8120-e4b4e28cc01d None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:59.852208 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-1f02e66f-f9d8-4d33-8120-e4b4e28cc01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:59.857900 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:58:59.866181 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-009ff06e-fbd3-4ffb-a0aa-fc88a520cf61 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:59.868046 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-009ff06e-fbd3-4ffb-a0aa-fc88a520cf61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:59.927282 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 910/1825] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 11:58:59.937753 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02e66f-f9d8-4d33-8120-e4b4e28cc01d None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:59.939332 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-1f02e66f-f9d8-4d33-8120-e4b4e28cc01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:59.940034 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 916/1826] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 11:58:59.947518 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96bf5d-ebd7-459e-9926-4ccaec976801 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:58:59.948076 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96bf5d-ebd7-459e-9926-4ccaec976801 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:58:59.948433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96bf5d-ebd7-459e-9926-4ccaec976801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:58:59.969004 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-ff96bf5d-ebd7-459e-9926-4ccaec976801 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:58:59.970232 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-ff96bf5d-ebd7-459e-9926-4ccaec976801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:58:59.979759 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 917/1827] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:58:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:58:59.986378 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96bf5d-ebd7-459e-9926-4ccaec976801 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:58:59.998712 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96bf5d-ebd7-459e-9926-4ccaec976801 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:00.004316 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b95722-5abb-4ff5-b198-227b6fe8503f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:00.005120 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b95722-5abb-4ff5-b198-227b6fe8503f admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:00.005474 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b95722-5abb-4ff5-b198-227b6fe8503f admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:00.006008 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b95722-5abb-4ff5-b198-227b6fe8503f admin admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:00.006760 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b95722-5abb-4ff5-b198-227b6fe8503f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:59:00.007104 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b95722-5abb-4ff5-b198-227b6fe8503f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:00.008791 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b95722-5abb-4ff5-b198-227b6fe8503f admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:00.011147 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:00.015528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02e66f-f9d8-4d33-8120-e4b4e28cc01d None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:00.019789 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64719b4d-901b-4c04-bf32-53b4a0ce4505 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:00.020724 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64719b4d-901b-4c04-bf32-53b4a0ce4505 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:00.021389 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64719b4d-901b-4c04-bf32-53b4a0ce4505 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:00.021897 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64719b4d-901b-4c04-bf32-53b4a0ce4505 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:00.027899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 918/1828] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 11:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:59:00.032316 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b95722-5abb-4ff5-b198-227b6fe8503f admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:00.032511 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64719b4d-901b-4c04-bf32-53b4a0ce4505 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:00.034191 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64719b4d-901b-4c04-bf32-53b4a0ce4505 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:00.043572 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b95722-5abb-4ff5-b198-227b6fe8503f admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:00.049081 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b0407-f4c2-4786-b6d7-1162c9cc8e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:00.049701 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b0407-f4c2-4786-b6d7-1162c9cc8e34 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:00.049986 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b0407-f4c2-4786-b6d7-1162c9cc8e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:00.050263 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b0407-f4c2-4786-b6d7-1162c9cc8e34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:00.050958 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956b0407-f4c2-4786-b6d7-1162c9cc8e34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:00.053102 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956b0407-f4c2-4786-b6d7-1162c9cc8e34 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:00.055540 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 911/1829] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:58:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:59:00.081943 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 919/1830] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:59:00 2022] POST /identity/v3/projects => generated 363 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:59:00.086339 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64719b4d-901b-4c04-bf32-53b4a0ce4505 service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:00.097347 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64719b4d-901b-4c04-bf32-53b4a0ce4505 service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:00.173314 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f02fc2-244f-449c-af9c-b40e06064787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:00.173992 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f02fc2-244f-449c-af9c-b40e06064787 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:00.174281 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f02fc2-244f-449c-af9c-b40e06064787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:00.174563 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f02fc2-244f-449c-af9c-b40e06064787 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:00.175281 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f02fc2-244f-449c-af9c-b40e06064787 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:00.177265 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f02fc2-244f-449c-af9c-b40e06064787 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:00.198616 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 912/1831] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:59:00 2022] POST /identity/v3/users => generated 282 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 11:59:00.202532 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b0407-f4c2-4786-b6d7-1162c9cc8e34 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:00.213365 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b0407-f4c2-4786-b6d7-1162c9cc8e34 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:00.218128 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9663788-cb9a-4008-a893-09beb8ec5371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:00.218790 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9663788-cb9a-4008-a893-09beb8ec5371 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:00.219420 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9663788-cb9a-4008-a893-09beb8ec5371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:00.219732 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9663788-cb9a-4008-a893-09beb8ec5371 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:00.220490 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9663788-cb9a-4008-a893-09beb8ec5371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:00.222400 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9663788-cb9a-4008-a893-09beb8ec5371 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:00.248244 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 920/1832] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:59:00.252058 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f02fc2-244f-449c-af9c-b40e06064787 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:00.262885 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f02fc2-244f-449c-af9c-b40e06064787 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:00.270027 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a15ae2-07e5-4960-ab6e-63de47799f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:00.270818 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a15ae2-07e5-4960-ab6e-63de47799f6d admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:00.271109 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a15ae2-07e5-4960-ab6e-63de47799f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:00.271386 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a15ae2-07e5-4960-ab6e-63de47799f6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:00.272146 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a15ae2-07e5-4960-ab6e-63de47799f6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:00.274608 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a15ae2-07e5-4960-ab6e-63de47799f6d admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:00.288418 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 913/1833] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:59:00.290390 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9663788-cb9a-4008-a893-09beb8ec5371 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:00.301173 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9663788-cb9a-4008-a893-09beb8ec5371 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:00.306414 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4460d95b-f8bf-4531-bbb7-e7f39e11e6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:00.306895 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460d95b-f8bf-4531-bbb7-e7f39e11e6e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:00.307101 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460d95b-f8bf-4531-bbb7-e7f39e11e6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:00.307551 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4460d95b-f8bf-4531-bbb7-e7f39e11e6e6 admin admin] PATH_INFO: `/v3/projects/a7fab1eb55264eec83f24ebcc49fd2d4/users/6e9ec124d3854b8eaaf5a779cf9b79b3/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:00.324324 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4460d95b-f8bf-4531-bbb7-e7f39e11e6e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7fab1eb55264eec83f24ebcc49fd2d4, user_id=6e9ec124d3854b8eaaf5a779cf9b79b3, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:00.327003 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4460d95b-f8bf-4531-bbb7-e7f39e11e6e6 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:00.340866 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 921/1834] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:59:00 2022] PUT /identity/v3/projects/a7fab1eb55264eec83f24ebcc49fd2d4/users/6e9ec124d3854b8eaaf5a779cf9b79b3/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:00.352255 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feddaf0-421d-4bcc-87c2-4bb7e0f8825e None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:00.352538 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feddaf0-421d-4bcc-87c2-4bb7e0f8825e None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:00.352811 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feddaf0-421d-4bcc-87c2-4bb7e0f8825e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:00.372916 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4460d95b-f8bf-4531-bbb7-e7f39e11e6e6 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:00.374768 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-4460d95b-f8bf-4531-bbb7-e7f39e11e6e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:00.388213 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-3feddaf0-421d-4bcc-87c2-4bb7e0f8825e None None] MFA Rules not processed for user `6e9ec124d3854b8eaaf5a779cf9b79b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:00.389442 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-3feddaf0-421d-4bcc-87c2-4bb7e0f8825e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:00.422702 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:00.483284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4460d95b-f8bf-4531-bbb7-e7f39e11e6e6 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:00.486078 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 914/1835] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:00 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:00.490372 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed10610-cc2d-4448-91aa-c5b179cd4a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:00.490667 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feddaf0-421d-4bcc-87c2-4bb7e0f8825e None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:00.491943 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed10610-cc2d-4448-91aa-c5b179cd4a1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:00.492296 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed10610-cc2d-4448-91aa-c5b179cd4a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:00.492582 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed10610-cc2d-4448-91aa-c5b179cd4a1d admin admin] PATH_INFO: `/v3/projects/3149246548fb417ca1913caa30b1e221` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:00.495971 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed10610-cc2d-4448-91aa-c5b179cd4a1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3149246548fb417ca1913caa30b1e221)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:00.500334 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed10610-cc2d-4448-91aa-c5b179cd4a1d admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:00.507836 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feddaf0-421d-4bcc-87c2-4bb7e0f8825e None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:00.520491 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68554e0-9ba4-42dc-834e-6af3bd4efa6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:00.521243 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68554e0-9ba4-42dc-834e-6af3bd4efa6f admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:00.521446 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68554e0-9ba4-42dc-834e-6af3bd4efa6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:00.522699 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68554e0-9ba4-42dc-834e-6af3bd4efa6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:00.524216 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68554e0-9ba4-42dc-834e-6af3bd4efa6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:00.526154 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68554e0-9ba4-42dc-834e-6af3bd4efa6f admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:00.555842 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-0ed10610-cc2d-4448-91aa-c5b179cd4a1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3149246548fb417ca1913caa30b1e221', 'request_id': 'req-0ed10610-cc2d-4448-91aa-c5b179cd4a1d'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:00.562549 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-0ed10610-cc2d-4448-91aa-c5b179cd4a1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3149246548fb417ca1913caa30b1e221', 'request_id': 'req-0ed10610-cc2d-4448-91aa-c5b179cd4a1d'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:00.567556 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 915/1836] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:59:00 2022] POST /identity/v3/projects => generated 365 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 11:59:00.571923 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68554e0-9ba4-42dc-834e-6af3bd4efa6f admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:00.576465 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-0ed10610-cc2d-4448-91aa-c5b179cd4a1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3149246548fb417ca1913caa30b1e221', 'request_id': 'req-0ed10610-cc2d-4448-91aa-c5b179cd4a1d'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:00.589795 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-0ed10610-cc2d-4448-91aa-c5b179cd4a1d admin admin] The token cache is being invalidate because project 3149246548fb417ca1913caa30b1e221 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 11:59:00.590099 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-0ed10610-cc2d-4448-91aa-c5b179cd4a1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:00.590896 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-0ed10610-cc2d-4448-91aa-c5b179cd4a1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:00.595374 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 922/1837] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 11:59:00 2022] DELETE /identity/v3/projects/3149246548fb417ca1913caa30b1e221 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 11:59:00.611770 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed10610-cc2d-4448-91aa-c5b179cd4a1d admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:00.614379 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-0ed10610-cc2d-4448-91aa-c5b179cd4a1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:00.650698 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:00.667439 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68554e0-9ba4-42dc-834e-6af3bd4efa6f admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:00.673426 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93fd90d-82d3-4aa5-906d-5074ec3ba79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:00.674437 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93fd90d-82d3-4aa5-906d-5074ec3ba79b admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:00.675101 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93fd90d-82d3-4aa5-906d-5074ec3ba79b admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:00.675744 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93fd90d-82d3-4aa5-906d-5074ec3ba79b admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:00.676650 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93fd90d-82d3-4aa5-906d-5074ec3ba79b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:00.678831 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93fd90d-82d3-4aa5-906d-5074ec3ba79b admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:00.703854 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed10610-cc2d-4448-91aa-c5b179cd4a1d admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:00.706119 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 916/1838] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:59:00 2022] POST /identity/v3/users => generated 289 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:59:00.709973 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee31fc3-5c98-4f9b-8c26-4a375b6cf16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:00.710362 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93fd90d-82d3-4aa5-906d-5074ec3ba79b admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:00.711981 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee31fc3-5c98-4f9b-8c26-4a375b6cf16b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:00.712271 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee31fc3-5c98-4f9b-8c26-4a375b6cf16b admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:00.712546 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee31fc3-5c98-4f9b-8c26-4a375b6cf16b admin admin] PATH_INFO: `/v3/users/c42efe0253de430e847ffc23b3185f49` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:00.713813 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee31fc3-5c98-4f9b-8c26-4a375b6cf16b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c42efe0253de430e847ffc23b3185f49)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:00.715351 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-f93fd90d-82d3-4aa5-906d-5074ec3ba79b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:00.715733 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee31fc3-5c98-4f9b-8c26-4a375b6cf16b admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:00.728476 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93fd90d-82d3-4aa5-906d-5074ec3ba79b admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:00.733810 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0038b67-75e4-49f5-bca4-6d77887cdbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:00.734481 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0038b67-75e4-49f5-bca4-6d77887cdbcd admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:00.734767 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0038b67-75e4-49f5-bca4-6d77887cdbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:00.735046 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0038b67-75e4-49f5-bca4-6d77887cdbcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:00.736182 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0038b67-75e4-49f5-bca4-6d77887cdbcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:00.737788 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0038b67-75e4-49f5-bca4-6d77887cdbcd admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:00.750283 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 917/1839] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:59:00.751957 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0038b67-75e4-49f5-bca4-6d77887cdbcd admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:00.754605 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-a0038b67-75e4-49f5-bca4-6d77887cdbcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:00.780982 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-4ee31fc3-5c98-4f9b-8c26-4a375b6cf16b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c42efe0253de430e847ffc23b3185f49'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:00.781818 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-4ee31fc3-5c98-4f9b-8c26-4a375b6cf16b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c42efe0253de430e847ffc23b3185f49'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:00.799711 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-4ee31fc3-5c98-4f9b-8c26-4a375b6cf16b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c42efe0253de430e847ffc23b3185f49'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:00.805269 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-4ee31fc3-5c98-4f9b-8c26-4a375b6cf16b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c42efe0253de430e847ffc23b3185f49'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:00.813554 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-4ee31fc3-5c98-4f9b-8c26-4a375b6cf16b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c42efe0253de430e847ffc23b3185f49'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:00.817436 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0038b67-75e4-49f5-bca4-6d77887cdbcd admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:00.821158 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 923/1840] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 11:59:00 2022] DELETE /identity/v3/users/c42efe0253de430e847ffc23b3185f49 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:00.821790 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1a57f-0d6a-434a-ac3b-553f3a21480d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:00.822439 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1a57f-0d6a-434a-ac3b-553f3a21480d service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:00.822721 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1a57f-0d6a-434a-ac3b-553f3a21480d service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:00.822998 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1a57f-0d6a-434a-ac3b-553f3a21480d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:00.824826 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee31fc3-5c98-4f9b-8c26-4a375b6cf16b admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:00.825005 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-08f1a57f-0d6a-434a-ac3b-553f3a21480d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:00.826188 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-4ee31fc3-5c98-4f9b-8c26-4a375b6cf16b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:00.864523 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:00.902206 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee31fc3-5c98-4f9b-8c26-4a375b6cf16b admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:00.907967 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f1a57f-0d6a-434a-ac3b-553f3a21480d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:00.908713 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b4580-5bef-47ab-946b-797691fef3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:00.909618 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b4580-5bef-47ab-946b-797691fef3f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:00.909900 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b4580-5bef-47ab-946b-797691fef3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:00.910172 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b4580-5bef-47ab-946b-797691fef3f6 admin admin] PATH_INFO: `/v3/projects/e507050831e4497489e7001f796ef3a6/users/fa70a428161047a19385dee3a01a721d/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:00.910648 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f1a57f-0d6a-434a-ac3b-553f3a21480d service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:00.925139 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 918/1841] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:59:00 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:59:00.926032 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b4580-5bef-47ab-946b-797691fef3f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e507050831e4497489e7001f796ef3a6, user_id=fa70a428161047a19385dee3a01a721d, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:00.926461 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1a57f-0d6a-434a-ac3b-553f3a21480d service cinder] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:00.928288 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-08f1a57f-0d6a-434a-ac3b-553f3a21480d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:00.929338 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b4580-5bef-47ab-946b-797691fef3f6 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:00.945099 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1a57f-0d6a-434a-ac3b-553f3a21480d service cinder] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:00.947900 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 924/1842] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:59:00 2022] PUT /identity/v3/projects/e507050831e4497489e7001f796ef3a6/users/fa70a428161047a19385dee3a01a721d/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:00.951982 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b4580-5bef-47ab-946b-797691fef3f6 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:00.988652 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:01.027693 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43519425-8e7f-4315-bd3d-adbebe2363ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:01.028585 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43519425-8e7f-4315-bd3d-adbebe2363ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:01.029449 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43519425-8e7f-4315-bd3d-adbebe2363ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:01.029449 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43519425-8e7f-4315-bd3d-adbebe2363ba admin admin] PATH_INFO: `/v3/users/eae970eb8fe340cb9e6f8e68b8efd73b` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:01.031244 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43519425-8e7f-4315-bd3d-adbebe2363ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=eae970eb8fe340cb9e6f8e68b8efd73b)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:01.035945 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43519425-8e7f-4315-bd3d-adbebe2363ba admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:01.040204 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b4580-5bef-47ab-946b-797691fef3f6 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:01.048186 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffb293-2a31-42af-900f-09ff6c3329c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:01.048933 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffb293-2a31-42af-900f-09ff6c3329c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:01.049361 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffb293-2a31-42af-900f-09ff6c3329c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:01.049646 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffb293-2a31-42af-900f-09ff6c3329c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:01.050381 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bffb293-2a31-42af-900f-09ff6c3329c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:01.052018 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bffb293-2a31-42af-900f-09ff6c3329c0 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:01.066787 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 925/1843] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:59:01.071920 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffb293-2a31-42af-900f-09ff6c3329c0 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:01.084132 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffb293-2a31-42af-900f-09ff6c3329c0 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:01.089544 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464edba-7de3-4ddb-9015-bdebadcab5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:01.090433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464edba-7de3-4ddb-9015-bdebadcab5a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:01.090713 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464edba-7de3-4ddb-9015-bdebadcab5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:01.091011 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464edba-7de3-4ddb-9015-bdebadcab5a3 admin admin] PATH_INFO: `/v3/projects/e507050831e4497489e7001f796ef3a6/users/fa70a428161047a19385dee3a01a721d/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:01.093238 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d464edba-7de3-4ddb-9015-bdebadcab5a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e507050831e4497489e7001f796ef3a6, user_id=fa70a428161047a19385dee3a01a721d, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:01.097340 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d464edba-7de3-4ddb-9015-bdebadcab5a3 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:01.115677 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 926/1844] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:59:01 2022] PUT /identity/v3/projects/e507050831e4497489e7001f796ef3a6/users/fa70a428161047a19385dee3a01a721d/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 11:59:01.129273 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a1b24-d384-4b58-96a2-0a2ff4442965 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:01.129567 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a1b24-d384-4b58-96a2-0a2ff4442965 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:01.129841 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a1b24-d384-4b58-96a2-0a2ff4442965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:01.144019 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-43519425-8e7f-4315-bd3d-adbebe2363ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eae970eb8fe340cb9e6f8e68b8efd73b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:01.158753 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-43519425-8e7f-4315-bd3d-adbebe2363ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eae970eb8fe340cb9e6f8e68b8efd73b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:01.160005 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-43519425-8e7f-4315-bd3d-adbebe2363ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eae970eb8fe340cb9e6f8e68b8efd73b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:01.179091 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-43519425-8e7f-4315-bd3d-adbebe2363ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eae970eb8fe340cb9e6f8e68b8efd73b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:01.180316 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-4a6a1b24-d384-4b58-96a2-0a2ff4442965 None None] MFA Rules not processed for user `fa70a428161047a19385dee3a01a721d`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:01.181741 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-4a6a1b24-d384-4b58-96a2-0a2ff4442965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:01.189379 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-43519425-8e7f-4315-bd3d-adbebe2363ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eae970eb8fe340cb9e6f8e68b8efd73b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:01.198775 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 919/1845] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 11:59:00 2022] DELETE /identity/v3/users/eae970eb8fe340cb9e6f8e68b8efd73b => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:01.199737 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43519425-8e7f-4315-bd3d-adbebe2363ba admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:01.201332 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-43519425-8e7f-4315-bd3d-adbebe2363ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:01.266616 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:01.274791 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 927/1846] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:01 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:01.286621 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43519425-8e7f-4315-bd3d-adbebe2363ba admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:01.287431 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23b509-e6e9-4817-af28-5a47ed5ce72a None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:01.287860 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23b509-e6e9-4817-af28-5a47ed5ce72a None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:01.288142 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23b509-e6e9-4817-af28-5a47ed5ce72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:01.291419 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681e46a-437d-44b4-9721-635648ea7ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:01.292448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681e46a-437d-44b4-9721-635648ea7ccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:01.292734 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681e46a-437d-44b4-9721-635648ea7ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:01.293008 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681e46a-437d-44b4-9721-635648ea7ccc admin admin] PATH_INFO: `/v3/projects/b7fef8fb7bf84e2b8d0e01c2e9f9d05b` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:01.294186 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681e46a-437d-44b4-9721-635648ea7ccc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7fef8fb7bf84e2b8d0e01c2e9f9d05b)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:01.296181 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681e46a-437d-44b4-9721-635648ea7ccc admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:01.326786 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-dd23b509-e6e9-4817-af28-5a47ed5ce72a None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:01.328120 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-dd23b509-e6e9-4817-af28-5a47ed5ce72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:01.341856 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 928/1847] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:01.341856 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23b509-e6e9-4817-af28-5a47ed5ce72a None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:01.341856 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-dd23b509-e6e9-4817-af28-5a47ed5ce72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:01.372204 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-4681e46a-437d-44b4-9721-635648ea7ccc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7fef8fb7bf84e2b8d0e01c2e9f9d05b', 'request_id': 'req-4681e46a-437d-44b4-9721-635648ea7ccc'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:01.380736 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-4681e46a-437d-44b4-9721-635648ea7ccc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7fef8fb7bf84e2b8d0e01c2e9f9d05b', 'request_id': 'req-4681e46a-437d-44b4-9721-635648ea7ccc'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:01.395036 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-4681e46a-437d-44b4-9721-635648ea7ccc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7fef8fb7bf84e2b8d0e01c2e9f9d05b', 'request_id': 'req-4681e46a-437d-44b4-9721-635648ea7ccc'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:01.420465 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-4681e46a-437d-44b4-9721-635648ea7ccc admin admin] The token cache is being invalidate because project b7fef8fb7bf84e2b8d0e01c2e9f9d05b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 11:59:01.420765 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-4681e46a-437d-44b4-9721-635648ea7ccc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:01.421448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-4681e46a-437d-44b4-9721-635648ea7ccc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:01.426812 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 920/1848] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 11:59:01 2022] DELETE /identity/v3/projects/b7fef8fb7bf84e2b8d0e01c2e9f9d05b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:01.427727 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681e46a-437d-44b4-9721-635648ea7ccc admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:01.429276 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-4681e46a-437d-44b4-9721-635648ea7ccc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:01.432833 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23b509-e6e9-4817-af28-5a47ed5ce72a None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:01.489709 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:01.496707 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681e46a-437d-44b4-9721-635648ea7ccc admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:01.497303 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70578c64-e7ab-4d89-82af-d4c807d36227 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:01.498018 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70578c64-e7ab-4d89-82af-d4c807d36227 service cinder] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:01.498303 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70578c64-e7ab-4d89-82af-d4c807d36227 service cinder] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:01.498663 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70578c64-e7ab-4d89-82af-d4c807d36227 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:01.501218 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-70578c64-e7ab-4d89-82af-d4c807d36227 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:01.502794 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96338b3-edc2-46dd-bc84-794504aa6fea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:01.503321 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96338b3-edc2-46dd-bc84-794504aa6fea service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:01.503645 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96338b3-edc2-46dd-bc84-794504aa6fea service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:01.503928 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96338b3-edc2-46dd-bc84-794504aa6fea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:01.505875 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-f96338b3-edc2-46dd-bc84-794504aa6fea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:01.577473 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70578c64-e7ab-4d89-82af-d4c807d36227 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:01.578949 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70578c64-e7ab-4d89-82af-d4c807d36227 service cinder] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:01.581144 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96338b3-edc2-46dd-bc84-794504aa6fea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:01.582612 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96338b3-edc2-46dd-bc84-794504aa6fea service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:01.588765 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 929/1849] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:59:01 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:59:01.589868 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8aaa2-8caf-446e-b7dc-cf942d5dfe48 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:01.590212 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8aaa2-8caf-446e-b7dc-cf942d5dfe48 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:01.590500 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8aaa2-8caf-446e-b7dc-cf942d5dfe48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:01.592631 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 921/1850] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:59:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:59:01.610207 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-e6c8aaa2-8caf-446e-b7dc-cf942d5dfe48 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:01.611373 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-e6c8aaa2-8caf-446e-b7dc-cf942d5dfe48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:01.634829 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f29fc4-5135-4eec-a34e-6611abb3b1a0 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:01.635116 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f29fc4-5135-4eec-a34e-6611abb3b1a0 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:01.635402 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f29fc4-5135-4eec-a34e-6611abb3b1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:01.640691 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 930/1851] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:01.658596 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-26f29fc4-5135-4eec-a34e-6611abb3b1a0 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:01.660334 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-26f29fc4-5135-4eec-a34e-6611abb3b1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:01.670919 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 922/1852] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:01.674633 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8aaa2-8caf-446e-b7dc-cf942d5dfe48 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:01.681148 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f29fc4-5135-4eec-a34e-6611abb3b1a0 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:01.682909 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-26f29fc4-5135-4eec-a34e-6611abb3b1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:01.686115 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8aaa2-8caf-446e-b7dc-cf942d5dfe48 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:01.691421 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6158c-a290-4cbe-b1d4-6f97ddf6f1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:01.692145 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6158c-a290-4cbe-b1d4-6f97ddf6f1a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:01.692430 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6158c-a290-4cbe-b1d4-6f97ddf6f1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:01.692714 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6158c-a290-4cbe-b1d4-6f97ddf6f1a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:01.694193 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6158c-a290-4cbe-b1d4-6f97ddf6f1a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:59:01.694514 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6158c-a290-4cbe-b1d4-6f97ddf6f1a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:01.696466 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6158c-a290-4cbe-b1d4-6f97ddf6f1a1 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:01.701230 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f29fc4-5135-4eec-a34e-6611abb3b1a0 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:01.704866 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7d9fd-b1a8-46ac-a578-b07e43d5efd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:01.705517 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7d9fd-b1a8-46ac-a578-b07e43d5efd6 service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:01.705798 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7d9fd-b1a8-46ac-a578-b07e43d5efd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:01.706069 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7d9fd-b1a8-46ac-a578-b07e43d5efd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:01.708025 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-16d7d9fd-b1a8-46ac-a578-b07e43d5efd6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:01.716965 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 931/1853] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 11:59:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:59:01.717909 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6158c-a290-4cbe-b1d4-6f97ddf6f1a1 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:01.731712 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6158c-a290-4cbe-b1d4-6f97ddf6f1a1 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:01.737975 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:01.739241 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c406b7d-4373-4054-8e65-2376d704b76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:01.739945 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c406b7d-4373-4054-8e65-2376d704b76d admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:01.740863 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c406b7d-4373-4054-8e65-2376d704b76d admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:01.741287 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c406b7d-4373-4054-8e65-2376d704b76d admin admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:01.742699 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c406b7d-4373-4054-8e65-2376d704b76d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:01.744829 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c406b7d-4373-4054-8e65-2376d704b76d admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:01.784987 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 932/1854] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:59:01 2022] POST /identity/v3/projects => generated 367 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:59:01.789604 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c406b7d-4373-4054-8e65-2376d704b76d admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:01.832866 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d7d9fd-b1a8-46ac-a578-b07e43d5efd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:01.834628 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d7d9fd-b1a8-46ac-a578-b07e43d5efd6 service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:01.848623 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 923/1855] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:59:01 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:59:01.877750 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c406b7d-4373-4054-8e65-2376d704b76d admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:01.885665 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601301c-47b0-4a1d-995e-53ad25de6d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:01.886346 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601301c-47b0-4a1d-995e-53ad25de6d93 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:01.886626 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601301c-47b0-4a1d-995e-53ad25de6d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:01.887056 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601301c-47b0-4a1d-995e-53ad25de6d93 admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:01.887929 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f601301c-47b0-4a1d-995e-53ad25de6d93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:01.890029 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f601301c-47b0-4a1d-995e-53ad25de6d93 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:01.919981 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 933/1856] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:59:01 2022] POST /identity/v3/users => generated 284 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:59:01.924249 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7d9fd-b1a8-46ac-a578-b07e43d5efd6 service cinder] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:01.937730 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7d9fd-b1a8-46ac-a578-b07e43d5efd6 service cinder] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:01.945017 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bfdaae-4900-456e-9230-3bc43657b418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:01.945715 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfdaae-4900-456e-9230-3bc43657b418 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:01.945998 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfdaae-4900-456e-9230-3bc43657b418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:01.946269 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfdaae-4900-456e-9230-3bc43657b418 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:01.947261 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bfdaae-4900-456e-9230-3bc43657b418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:01.948765 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bfdaae-4900-456e-9230-3bc43657b418 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:01.962015 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 924/1857] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 11:59:01.965607 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601301c-47b0-4a1d-995e-53ad25de6d93 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:01.982883 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601301c-47b0-4a1d-995e-53ad25de6d93 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:01.993117 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50106aa-e1f9-4fd1-a993-6b8f58d255b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:01.994042 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50106aa-e1f9-4fd1-a993-6b8f58d255b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:01.994315 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50106aa-e1f9-4fd1-a993-6b8f58d255b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:01.994759 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50106aa-e1f9-4fd1-a993-6b8f58d255b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:01.995757 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50106aa-e1f9-4fd1-a993-6b8f58d255b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:01.997657 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50106aa-e1f9-4fd1-a993-6b8f58d255b1 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:02.012976 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 934/1858] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:59:02.016881 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bfdaae-4900-456e-9230-3bc43657b418 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:02.031853 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50106aa-e1f9-4fd1-a993-6b8f58d255b1 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:02.034856 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bfdaae-4900-456e-9230-3bc43657b418 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:02.037430 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-c50106aa-e1f9-4fd1-a993-6b8f58d255b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:02.042187 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd84cc6-4d59-404d-9a4c-6add36c7f338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:02.043313 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd84cc6-4d59-404d-9a4c-6add36c7f338 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:02.043672 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd84cc6-4d59-404d-9a4c-6add36c7f338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:02.044016 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd84cc6-4d59-404d-9a4c-6add36c7f338 admin admin] PATH_INFO: `/v3/projects/6b5c7a0f5c8b454fa385da0712649ddb/users/c15b2e8ed3fe4d7bbecfdcda2a90b1d2/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:02.056446 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50106aa-e1f9-4fd1-a993-6b8f58d255b1 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:02.062018 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50bb29d-48c4-4bd7-8224-e4c945b109e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:02.063098 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50bb29d-48c4-4bd7-8224-e4c945b109e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:02.063463 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50bb29d-48c4-4bd7-8224-e4c945b109e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:02.063593 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd84cc6-4d59-404d-9a4c-6add36c7f338 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b5c7a0f5c8b454fa385da0712649ddb, user_id=c15b2e8ed3fe4d7bbecfdcda2a90b1d2, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:02.063776 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50bb29d-48c4-4bd7-8224-e4c945b109e8 admin admin] PATH_INFO: `/v3/projects/737a42eebb1345e4a179d2e1d6d103ee` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:02.064986 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50bb29d-48c4-4bd7-8224-e4c945b109e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=737a42eebb1345e4a179d2e1d6d103ee)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:02.066693 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd84cc6-4d59-404d-9a4c-6add36c7f338 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:02.067585 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50bb29d-48c4-4bd7-8224-e4c945b109e8 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:02.085055 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 925/1859] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:59:02 2022] PUT /identity/v3/projects/6b5c7a0f5c8b454fa385da0712649ddb/users/c15b2e8ed3fe4d7bbecfdcda2a90b1d2/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:02.099986 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf66d4b-3df8-49d7-b6d1-ceaa1c303c14 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:02.100282 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf66d4b-3df8-49d7-b6d1-ceaa1c303c14 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:02.100597 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf66d4b-3df8-49d7-b6d1-ceaa1c303c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:02.116421 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:02.131975 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-3cf66d4b-3df8-49d7-b6d1-ceaa1c303c14 None None] MFA Rules not processed for user `c15b2e8ed3fe4d7bbecfdcda2a90b1d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:02.133268 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-3cf66d4b-3df8-49d7-b6d1-ceaa1c303c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:02.137859 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-c50bb29d-48c4-4bd7-8224-e4c945b109e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '737a42eebb1345e4a179d2e1d6d103ee', 'request_id': 'req-c50bb29d-48c4-4bd7-8224-e4c945b109e8'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:02.151146 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-c50bb29d-48c4-4bd7-8224-e4c945b109e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '737a42eebb1345e4a179d2e1d6d103ee', 'request_id': 'req-c50bb29d-48c4-4bd7-8224-e4c945b109e8'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:02.162569 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-c50bb29d-48c4-4bd7-8224-e4c945b109e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '737a42eebb1345e4a179d2e1d6d103ee', 'request_id': 'req-c50bb29d-48c4-4bd7-8224-e4c945b109e8'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:02.186189 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-c50bb29d-48c4-4bd7-8224-e4c945b109e8 admin admin] The token cache is being invalidate because project 737a42eebb1345e4a179d2e1d6d103ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 11:59:02.186619 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-c50bb29d-48c4-4bd7-8224-e4c945b109e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:02.187292 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-c50bb29d-48c4-4bd7-8224-e4c945b109e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:02.189132 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 935/1860] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 11:59:02 2022] DELETE /identity/v3/projects/737a42eebb1345e4a179d2e1d6d103ee => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:02.193024 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50bb29d-48c4-4bd7-8224-e4c945b109e8 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:02.194320 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-c50bb29d-48c4-4bd7-8224-e4c945b109e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:02.211887 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 926/1861] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:02 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:02.217233 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf66d4b-3df8-49d7-b6d1-ceaa1c303c14 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:02.219117 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-3cf66d4b-3df8-49d7-b6d1-ceaa1c303c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:02.280923 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50bb29d-48c4-4bd7-8224-e4c945b109e8 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:02.287358 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb58f8b-e878-4745-954b-459d4458b03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:02.287589 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf66d4b-3df8-49d7-b6d1-ceaa1c303c14 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:02.291797 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb58f8b-e878-4745-954b-459d4458b03c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:02.292180 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb58f8b-e878-4745-954b-459d4458b03c admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:02.292284 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de97e4-37a0-43f5-bd79-3a08c9ac7c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:02.292569 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb58f8b-e878-4745-954b-459d4458b03c admin admin] PATH_INFO: `/v3/users/6526ae625bec48c2af5bf5763e46b93a` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:02.292920 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de97e4-37a0-43f5-bd79-3a08c9ac7c3f admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:02.293208 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de97e4-37a0-43f5-bd79-3a08c9ac7c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:02.293504 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de97e4-37a0-43f5-bd79-3a08c9ac7c3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:02.294184 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26de97e4-37a0-43f5-bd79-3a08c9ac7c3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:02.294321 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb58f8b-e878-4745-954b-459d4458b03c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6526ae625bec48c2af5bf5763e46b93a)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:02.296133 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26de97e4-37a0-43f5-bd79-3a08c9ac7c3f admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:02.296357 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb58f8b-e878-4745-954b-459d4458b03c admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:02.316846 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:02.327874 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 927/1862] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:59:02 2022] POST /identity/v3/projects => generated 367 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 11:59:02.328801 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de97e4-37a0-43f5-bd79-3a08c9ac7c3f admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:02.345226 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-3eb58f8b-e878-4745-954b-459d4458b03c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6526ae625bec48c2af5bf5763e46b93a'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:02.345894 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-3eb58f8b-e878-4745-954b-459d4458b03c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6526ae625bec48c2af5bf5763e46b93a'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:02.357916 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-3eb58f8b-e878-4745-954b-459d4458b03c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6526ae625bec48c2af5bf5763e46b93a'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:02.364965 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-3eb58f8b-e878-4745-954b-459d4458b03c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6526ae625bec48c2af5bf5763e46b93a'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:02.372949 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-3eb58f8b-e878-4745-954b-459d4458b03c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6526ae625bec48c2af5bf5763e46b93a'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:02.379280 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 936/1863] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 11:59:02 2022] DELETE /identity/v3/users/6526ae625bec48c2af5bf5763e46b93a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 11:59:02.392555 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de97e4-37a0-43f5-bd79-3a08c9ac7c3f admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:02.459646 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f624b9-aebb-4428-9d9d-1611e3c77277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:02.460330 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f624b9-aebb-4428-9d9d-1611e3c77277 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:02.460618 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f624b9-aebb-4428-9d9d-1611e3c77277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:02.461452 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f624b9-aebb-4428-9d9d-1611e3c77277 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:02.462807 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f624b9-aebb-4428-9d9d-1611e3c77277 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:02.464783 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f624b9-aebb-4428-9d9d-1611e3c77277 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:02.485408 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 928/1864] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:59:02 2022] POST /identity/v3/users => generated 290 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 11:59:02.490059 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb58f8b-e878-4745-954b-459d4458b03c admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:02.491928 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-3eb58f8b-e878-4745-954b-459d4458b03c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:02.505532 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb58f8b-e878-4745-954b-459d4458b03c admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:02.510589 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c281a3b-1896-41e8-9fc3-ea93d991777c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:02.511309 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c281a3b-1896-41e8-9fc3-ea93d991777c admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:02.511555 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c281a3b-1896-41e8-9fc3-ea93d991777c admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:02.511834 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c281a3b-1896-41e8-9fc3-ea93d991777c admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:02.512956 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c281a3b-1896-41e8-9fc3-ea93d991777c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:02.514140 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c281a3b-1896-41e8-9fc3-ea93d991777c admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:02.525352 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 937/1865] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:59:02.529582 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f624b9-aebb-4428-9d9d-1611e3c77277 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:02.540670 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f624b9-aebb-4428-9d9d-1611e3c77277 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:02.545541 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e84d9-7005-4f1e-8868-3aae1794be53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:02.546657 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e84d9-7005-4f1e-8868-3aae1794be53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:02.546950 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e84d9-7005-4f1e-8868-3aae1794be53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:02.547764 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e84d9-7005-4f1e-8868-3aae1794be53 admin admin] PATH_INFO: `/v3/projects/a9e9690a166145218098f30569c48b5b/users/e5fa2e63d64d4f88a0474814dcfbad8a/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:02.564796 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052e84d9-7005-4f1e-8868-3aae1794be53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9e9690a166145218098f30569c48b5b, user_id=e5fa2e63d64d4f88a0474814dcfbad8a, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:02.567718 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052e84d9-7005-4f1e-8868-3aae1794be53 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:02.583067 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 929/1866] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:59:02 2022] PUT /identity/v3/projects/a9e9690a166145218098f30569c48b5b/users/e5fa2e63d64d4f88a0474814dcfbad8a/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:02.586780 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c281a3b-1896-41e8-9fc3-ea93d991777c admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:02.596860 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c281a3b-1896-41e8-9fc3-ea93d991777c admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:02.618970 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:02.659192 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e12ed-dba2-48ed-932d-388cc0c1b9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:02.659899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e12ed-dba2-48ed-932d-388cc0c1b9ae admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:02.660178 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e12ed-dba2-48ed-932d-388cc0c1b9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:02.660450 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e12ed-dba2-48ed-932d-388cc0c1b9ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:02.661200 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e12ed-dba2-48ed-932d-388cc0c1b9ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:02.662790 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e12ed-dba2-48ed-932d-388cc0c1b9ae admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:02.675927 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 938/1867] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:59:02.677326 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e84d9-7005-4f1e-8868-3aae1794be53 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:02.688873 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e84d9-7005-4f1e-8868-3aae1794be53 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:02.693442 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d344f-481e-4ef1-840e-05b29cc26f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:02.694317 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d344f-481e-4ef1-840e-05b29cc26f47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:02.694598 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d344f-481e-4ef1-840e-05b29cc26f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:02.694871 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d344f-481e-4ef1-840e-05b29cc26f47 admin admin] PATH_INFO: `/v3/projects/a9e9690a166145218098f30569c48b5b/users/e5fa2e63d64d4f88a0474814dcfbad8a/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:02.697415 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425d344f-481e-4ef1-840e-05b29cc26f47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9e9690a166145218098f30569c48b5b, user_id=e5fa2e63d64d4f88a0474814dcfbad8a, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:02.700057 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425d344f-481e-4ef1-840e-05b29cc26f47 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:02.712295 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 930/1868] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:59:02 2022] PUT /identity/v3/projects/a9e9690a166145218098f30569c48b5b/users/e5fa2e63d64d4f88a0474814dcfbad8a/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 11:59:02.722264 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630df4b9-3528-4b0a-a5c1-b21c0689cba7 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:02.722555 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630df4b9-3528-4b0a-a5c1-b21c0689cba7 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:02.722830 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630df4b9-3528-4b0a-a5c1-b21c0689cba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:02.735877 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d344f-481e-4ef1-840e-05b29cc26f47 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:02.737986 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-425d344f-481e-4ef1-840e-05b29cc26f47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:02.753279 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-630df4b9-3528-4b0a-a5c1-b21c0689cba7 None None] MFA Rules not processed for user `e5fa2e63d64d4f88a0474814dcfbad8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:02.755416 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-630df4b9-3528-4b0a-a5c1-b21c0689cba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:02.825403 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d344f-481e-4ef1-840e-05b29cc26f47 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:02.830052 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e1ae7-4745-41cb-9d63-eb66d78e7d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:02.830911 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e1ae7-4745-41cb-9d63-eb66d78e7d03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:02.831192 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e1ae7-4745-41cb-9d63-eb66d78e7d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:02.831468 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e1ae7-4745-41cb-9d63-eb66d78e7d03 admin admin] PATH_INFO: `/v3/projects/173fc0a98cec458698a15d173bdec6f9` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:02.832705 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e1ae7-4745-41cb-9d63-eb66d78e7d03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=173fc0a98cec458698a15d173bdec6f9)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:02.834585 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e1ae7-4745-41cb-9d63-eb66d78e7d03 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:02.836108 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:02.847344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 939/1869] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:02 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:02.858593 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630df4b9-3528-4b0a-a5c1-b21c0689cba7 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:02.859982 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-630df4b9-3528-4b0a-a5c1-b21c0689cba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:02.893413 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-6d8e1ae7-4745-41cb-9d63-eb66d78e7d03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '173fc0a98cec458698a15d173bdec6f9', 'request_id': 'req-6d8e1ae7-4745-41cb-9d63-eb66d78e7d03'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:02.904428 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-6d8e1ae7-4745-41cb-9d63-eb66d78e7d03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '173fc0a98cec458698a15d173bdec6f9', 'request_id': 'req-6d8e1ae7-4745-41cb-9d63-eb66d78e7d03'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:02.916170 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-6d8e1ae7-4745-41cb-9d63-eb66d78e7d03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '173fc0a98cec458698a15d173bdec6f9', 'request_id': 'req-6d8e1ae7-4745-41cb-9d63-eb66d78e7d03'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:02.930527 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-6d8e1ae7-4745-41cb-9d63-eb66d78e7d03 admin admin] The token cache is being invalidate because project 173fc0a98cec458698a15d173bdec6f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 11:59:02.930953 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-6d8e1ae7-4745-41cb-9d63-eb66d78e7d03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:02.931861 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-6d8e1ae7-4745-41cb-9d63-eb66d78e7d03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:02.932410 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630df4b9-3528-4b0a-a5c1-b21c0689cba7 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:02.934354 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 931/1870] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 11:59:02 2022] DELETE /identity/v3/projects/173fc0a98cec458698a15d173bdec6f9 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:02.938964 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b550c-00d1-4e70-9365-672e4db5997c None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:02.939250 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b550c-00d1-4e70-9365-672e4db5997c None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:02.939552 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b550c-00d1-4e70-9365-672e4db5997c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:02.967592 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-974b550c-00d1-4e70-9365-672e4db5997c None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:02.969883 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-974b550c-00d1-4e70-9365-672e4db5997c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:03.005803 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821b9cb-0111-40d8-82da-0ad758fabe45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:03.006583 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821b9cb-0111-40d8-82da-0ad758fabe45 service cinder] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:03.007074 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821b9cb-0111-40d8-82da-0ad758fabe45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:03.007449 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821b9cb-0111-40d8-82da-0ad758fabe45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:03.009715 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-7821b9cb-0111-40d8-82da-0ad758fabe45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:03.032951 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:03.056911 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 932/1871] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:03.065904 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0b683-a8b8-4389-9047-14a2bef8f1cb None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:03.066211 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0b683-a8b8-4389-9047-14a2bef8f1cb None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:03.066493 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0b683-a8b8-4389-9047-14a2bef8f1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:03.093130 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-04c0b683-a8b8-4389-9047-14a2bef8f1cb None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:03.094354 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-04c0b683-a8b8-4389-9047-14a2bef8f1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:03.103562 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 933/1872] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:03.107531 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c0b683-a8b8-4389-9047-14a2bef8f1cb None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:03.116474 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c0b683-a8b8-4389-9047-14a2bef8f1cb None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:03.121749 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821b9cb-0111-40d8-82da-0ad758fabe45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:03.122288 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac57c9-9a0b-4773-8787-d556793f7491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:03.122934 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac57c9-9a0b-4773-8787-d556793f7491 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:03.123220 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac57c9-9a0b-4773-8787-d556793f7491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:03.123323 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821b9cb-0111-40d8-82da-0ad758fabe45 service cinder] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:03.123511 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac57c9-9a0b-4773-8787-d556793f7491 admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:03.124237 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeac57c9-9a0b-4773-8787-d556793f7491 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:59:03.124540 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeac57c9-9a0b-4773-8787-d556793f7491 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:03.126128 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeac57c9-9a0b-4773-8787-d556793f7491 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:03.133144 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 940/1873] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:59:02 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 11:59:03.137952 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 934/1874] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 11:59:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:59:03.142261 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821b9cb-0111-40d8-82da-0ad758fabe45 service cinder] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:03.152611 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821b9cb-0111-40d8-82da-0ad758fabe45 service cinder] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:03.157255 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ddbafc-ed9e-4a75-9145-b13c6e356eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:03.157908 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ddbafc-ed9e-4a75-9145-b13c6e356eb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:03.158195 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ddbafc-ed9e-4a75-9145-b13c6e356eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:03.158475 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ddbafc-ed9e-4a75-9145-b13c6e356eb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:03.159175 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ddbafc-ed9e-4a75-9145-b13c6e356eb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:03.161127 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ddbafc-ed9e-4a75-9145-b13c6e356eb8 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:03.175007 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac57c9-9a0b-4773-8787-d556793f7491 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:03.177519 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-aeac57c9-9a0b-4773-8787-d556793f7491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:03.189770 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 941/1875] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:59:03 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:59:03.195569 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ddbafc-ed9e-4a75-9145-b13c6e356eb8 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:03.195796 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac57c9-9a0b-4773-8787-d556793f7491 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:03.251590 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa42ccf-03ba-40c8-bd76-84635a37bc46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:03.252761 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa42ccf-03ba-40c8-bd76-84635a37bc46 service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:03.253273 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa42ccf-03ba-40c8-bd76-84635a37bc46 service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:03.253779 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa42ccf-03ba-40c8-bd76-84635a37bc46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:03.257000 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-daa42ccf-03ba-40c8-bd76-84635a37bc46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:03.260264 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ddbafc-ed9e-4a75-9145-b13c6e356eb8 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:03.264894 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17cf0b-9382-4309-b8f2-ba9fc8195579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:03.265553 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17cf0b-9382-4309-b8f2-ba9fc8195579 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:03.265860 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17cf0b-9382-4309-b8f2-ba9fc8195579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:03.266138 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17cf0b-9382-4309-b8f2-ba9fc8195579 admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:03.266823 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17cf0b-9382-4309-b8f2-ba9fc8195579 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:03.268806 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17cf0b-9382-4309-b8f2-ba9fc8195579 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:03.284418 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:03.292288 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 942/1876] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:59:03 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:59:03.296738 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17cf0b-9382-4309-b8f2-ba9fc8195579 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:03.307846 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17cf0b-9382-4309-b8f2-ba9fc8195579 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:03.312439 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3c6c4-c9e7-441d-8e84-164dc15befe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:03.313084 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3c6c4-c9e7-441d-8e84-164dc15befe4 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:03.313371 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3c6c4-c9e7-441d-8e84-164dc15befe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:03.313649 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3c6c4-c9e7-441d-8e84-164dc15befe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:03.314372 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf3c6c4-c9e7-441d-8e84-164dc15befe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:03.316024 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf3c6c4-c9e7-441d-8e84-164dc15befe4 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:03.324689 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa42ccf-03ba-40c8-bd76-84635a37bc46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:03.325804 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 943/1877] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:59:03.326169 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa42ccf-03ba-40c8-bd76-84635a37bc46 service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:03.329534 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3c6c4-c9e7-441d-8e84-164dc15befe4 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:03.336459 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 935/1878] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:59:03 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 11:59:03.339360 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3c6c4-c9e7-441d-8e84-164dc15befe4 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:03.344079 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52dbad0-6c88-48da-b69d-0afdee12afa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:03.344719 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52dbad0-6c88-48da-b69d-0afdee12afa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:03.345002 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52dbad0-6c88-48da-b69d-0afdee12afa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:03.345289 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52dbad0-6c88-48da-b69d-0afdee12afa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:03.346029 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52dbad0-6c88-48da-b69d-0afdee12afa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:03.347639 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52dbad0-6c88-48da-b69d-0afdee12afa5 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:03.358661 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 944/1879] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 11:59:03.362845 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa42ccf-03ba-40c8-bd76-84635a37bc46 service cinder] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:03.373622 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa42ccf-03ba-40c8-bd76-84635a37bc46 service cinder] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:03.378375 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5514be51-1f7c-4581-a7ae-300514d730e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:03.379361 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514be51-1f7c-4581-a7ae-300514d730e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:03.379677 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514be51-1f7c-4581-a7ae-300514d730e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:03.379957 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514be51-1f7c-4581-a7ae-300514d730e7 admin admin] PATH_INFO: `/v3/projects/7417c8fada414d428b34723883faffc3/users/f1c6cc154c0046818a6d096b2473a29d/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:03.396217 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5514be51-1f7c-4581-a7ae-300514d730e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7417c8fada414d428b34723883faffc3, user_id=f1c6cc154c0046818a6d096b2473a29d, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:03.399675 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5514be51-1f7c-4581-a7ae-300514d730e7 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:03.412880 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 936/1880] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:59:03 2022] PUT /identity/v3/projects/7417c8fada414d428b34723883faffc3/users/f1c6cc154c0046818a6d096b2473a29d/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:03.423864 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd8b89-1e2d-49c3-aa32-b82f72e715e6 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:03.424229 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd8b89-1e2d-49c3-aa32-b82f72e715e6 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:03.424571 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd8b89-1e2d-49c3-aa32-b82f72e715e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:03.450751 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-7cdd8b89-1e2d-49c3-aa32-b82f72e715e6 None None] MFA Rules not processed for user `f1c6cc154c0046818a6d096b2473a29d`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:03.452087 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-7cdd8b89-1e2d-49c3-aa32-b82f72e715e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:03.511310 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:03.534337 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 945/1881] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:03.539972 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5514be51-1f7c-4581-a7ae-300514d730e7 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:03.615934 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5514be51-1f7c-4581-a7ae-300514d730e7 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:03.620829 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23109ef7-d4a1-4292-b7c9-ef794d1896bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:03.621557 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23109ef7-d4a1-4292-b7c9-ef794d1896bb admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:03.621929 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23109ef7-d4a1-4292-b7c9-ef794d1896bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:03.622380 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23109ef7-d4a1-4292-b7c9-ef794d1896bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:03.623344 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23109ef7-d4a1-4292-b7c9-ef794d1896bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:03.624995 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23109ef7-d4a1-4292-b7c9-ef794d1896bb admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:03.653823 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 937/1882] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:59:03 2022] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:59:03.657985 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd8b89-1e2d-49c3-aa32-b82f72e715e6 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:03.669191 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd8b89-1e2d-49c3-aa32-b82f72e715e6 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:03.725917 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c482b-0129-4bec-ae24-469cdf701d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:03.726613 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c482b-0129-4bec-ae24-469cdf701d12 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:03.726889 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c482b-0129-4bec-ae24-469cdf701d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:03.727159 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c482b-0129-4bec-ae24-469cdf701d12 admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:03.727881 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323c482b-0129-4bec-ae24-469cdf701d12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:03.729781 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323c482b-0129-4bec-ae24-469cdf701d12 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:03.750898 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 946/1883] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:59:03 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:59:03.755309 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23109ef7-d4a1-4292-b7c9-ef794d1896bb admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:03.766613 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23109ef7-d4a1-4292-b7c9-ef794d1896bb admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:03.771200 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fd969-4621-4e43-aa0e-8cdf14668242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:03.771906 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fd969-4621-4e43-aa0e-8cdf14668242 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:03.772189 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fd969-4621-4e43-aa0e-8cdf14668242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:03.772724 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fd969-4621-4e43-aa0e-8cdf14668242 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:03.774073 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01fd969-4621-4e43-aa0e-8cdf14668242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:03.775679 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01fd969-4621-4e43-aa0e-8cdf14668242 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:03.786148 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 938/1884] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:59:03.790325 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c482b-0129-4bec-ae24-469cdf701d12 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:03.800420 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c482b-0129-4bec-ae24-469cdf701d12 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:03.805176 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16f00b-e9ad-4e41-9f97-41aaf73a4fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:03.806056 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16f00b-e9ad-4e41-9f97-41aaf73a4fab admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:03.806335 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16f00b-e9ad-4e41-9f97-41aaf73a4fab admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:03.806620 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16f00b-e9ad-4e41-9f97-41aaf73a4fab admin admin] PATH_INFO: `/v3/projects/34737e924b024803b8e3b8a279fcc906/users/c73ff5aa9b3f4fdeb593ecebe682cdda/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:03.821850 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e16f00b-e9ad-4e41-9f97-41aaf73a4fab admin admin] RBAC: Authorizing `identity:create_grant(project_id=34737e924b024803b8e3b8a279fcc906, user_id=c73ff5aa9b3f4fdeb593ecebe682cdda, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:03.824547 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e16f00b-e9ad-4e41-9f97-41aaf73a4fab admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:03.838518 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 947/1885] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:59:03 2022] PUT /identity/v3/projects/34737e924b024803b8e3b8a279fcc906/users/c73ff5aa9b3f4fdeb593ecebe682cdda/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 11:59:03.842545 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fd969-4621-4e43-aa0e-8cdf14668242 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:03.852742 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fd969-4621-4e43-aa0e-8cdf14668242 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:03.911092 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e88ebe-789e-4895-9b51-bce84b3f7ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:03.911825 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e88ebe-789e-4895-9b51-bce84b3f7ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:03.912106 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e88ebe-789e-4895-9b51-bce84b3f7ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:03.912384 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e88ebe-789e-4895-9b51-bce84b3f7ee0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:03.913106 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e88ebe-789e-4895-9b51-bce84b3f7ee0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:03.914713 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e88ebe-789e-4895-9b51-bce84b3f7ee0 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:03.924613 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 939/1886] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:03 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:59:03.928631 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16f00b-e9ad-4e41-9f97-41aaf73a4fab admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:03.938684 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16f00b-e9ad-4e41-9f97-41aaf73a4fab admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:03.943526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada44a4-f725-43c6-be77-4e9d09be9b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:03.944499 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada44a4-f725-43c6-be77-4e9d09be9b5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:03.944783 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada44a4-f725-43c6-be77-4e9d09be9b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:03.945056 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada44a4-f725-43c6-be77-4e9d09be9b5d admin admin] PATH_INFO: `/v3/projects/34737e924b024803b8e3b8a279fcc906/users/c73ff5aa9b3f4fdeb593ecebe682cdda/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:03.947544 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada44a4-f725-43c6-be77-4e9d09be9b5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=34737e924b024803b8e3b8a279fcc906, user_id=c73ff5aa9b3f4fdeb593ecebe682cdda, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:03.950143 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada44a4-f725-43c6-be77-4e9d09be9b5d admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:03.960537 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 948/1887] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:59:03 2022] PUT /identity/v3/projects/34737e924b024803b8e3b8a279fcc906/users/c73ff5aa9b3f4fdeb593ecebe682cdda/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:03.971077 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de28cb-6db7-402b-8e33-a2fcd4a94c87 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:03.971366 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de28cb-6db7-402b-8e33-a2fcd4a94c87 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:03.971679 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de28cb-6db7-402b-8e33-a2fcd4a94c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:03.990072 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:03.998741 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-71de28cb-6db7-402b-8e33-a2fcd4a94c87 None None] MFA Rules not processed for user `c73ff5aa9b3f4fdeb593ecebe682cdda`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:03.999994 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-71de28cb-6db7-402b-8e33-a2fcd4a94c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:04.068104 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 940/1888] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:03 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:04.080316 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada44a4-f725-43c6-be77-4e9d09be9b5d admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:04.157420 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada44a4-f725-43c6-be77-4e9d09be9b5d admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:04.168350 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da621b-f089-49e8-9669-2a5fa3ab7da1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:04.169101 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da621b-f089-49e8-9669-2a5fa3ab7da1 service cinder] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:04.169513 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da621b-f089-49e8-9669-2a5fa3ab7da1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:04.169846 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da621b-f089-49e8-9669-2a5fa3ab7da1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:04.181426 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34da621b-f089-49e8-9669-2a5fa3ab7da1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:04.182982 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34da621b-f089-49e8-9669-2a5fa3ab7da1 service cinder] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:04.194462 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 949/1889] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:59:04 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:59:04.280592 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de28cb-6db7-402b-8e33-a2fcd4a94c87 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:04.282010 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-71de28cb-6db7-402b-8e33-a2fcd4a94c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:04.294071 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de28cb-6db7-402b-8e33-a2fcd4a94c87 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:04.297650 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a06c4d4-861b-4d34-84c0-da8105a1a69c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:04.298287 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06c4d4-861b-4d34-84c0-da8105a1a69c service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:04.298570 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06c4d4-861b-4d34-84c0-da8105a1a69c service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:04.298845 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06c4d4-861b-4d34-84c0-da8105a1a69c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:04.354196 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a06c4d4-861b-4d34-84c0-da8105a1a69c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:04.355596 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a06c4d4-861b-4d34-84c0-da8105a1a69c service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:04.364317 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 941/1890] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:59:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:59:04.624125 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da621b-f089-49e8-9669-2a5fa3ab7da1 service cinder] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:04.670323 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:04.690643 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da621b-f089-49e8-9669-2a5fa3ab7da1 service cinder] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:04.695249 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e926177-8f45-420a-a842-b7660288907d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:04.696148 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e926177-8f45-420a-a842-b7660288907d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:04.696427 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e926177-8f45-420a-a842-b7660288907d admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:04.696697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e926177-8f45-420a-a842-b7660288907d admin admin] PATH_INFO: `/v3/users/f1c6cc154c0046818a6d096b2473a29d` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:04.697872 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e926177-8f45-420a-a842-b7660288907d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1c6cc154c0046818a6d096b2473a29d)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:04.699835 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e926177-8f45-420a-a842-b7660288907d admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:04.750069 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-1e926177-8f45-420a-a842-b7660288907d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1c6cc154c0046818a6d096b2473a29d'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:04.751537 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-1e926177-8f45-420a-a842-b7660288907d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1c6cc154c0046818a6d096b2473a29d'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:04.765259 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-1e926177-8f45-420a-a842-b7660288907d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1c6cc154c0046818a6d096b2473a29d'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:04.772268 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-1e926177-8f45-420a-a842-b7660288907d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1c6cc154c0046818a6d096b2473a29d'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:04.782225 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-1e926177-8f45-420a-a842-b7660288907d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1c6cc154c0046818a6d096b2473a29d'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:04.788733 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 950/1891] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 11:59:04 2022] DELETE /identity/v3/users/f1c6cc154c0046818a6d096b2473a29d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:04.793857 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b96ff9-98db-4d16-88d0-591f38afb5cc None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:04.794357 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b96ff9-98db-4d16-88d0-591f38afb5cc None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:04.794460 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b96ff9-98db-4d16-88d0-591f38afb5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:04.814780 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-c7b96ff9-98db-4d16-88d0-591f38afb5cc None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:04.814780 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-c7b96ff9-98db-4d16-88d0-591f38afb5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:04.873790 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 942/1892] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:04.883514 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e926177-8f45-420a-a842-b7660288907d admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:04.884937 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-1e926177-8f45-420a-a842-b7660288907d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:04.948032 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e926177-8f45-420a-a842-b7660288907d admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:04.952350 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7fde1-da6f-41a3-b52e-2c58161254b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:04.953092 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7fde1-da6f-41a3-b52e-2c58161254b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:04.953343 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7fde1-da6f-41a3-b52e-2c58161254b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:04.953733 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7fde1-da6f-41a3-b52e-2c58161254b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:04.966353 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad7fde1-da6f-41a3-b52e-2c58161254b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:04.968015 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad7fde1-da6f-41a3-b52e-2c58161254b6 service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:04.980722 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 951/1893] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:59:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:59:05.485424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b96ff9-98db-4d16-88d0-591f38afb5cc None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:05.486944 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-c7b96ff9-98db-4d16-88d0-591f38afb5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:05.512025 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b96ff9-98db-4d16-88d0-591f38afb5cc None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:05.525035 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf776c11-bace-42ea-ac87-de3b9b21f505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:05.527308 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf776c11-bace-42ea-ac87-de3b9b21f505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:05.528916 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf776c11-bace-42ea-ac87-de3b9b21f505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:05.529221 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf776c11-bace-42ea-ac87-de3b9b21f505 admin admin] PATH_INFO: `/v3/projects/7417c8fada414d428b34723883faffc3` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:05.534282 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf776c11-bace-42ea-ac87-de3b9b21f505 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7417c8fada414d428b34723883faffc3)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:05.536019 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf776c11-bace-42ea-ac87-de3b9b21f505 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:05.603350 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:05.623274 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-bf776c11-bace-42ea-ac87-de3b9b21f505 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7417c8fada414d428b34723883faffc3', 'request_id': 'req-bf776c11-bace-42ea-ac87-de3b9b21f505'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:05.632447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-bf776c11-bace-42ea-ac87-de3b9b21f505 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7417c8fada414d428b34723883faffc3', 'request_id': 'req-bf776c11-bace-42ea-ac87-de3b9b21f505'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:05.642158 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-bf776c11-bace-42ea-ac87-de3b9b21f505 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7417c8fada414d428b34723883faffc3', 'request_id': 'req-bf776c11-bace-42ea-ac87-de3b9b21f505'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:05.658106 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-bf776c11-bace-42ea-ac87-de3b9b21f505 admin admin] The token cache is being invalidate because project 7417c8fada414d428b34723883faffc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 11:59:05.658564 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-bf776c11-bace-42ea-ac87-de3b9b21f505 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:05.659532 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-bf776c11-bace-42ea-ac87-de3b9b21f505 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:05.661296 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 943/1894] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 11:59:05 2022] DELETE /identity/v3/projects/7417c8fada414d428b34723883faffc3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:05.667272 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7fde1-da6f-41a3-b52e-2c58161254b6 service neutron] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:05.702721 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7fde1-da6f-41a3-b52e-2c58161254b6 service neutron] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:05.818175 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75bbcda-cb3b-497a-8844-5c9c16efd6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:05.819787 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bbcda-cb3b-497a-8844-5c9c16efd6a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:05.820909 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bbcda-cb3b-497a-8844-5c9c16efd6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:05.821467 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bbcda-cb3b-497a-8844-5c9c16efd6a1 admin admin] PATH_INFO: `/v3/users/c73ff5aa9b3f4fdeb593ecebe682cdda` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:05.822917 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75bbcda-cb3b-497a-8844-5c9c16efd6a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c73ff5aa9b3f4fdeb593ecebe682cdda)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:05.825520 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75bbcda-cb3b-497a-8844-5c9c16efd6a1 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:05.830992 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:05.903074 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-d75bbcda-cb3b-497a-8844-5c9c16efd6a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c73ff5aa9b3f4fdeb593ecebe682cdda'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:05.906260 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-d75bbcda-cb3b-497a-8844-5c9c16efd6a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c73ff5aa9b3f4fdeb593ecebe682cdda'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:05.920904 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-d75bbcda-cb3b-497a-8844-5c9c16efd6a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c73ff5aa9b3f4fdeb593ecebe682cdda'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:05.928837 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-d75bbcda-cb3b-497a-8844-5c9c16efd6a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c73ff5aa9b3f4fdeb593ecebe682cdda'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:05.939008 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-d75bbcda-cb3b-497a-8844-5c9c16efd6a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c73ff5aa9b3f4fdeb593ecebe682cdda'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:05.948519 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 952/1895] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 11:59:05 2022] DELETE /identity/v3/users/c73ff5aa9b3f4fdeb593ecebe682cdda => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:06.746271 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a7180-872f-4854-a842-c86704cadd90 None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:06.746271 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a7180-872f-4854-a842-c86704cadd90 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:06.746944 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a7180-872f-4854-a842-c86704cadd90 None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:06.749869 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 944/1896] 10.222.0.15 () {54 vars in 921 bytes} [Fri Jun 3 11:59:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 11:59:06.762291 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9bc021-91cf-4c18-83fb-9fdc9b4551c0 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:06.762596 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9bc021-91cf-4c18-83fb-9fdc9b4551c0 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:06.763061 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9bc021-91cf-4c18-83fb-9fdc9b4551c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:06.807107 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-3d9bc021-91cf-4c18-83fb-9fdc9b4551c0 None None] MFA Rules not processed for user `6247bfb7aebd45eeb97ba5933be44c6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:06.808463 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-3d9bc021-91cf-4c18-83fb-9fdc9b4551c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:06.975376 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a7180-872f-4854-a842-c86704cadd90 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:06.978192 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-966a7180-872f-4854-a842-c86704cadd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:07.018343 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 953/1897] 10.222.0.15 () {58 vars in 1018 bytes} [Fri Jun 3 11:59:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:07.049171 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9bc021-91cf-4c18-83fb-9fdc9b4551c0 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:07.052409 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-3d9bc021-91cf-4c18-83fb-9fdc9b4551c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:07.072657 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9bc021-91cf-4c18-83fb-9fdc9b4551c0 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:07.079161 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b0284-ee25-441a-b16e-f8f054ba094c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:07.079862 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b0284-ee25-441a-b16e-f8f054ba094c service nova] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:07.080144 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b0284-ee25-441a-b16e-f8f054ba094c service nova] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:07.080423 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b0284-ee25-441a-b16e-f8f054ba094c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:07.090215 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b0284-ee25-441a-b16e-f8f054ba094c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:07.092070 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b0284-ee25-441a-b16e-f8f054ba094c service nova] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:07.093234 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a7180-872f-4854-a842-c86704cadd90 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:07.102371 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f52bdf-d8a9-4e6a-ae64-2975533d129a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:07.103567 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f52bdf-d8a9-4e6a-ae64-2975533d129a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:07.104117 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f52bdf-d8a9-4e6a-ae64-2975533d129a admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:07.104721 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f52bdf-d8a9-4e6a-ae64-2975533d129a admin admin] PATH_INFO: `/v3/projects/34737e924b024803b8e3b8a279fcc906` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:07.105201 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 954/1898] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:59:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 11:59:07.106285 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f52bdf-d8a9-4e6a-ae64-2975533d129a admin admin] RBAC: Authorizing `identity:delete_project(project_id=34737e924b024803b8e3b8a279fcc906)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:07.108476 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f52bdf-d8a9-4e6a-ae64-2975533d129a admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:07.182105 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-f0f52bdf-d8a9-4e6a-ae64-2975533d129a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34737e924b024803b8e3b8a279fcc906', 'request_id': 'req-f0f52bdf-d8a9-4e6a-ae64-2975533d129a'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:07.197568 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-f0f52bdf-d8a9-4e6a-ae64-2975533d129a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34737e924b024803b8e3b8a279fcc906', 'request_id': 'req-f0f52bdf-d8a9-4e6a-ae64-2975533d129a'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:07.209463 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-f0f52bdf-d8a9-4e6a-ae64-2975533d129a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34737e924b024803b8e3b8a279fcc906', 'request_id': 'req-f0f52bdf-d8a9-4e6a-ae64-2975533d129a'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:07.222621 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-f0f52bdf-d8a9-4e6a-ae64-2975533d129a admin admin] The token cache is being invalidate because project 34737e924b024803b8e3b8a279fcc906 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 11:59:07.223000 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-f0f52bdf-d8a9-4e6a-ae64-2975533d129a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:07.223859 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-f0f52bdf-d8a9-4e6a-ae64-2975533d129a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:07.225810 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 945/1899] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 11:59:06 2022] DELETE /identity/v3/projects/34737e924b024803b8e3b8a279fcc906 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:07.230488 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccb229-92fc-46df-9287-26ae6761a664 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:07.230956 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccb229-92fc-46df-9287-26ae6761a664 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:07.231237 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccb229-92fc-46df-9287-26ae6761a664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:07.255361 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-27ccb229-92fc-46df-9287-26ae6761a664 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:07.259682 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-27ccb229-92fc-46df-9287-26ae6761a664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:07.278906 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f52bdf-d8a9-4e6a-ae64-2975533d129a admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:07.280644 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-f0f52bdf-d8a9-4e6a-ae64-2975533d129a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:07.324541 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 955/1900] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:07.332384 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cd124-b8d0-4b38-acc7-56a26acfde83 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:07.332760 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cd124-b8d0-4b38-acc7-56a26acfde83 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:07.333138 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cd124-b8d0-4b38-acc7-56a26acfde83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:07.339142 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:07.340081 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:07.353964 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-3c3cd124-b8d0-4b38-acc7-56a26acfde83 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:07.355177 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-3c3cd124-b8d0-4b38-acc7-56a26acfde83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:07.357041 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f52bdf-d8a9-4e6a-ae64-2975533d129a admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:07.363255 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 956/1901] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 11:59:07.363420 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17061559-1102-494c-9e62-c5a181e96d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:07.364368 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17061559-1102-494c-9e62-c5a181e96d2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:07.364655 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17061559-1102-494c-9e62-c5a181e96d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:07.364930 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17061559-1102-494c-9e62-c5a181e96d2e admin admin] PATH_INFO: `/v3/users/c15b2e8ed3fe4d7bbecfdcda2a90b1d2` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:07.366296 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17061559-1102-494c-9e62-c5a181e96d2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c15b2e8ed3fe4d7bbecfdcda2a90b1d2)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:07.367590 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3cd124-b8d0-4b38-acc7-56a26acfde83 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:07.368782 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17061559-1102-494c-9e62-c5a181e96d2e admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:07.368897 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-3c3cd124-b8d0-4b38-acc7-56a26acfde83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:07.380395 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3cd124-b8d0-4b38-acc7-56a26acfde83 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:07.386101 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c32aa3-cb3b-48cf-8911-bb62ef695297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:07.387014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c32aa3-cb3b-48cf-8911-bb62ef695297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:07.387296 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c32aa3-cb3b-48cf-8911-bb62ef695297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:07.387604 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c32aa3-cb3b-48cf-8911-bb62ef695297 admin admin] PATH_INFO: `/v3/users/6e9ec124d3854b8eaaf5a779cf9b79b3` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:07.388829 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c32aa3-cb3b-48cf-8911-bb62ef695297 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e9ec124d3854b8eaaf5a779cf9b79b3)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:07.390755 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c32aa3-cb3b-48cf-8911-bb62ef695297 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:07.431703 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-17061559-1102-494c-9e62-c5a181e96d2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c15b2e8ed3fe4d7bbecfdcda2a90b1d2'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:07.440036 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-17061559-1102-494c-9e62-c5a181e96d2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c15b2e8ed3fe4d7bbecfdcda2a90b1d2'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:07.440837 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-17061559-1102-494c-9e62-c5a181e96d2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c15b2e8ed3fe4d7bbecfdcda2a90b1d2'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:07.453583 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-14c32aa3-cb3b-48cf-8911-bb62ef695297 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e9ec124d3854b8eaaf5a779cf9b79b3'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:07.454363 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-14c32aa3-cb3b-48cf-8911-bb62ef695297 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e9ec124d3854b8eaaf5a779cf9b79b3'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:07.456997 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-17061559-1102-494c-9e62-c5a181e96d2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c15b2e8ed3fe4d7bbecfdcda2a90b1d2'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:07.468957 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-17061559-1102-494c-9e62-c5a181e96d2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c15b2e8ed3fe4d7bbecfdcda2a90b1d2'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:07.475607 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-14c32aa3-cb3b-48cf-8911-bb62ef695297 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e9ec124d3854b8eaaf5a779cf9b79b3'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:07.479492 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 946/1902] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 11:59:07 2022] DELETE /identity/v3/users/c15b2e8ed3fe4d7bbecfdcda2a90b1d2 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 11:59:07.479492 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17061559-1102-494c-9e62-c5a181e96d2e admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:07.479492 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-17061559-1102-494c-9e62-c5a181e96d2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:07.488710 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-14c32aa3-cb3b-48cf-8911-bb62ef695297 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e9ec124d3854b8eaaf5a779cf9b79b3'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:07.503463 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-14c32aa3-cb3b-48cf-8911-bb62ef695297 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e9ec124d3854b8eaaf5a779cf9b79b3'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:07.510467 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 957/1903] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 11:59:07 2022] DELETE /identity/v3/users/6e9ec124d3854b8eaaf5a779cf9b79b3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:07.511800 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc8a9b-c52d-42a5-ba59-01c8eefdc83b None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:07.512101 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc8a9b-c52d-42a5-ba59-01c8eefdc83b None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:07.512382 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc8a9b-c52d-42a5-ba59-01c8eefdc83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:07.530705 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-f3dc8a9b-c52d-42a5-ba59-01c8eefdc83b None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:07.531948 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-f3dc8a9b-c52d-42a5-ba59-01c8eefdc83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:07.549284 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17061559-1102-494c-9e62-c5a181e96d2e admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:07.596227 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 958/1904] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:07.597508 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030847b-20ec-440d-bff2-1441d57e9aaa None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:07.599467 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030847b-20ec-440d-bff2-1441d57e9aaa None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:07.599467 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030847b-20ec-440d-bff2-1441d57e9aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:07.619414 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-d030847b-20ec-440d-bff2-1441d57e9aaa None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:07.620587 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-d030847b-20ec-440d-bff2-1441d57e9aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:07.622753 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ca266-614a-474f-805d-e232a8a25efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:07.623523 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ca266-614a-474f-805d-e232a8a25efb admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:07.623911 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ca266-614a-474f-805d-e232a8a25efb admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:07.624270 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ca266-614a-474f-805d-e232a8a25efb admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:07.625098 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8ca266-614a-474f-805d-e232a8a25efb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:59:07.625484 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8ca266-614a-474f-805d-e232a8a25efb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:07.627283 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8ca266-614a-474f-805d-e232a8a25efb admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:07.629425 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 959/1905] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:07.630287 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030847b-20ec-440d-bff2-1441d57e9aaa None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:07.632065 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-d030847b-20ec-440d-bff2-1441d57e9aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:07.642299 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 947/1906] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 11:59:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:59:07.644424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ca266-614a-474f-805d-e232a8a25efb admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:07.646396 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-5c8ca266-614a-474f-805d-e232a8a25efb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:07.658671 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:07.702996 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030847b-20ec-440d-bff2-1441d57e9aaa None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:07.707118 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde12ce-58da-42bc-b34e-9831e56111e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:07.708064 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde12ce-58da-42bc-b34e-9831e56111e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:07.708333 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde12ce-58da-42bc-b34e-9831e56111e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:07.708613 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde12ce-58da-42bc-b34e-9831e56111e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:07.717626 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ca266-614a-474f-805d-e232a8a25efb admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:07.719197 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde12ce-58da-42bc-b34e-9831e56111e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:07.720573 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde12ce-58da-42bc-b34e-9831e56111e1 service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:07.722473 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10449115-800c-4f3b-bbcc-e5403acd14ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:07.723052 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10449115-800c-4f3b-bbcc-e5403acd14ad service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:07.723407 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10449115-800c-4f3b-bbcc-e5403acd14ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:07.723694 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10449115-800c-4f3b-bbcc-e5403acd14ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:07.732980 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 960/1907] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:59:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:59:07.733809 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde12ce-58da-42bc-b34e-9831e56111e1 service neutron] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:07.736763 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-5dde12ce-58da-42bc-b34e-9831e56111e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:07.739313 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10449115-800c-4f3b-bbcc-e5403acd14ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:07.742514 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10449115-800c-4f3b-bbcc-e5403acd14ad service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:07.755755 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:07.761406 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 948/1908] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:59:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:59:07.764338 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde12ce-58da-42bc-b34e-9831e56111e1 service neutron] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:07.772669 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e01fe8-6d7a-4a9f-99fd-af0c755a7f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:07.774152 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e01fe8-6d7a-4a9f-99fd-af0c755a7f36 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:07.774441 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e01fe8-6d7a-4a9f-99fd-af0c755a7f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:07.774715 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e01fe8-6d7a-4a9f-99fd-af0c755a7f36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:07.775478 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e01fe8-6d7a-4a9f-99fd-af0c755a7f36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:07.778324 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e01fe8-6d7a-4a9f-99fd-af0c755a7f36 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:07.812805 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 961/1909] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:59:07 2022] POST /identity/v3/projects => generated 385 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:59:07.814011 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10449115-800c-4f3b-bbcc-e5403acd14ad service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:07.825550 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10449115-800c-4f3b-bbcc-e5403acd14ad service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:07.896278 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb6a6c-fdf1-4341-94e8-8878018095d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:07.897225 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb6a6c-fdf1-4341-94e8-8878018095d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:07.898597 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb6a6c-fdf1-4341-94e8-8878018095d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:07.899102 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb6a6c-fdf1-4341-94e8-8878018095d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:07.899968 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb6a6c-fdf1-4341-94e8-8878018095d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:07.902245 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb6a6c-fdf1-4341-94e8-8878018095d5 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:07.928313 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 949/1910] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:59:07 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:59:07.932792 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e01fe8-6d7a-4a9f-99fd-af0c755a7f36 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:07.945191 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e01fe8-6d7a-4a9f-99fd-af0c755a7f36 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:07.950356 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7349c9-f0eb-47ce-80ee-4a9660bb7bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:07.951063 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7349c9-f0eb-47ce-80ee-4a9660bb7bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:07.951342 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7349c9-f0eb-47ce-80ee-4a9660bb7bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:07.951662 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7349c9-f0eb-47ce-80ee-4a9660bb7bb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:07.952556 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7349c9-f0eb-47ce-80ee-4a9660bb7bb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:07.954046 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7349c9-f0eb-47ce-80ee-4a9660bb7bb4 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:07.970007 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 962/1911] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:59:07.972390 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb6a6c-fdf1-4341-94e8-8878018095d5 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:08.002148 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb6a6c-fdf1-4341-94e8-8878018095d5 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:08.018619 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf975bbf-639b-4de5-aab9-c0222bd7cf39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:08.019599 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf975bbf-639b-4de5-aab9-c0222bd7cf39 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:08.019987 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf975bbf-639b-4de5-aab9-c0222bd7cf39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:08.020363 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf975bbf-639b-4de5-aab9-c0222bd7cf39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:08.021970 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf975bbf-639b-4de5-aab9-c0222bd7cf39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:08.027528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf975bbf-639b-4de5-aab9-c0222bd7cf39 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:08.059064 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 950/1912] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:59:08.060794 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7349c9-f0eb-47ce-80ee-4a9660bb7bb4 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:08.071306 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7349c9-f0eb-47ce-80ee-4a9660bb7bb4 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:08.077913 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e286a-deda-4e9f-b568-8f09c73abf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:08.078815 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e286a-deda-4e9f-b568-8f09c73abf3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:08.079124 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e286a-deda-4e9f-b568-8f09c73abf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:08.079360 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e286a-deda-4e9f-b568-8f09c73abf3f admin admin] PATH_INFO: `/v3/projects/4c6392bea30c46109807845b269614e8/users/8c37523b770c41799670f463dec3f22c/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:08.099424 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e286a-deda-4e9f-b568-8f09c73abf3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c6392bea30c46109807845b269614e8, user_id=8c37523b770c41799670f463dec3f22c, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:08.103142 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e286a-deda-4e9f-b568-8f09c73abf3f admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:08.126588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 963/1913] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:59:08 2022] PUT /identity/v3/projects/4c6392bea30c46109807845b269614e8/users/8c37523b770c41799670f463dec3f22c/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 11:59:08.138369 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd20d0-b048-4751-8a98-cc3dc76e5656 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:08.138724 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd20d0-b048-4751-8a98-cc3dc76e5656 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:08.140152 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd20d0-b048-4751-8a98-cc3dc76e5656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:08.171280 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-9dfd20d0-b048-4751-8a98-cc3dc76e5656 None None] MFA Rules not processed for user `8c37523b770c41799670f463dec3f22c`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:08.172571 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-9dfd20d0-b048-4751-8a98-cc3dc76e5656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:08.260344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e286a-deda-4e9f-b568-8f09c73abf3f admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:08.264961 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-7b4e286a-deda-4e9f-b568-8f09c73abf3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:08.316468 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 951/1914] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:08.317525 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd20d0-b048-4751-8a98-cc3dc76e5656 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:08.318888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-9dfd20d0-b048-4751-8a98-cc3dc76e5656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:08.380640 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:08.399239 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e286a-deda-4e9f-b568-8f09c73abf3f admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:08.404531 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ffd38-f3d0-460d-ace3-6f3c3b106af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:08.405510 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ffd38-f3d0-460d-ace3-6f3c3b106af6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:08.405869 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ffd38-f3d0-460d-ace3-6f3c3b106af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:08.406223 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ffd38-f3d0-460d-ace3-6f3c3b106af6 admin admin] PATH_INFO: `/v3/projects/a7fab1eb55264eec83f24ebcc49fd2d4` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:08.407792 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ffd38-f3d0-460d-ace3-6f3c3b106af6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7fab1eb55264eec83f24ebcc49fd2d4)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:08.409861 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ffd38-f3d0-460d-ace3-6f3c3b106af6 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:08.455876 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd20d0-b048-4751-8a98-cc3dc76e5656 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:08.472036 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-2c2ffd38-f3d0-460d-ace3-6f3c3b106af6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7fab1eb55264eec83f24ebcc49fd2d4', 'request_id': 'req-2c2ffd38-f3d0-460d-ace3-6f3c3b106af6'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:08.479245 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-2c2ffd38-f3d0-460d-ace3-6f3c3b106af6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7fab1eb55264eec83f24ebcc49fd2d4', 'request_id': 'req-2c2ffd38-f3d0-460d-ace3-6f3c3b106af6'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:08.489948 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-2c2ffd38-f3d0-460d-ace3-6f3c3b106af6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7fab1eb55264eec83f24ebcc49fd2d4', 'request_id': 'req-2c2ffd38-f3d0-460d-ace3-6f3c3b106af6'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:08.517686 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-2c2ffd38-f3d0-460d-ace3-6f3c3b106af6 admin admin] The token cache is being invalidate because project a7fab1eb55264eec83f24ebcc49fd2d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 11:59:08.518575 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-2c2ffd38-f3d0-460d-ace3-6f3c3b106af6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:08.520111 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-2c2ffd38-f3d0-460d-ace3-6f3c3b106af6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:08.524504 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 964/1915] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 11:59:08 2022] DELETE /identity/v3/projects/a7fab1eb55264eec83f24ebcc49fd2d4 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 11:59:08.525510 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ffd38-f3d0-460d-ace3-6f3c3b106af6 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:08.528342 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-2c2ffd38-f3d0-460d-ace3-6f3c3b106af6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:08.538397 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58faac46-79a1-4352-8203-d2a741882851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:08.539304 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58faac46-79a1-4352-8203-d2a741882851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:08.539620 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58faac46-79a1-4352-8203-d2a741882851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:08.539897 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58faac46-79a1-4352-8203-d2a741882851 admin admin] PATH_INFO: `/v3/projects/6b5c7a0f5c8b454fa385da0712649ddb` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:08.541101 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58faac46-79a1-4352-8203-d2a741882851 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b5c7a0f5c8b454fa385da0712649ddb)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:08.543348 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58faac46-79a1-4352-8203-d2a741882851 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:08.604239 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:08.609826 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-58faac46-79a1-4352-8203-d2a741882851 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b5c7a0f5c8b454fa385da0712649ddb', 'request_id': 'req-58faac46-79a1-4352-8203-d2a741882851'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:08.619430 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-58faac46-79a1-4352-8203-d2a741882851 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b5c7a0f5c8b454fa385da0712649ddb', 'request_id': 'req-58faac46-79a1-4352-8203-d2a741882851'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:08.627882 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ffd38-f3d0-460d-ace3-6f3c3b106af6 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:08.630651 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-58faac46-79a1-4352-8203-d2a741882851 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b5c7a0f5c8b454fa385da0712649ddb', 'request_id': 'req-58faac46-79a1-4352-8203-d2a741882851'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:08.650118 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-58faac46-79a1-4352-8203-d2a741882851 admin admin] The token cache is being invalidate because project 6b5c7a0f5c8b454fa385da0712649ddb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 11:59:08.650560 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-58faac46-79a1-4352-8203-d2a741882851 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:08.651248 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-58faac46-79a1-4352-8203-d2a741882851 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:08.654552 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 952/1916] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 11:59:08 2022] DELETE /identity/v3/projects/6b5c7a0f5c8b454fa385da0712649ddb => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:08.655195 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58faac46-79a1-4352-8203-d2a741882851 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:08.656579 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-58faac46-79a1-4352-8203-d2a741882851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:08.707264 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2cd4b-0819-437b-bd48-3e9f880e8c30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:08.708116 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2cd4b-0819-437b-bd48-3e9f880e8c30 service cinder] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:08.708505 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2cd4b-0819-437b-bd48-3e9f880e8c30 service cinder] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:08.709021 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2cd4b-0819-437b-bd48-3e9f880e8c30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:08.711277 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-9ee2cd4b-0819-437b-bd48-3e9f880e8c30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:08.733578 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:08.738082 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58faac46-79a1-4352-8203-d2a741882851 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:08.747416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae13c3-78e2-43f4-9efa-de758c4370aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:08.748536 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae13c3-78e2-43f4-9efa-de758c4370aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:08.749186 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae13c3-78e2-43f4-9efa-de758c4370aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:08.749582 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae13c3-78e2-43f4-9efa-de758c4370aa admin admin] PATH_INFO: `/v3/users/fa70a428161047a19385dee3a01a721d` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:08.751224 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae13c3-78e2-43f4-9efa-de758c4370aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa70a428161047a19385dee3a01a721d)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:08.753241 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae13c3-78e2-43f4-9efa-de758c4370aa admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:08.782727 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2cd4b-0819-437b-bd48-3e9f880e8c30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:08.784257 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2cd4b-0819-437b-bd48-3e9f880e8c30 service cinder] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:08.795033 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 965/1917] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:59:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:59:08.795846 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2cd4b-0819-437b-bd48-3e9f880e8c30 service cinder] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:08.797490 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-9ee2cd4b-0819-437b-bd48-3e9f880e8c30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:08.806023 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-d6ae13c3-78e2-43f4-9efa-de758c4370aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa70a428161047a19385dee3a01a721d'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:08.814338 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-d6ae13c3-78e2-43f4-9efa-de758c4370aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa70a428161047a19385dee3a01a721d'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:08.814850 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2cd4b-0819-437b-bd48-3e9f880e8c30 service cinder] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:08.815229 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-d6ae13c3-78e2-43f4-9efa-de758c4370aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa70a428161047a19385dee3a01a721d'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:08.822084 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ebdf8-f7ae-42e8-a0c6-62fa4d5410c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:08.822959 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ebdf8-f7ae-42e8-a0c6-62fa4d5410c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:08.823242 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ebdf8-f7ae-42e8-a0c6-62fa4d5410c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:08.823541 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ebdf8-f7ae-42e8-a0c6-62fa4d5410c7 admin admin] PATH_INFO: `/v3/users/e5fa2e63d64d4f88a0474814dcfbad8a` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:08.824997 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ebdf8-f7ae-42e8-a0c6-62fa4d5410c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5fa2e63d64d4f88a0474814dcfbad8a)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:08.826897 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ebdf8-f7ae-42e8-a0c6-62fa4d5410c7 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:08.831528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-d6ae13c3-78e2-43f4-9efa-de758c4370aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa70a428161047a19385dee3a01a721d'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:08.841089 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-d6ae13c3-78e2-43f4-9efa-de758c4370aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa70a428161047a19385dee3a01a721d'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:08.847740 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 953/1918] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 11:59:08 2022] DELETE /identity/v3/users/fa70a428161047a19385dee3a01a721d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:08.887795 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-1b0ebdf8-f7ae-42e8-a0c6-62fa4d5410c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5fa2e63d64d4f88a0474814dcfbad8a'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:08.890383 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-1b0ebdf8-f7ae-42e8-a0c6-62fa4d5410c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5fa2e63d64d4f88a0474814dcfbad8a'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:08.908647 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-1b0ebdf8-f7ae-42e8-a0c6-62fa4d5410c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5fa2e63d64d4f88a0474814dcfbad8a'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:08.930373 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-1b0ebdf8-f7ae-42e8-a0c6-62fa4d5410c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5fa2e63d64d4f88a0474814dcfbad8a'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:08.939709 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-1b0ebdf8-f7ae-42e8-a0c6-62fa4d5410c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5fa2e63d64d4f88a0474814dcfbad8a'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:08.951385 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 966/1919] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 11:59:08 2022] DELETE /identity/v3/users/e5fa2e63d64d4f88a0474814dcfbad8a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:09.424428 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae13c3-78e2-43f4-9efa-de758c4370aa admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:09.426184 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-d6ae13c3-78e2-43f4-9efa-de758c4370aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:09.512395 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae13c3-78e2-43f4-9efa-de758c4370aa admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:09.588279 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4fef3-7b1f-41b9-9796-3da944e6d90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:09.589150 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4fef3-7b1f-41b9-9796-3da944e6d90b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:09.589434 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4fef3-7b1f-41b9-9796-3da944e6d90b admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:09.589712 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4fef3-7b1f-41b9-9796-3da944e6d90b admin admin] PATH_INFO: `/v3/projects/a9e9690a166145218098f30569c48b5b` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:09.591725 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b4fef3-7b1f-41b9-9796-3da944e6d90b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9e9690a166145218098f30569c48b5b)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:09.593854 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b4fef3-7b1f-41b9-9796-3da944e6d90b admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:09.638331 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:09.671631 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-b8b4fef3-7b1f-41b9-9796-3da944e6d90b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9e9690a166145218098f30569c48b5b', 'request_id': 'req-b8b4fef3-7b1f-41b9-9796-3da944e6d90b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:09.682664 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-b8b4fef3-7b1f-41b9-9796-3da944e6d90b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9e9690a166145218098f30569c48b5b', 'request_id': 'req-b8b4fef3-7b1f-41b9-9796-3da944e6d90b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:09.690125 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ebdf8-f7ae-42e8-a0c6-62fa4d5410c7 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:09.691772 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-1b0ebdf8-f7ae-42e8-a0c6-62fa4d5410c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:09.699293 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-b8b4fef3-7b1f-41b9-9796-3da944e6d90b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9e9690a166145218098f30569c48b5b', 'request_id': 'req-b8b4fef3-7b1f-41b9-9796-3da944e6d90b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:09.717060 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ebdf8-f7ae-42e8-a0c6-62fa4d5410c7 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:09.717559 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-b8b4fef3-7b1f-41b9-9796-3da944e6d90b admin admin] The token cache is being invalidate because project a9e9690a166145218098f30569c48b5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 11:59:09.717797 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-b8b4fef3-7b1f-41b9-9796-3da944e6d90b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:09.718465 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-b8b4fef3-7b1f-41b9-9796-3da944e6d90b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:09.721118 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 954/1920] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 11:59:09 2022] DELETE /identity/v3/projects/a9e9690a166145218098f30569c48b5b => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:09.722304 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4fef3-7b1f-41b9-9796-3da944e6d90b admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:09.723985 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-b8b4fef3-7b1f-41b9-9796-3da944e6d90b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:09.737383 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:09.803191 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf0d09-20d4-4360-8615-89dab235e457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:09.804349 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf0d09-20d4-4360-8615-89dab235e457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:09.804720 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf0d09-20d4-4360-8615-89dab235e457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:09.805051 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf0d09-20d4-4360-8615-89dab235e457 admin admin] PATH_INFO: `/v3/projects/e507050831e4497489e7001f796ef3a6` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:09.806636 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf0d09-20d4-4360-8615-89dab235e457 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e507050831e4497489e7001f796ef3a6)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:09.809522 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf0d09-20d4-4360-8615-89dab235e457 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:09.822285 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4fef3-7b1f-41b9-9796-3da944e6d90b admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:09.827562 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2017af-c59e-4598-a08e-6d101ce5891f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:09.829179 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2017af-c59e-4598-a08e-6d101ce5891f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:09.829539 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2017af-c59e-4598-a08e-6d101ce5891f admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:09.829883 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2017af-c59e-4598-a08e-6d101ce5891f admin admin] PATH_INFO: `/v3/users/d72ae65a9faa4b719b4343e83051cdd1` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:09.831787 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2017af-c59e-4598-a08e-6d101ce5891f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d72ae65a9faa4b719b4343e83051cdd1)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:09.843389 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2017af-c59e-4598-a08e-6d101ce5891f admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:09.880054 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-a9cf0d09-20d4-4360-8615-89dab235e457 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e507050831e4497489e7001f796ef3a6', 'request_id': 'req-a9cf0d09-20d4-4360-8615-89dab235e457'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:09.888049 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-a9cf0d09-20d4-4360-8615-89dab235e457 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e507050831e4497489e7001f796ef3a6', 'request_id': 'req-a9cf0d09-20d4-4360-8615-89dab235e457'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:09.901088 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-9a2017af-c59e-4598-a08e-6d101ce5891f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd72ae65a9faa4b719b4343e83051cdd1'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:09.908646 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-a9cf0d09-20d4-4360-8615-89dab235e457 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e507050831e4497489e7001f796ef3a6', 'request_id': 'req-a9cf0d09-20d4-4360-8615-89dab235e457'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:09.916616 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-9a2017af-c59e-4598-a08e-6d101ce5891f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd72ae65a9faa4b719b4343e83051cdd1'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:09.917655 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-9a2017af-c59e-4598-a08e-6d101ce5891f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd72ae65a9faa4b719b4343e83051cdd1'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:09.926846 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-a9cf0d09-20d4-4360-8615-89dab235e457 admin admin] The token cache is being invalidate because project e507050831e4497489e7001f796ef3a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 11:59:09.927356 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-a9cf0d09-20d4-4360-8615-89dab235e457 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:09.928255 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-a9cf0d09-20d4-4360-8615-89dab235e457 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:09.930211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 967/1921] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 11:59:09 2022] DELETE /identity/v3/projects/e507050831e4497489e7001f796ef3a6 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 11:59:09.931581 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa5b79-a0fd-48d8-8845-1d29a42c78d1 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:09.931944 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa5b79-a0fd-48d8-8845-1d29a42c78d1 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:09.932294 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa5b79-a0fd-48d8-8845-1d29a42c78d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:09.939626 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-9a2017af-c59e-4598-a08e-6d101ce5891f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd72ae65a9faa4b719b4343e83051cdd1'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:09.949763 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-9a2017af-c59e-4598-a08e-6d101ce5891f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd72ae65a9faa4b719b4343e83051cdd1'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:09.954046 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-1efa5b79-a0fd-48d8-8845-1d29a42c78d1 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:09.955330 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-1efa5b79-a0fd-48d8-8845-1d29a42c78d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:09.956539 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 955/1922] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 11:59:09 2022] DELETE /identity/v3/users/d72ae65a9faa4b719b4343e83051cdd1 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:09.957796 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686582b9-21f5-45fc-b2d8-d017f2450cff None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:09.958234 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686582b9-21f5-45fc-b2d8-d017f2450cff None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:09.958633 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686582b9-21f5-45fc-b2d8-d017f2450cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:09.977110 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-686582b9-21f5-45fc-b2d8-d017f2450cff None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:09.978319 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-686582b9-21f5-45fc-b2d8-d017f2450cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:10.009070 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:10.020169 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 968/1923] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:10.021741 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb2605-e927-44ba-b5b8-564a50831382 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:10.022188 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb2605-e927-44ba-b5b8-564a50831382 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:10.022733 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb2605-e927-44ba-b5b8-564a50831382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:10.040930 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-00fb2605-e927-44ba-b5b8-564a50831382 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:10.042330 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-00fb2605-e927-44ba-b5b8-564a50831382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:10.047958 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 956/1924] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:10.047958 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f33d7-d92b-4ef6-95a9-6a3f5c90d604 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:10.047958 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f33d7-d92b-4ef6-95a9-6a3f5c90d604 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:10.047958 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f33d7-d92b-4ef6-95a9-6a3f5c90d604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:10.060953 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 969/1925] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:10.064144 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce7e76-10a5-433b-ba4c-51c1e7f75189 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:10.064144 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce7e76-10a5-433b-ba4c-51c1e7f75189 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:10.064144 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce7e76-10a5-433b-ba4c-51c1e7f75189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:10.065164 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-c48f33d7-d92b-4ef6-95a9-6a3f5c90d604 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:10.065939 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-c48f33d7-d92b-4ef6-95a9-6a3f5c90d604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:10.075268 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 957/1926] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:10.076333 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f33d7-d92b-4ef6-95a9-6a3f5c90d604 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:10.079264 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-c48f33d7-d92b-4ef6-95a9-6a3f5c90d604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:10.084153 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-22ce7e76-10a5-433b-ba4c-51c1e7f75189 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:10.085327 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-22ce7e76-10a5-433b-ba4c-51c1e7f75189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:10.093550 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 970/1927] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:10.094174 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce7e76-10a5-433b-ba4c-51c1e7f75189 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:10.103897 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce7e76-10a5-433b-ba4c-51c1e7f75189 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:10.108620 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac0ae7-2d57-4422-85f8-1397c5b38609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:10.109323 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac0ae7-2d57-4422-85f8-1397c5b38609 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:10.109607 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac0ae7-2d57-4422-85f8-1397c5b38609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:10.109888 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac0ae7-2d57-4422-85f8-1397c5b38609 admin admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:10.110665 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ac0ae7-2d57-4422-85f8-1397c5b38609 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:59:10.110957 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ac0ae7-2d57-4422-85f8-1397c5b38609 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:10.112596 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ac0ae7-2d57-4422-85f8-1397c5b38609 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:10.124857 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 971/1928] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 11:59:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:59:10.128763 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac0ae7-2d57-4422-85f8-1397c5b38609 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:10.138879 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac0ae7-2d57-4422-85f8-1397c5b38609 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:10.140347 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f33d7-d92b-4ef6-95a9-6a3f5c90d604 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:10.143895 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff0b23-7881-4c82-8df6-dbf4148ad4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:10.144543 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff0b23-7881-4c82-8df6-dbf4148ad4c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:10.144807 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea866355-3d69-4326-842c-a0da73fcc278 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:10.144977 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff0b23-7881-4c82-8df6-dbf4148ad4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:10.145103 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff0b23-7881-4c82-8df6-dbf4148ad4c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:10.145609 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea866355-3d69-4326-842c-a0da73fcc278 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:10.145803 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff0b23-7881-4c82-8df6-dbf4148ad4c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:59:10.146063 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea866355-3d69-4326-842c-a0da73fcc278 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:10.146229 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff0b23-7881-4c82-8df6-dbf4148ad4c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:10.146369 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea866355-3d69-4326-842c-a0da73fcc278 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:10.148268 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff0b23-7881-4c82-8df6-dbf4148ad4c5 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:10.156666 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea866355-3d69-4326-842c-a0da73fcc278 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:10.158116 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea866355-3d69-4326-842c-a0da73fcc278 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:10.164126 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 972/1929] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 11:59:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:59:10.164126 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff0b23-7881-4c82-8df6-dbf4148ad4c5 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:10.168619 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 958/1930] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:59:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:59:10.169402 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea866355-3d69-4326-842c-a0da73fcc278 service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:10.173379 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff0b23-7881-4c82-8df6-dbf4148ad4c5 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:10.178973 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea866355-3d69-4326-842c-a0da73fcc278 service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:10.183235 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e1a7c6-9875-412e-b65c-e891f6226c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:10.184178 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1a7c6-9875-412e-b65c-e891f6226c01 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:10.184822 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1a7c6-9875-412e-b65c-e891f6226c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:10.184822 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1a7c6-9875-412e-b65c-e891f6226c01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:10.185476 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e1a7c6-9875-412e-b65c-e891f6226c01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:10.186177 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea84718-c730-4015-84dd-1422f5005500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:10.186376 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea84718-c730-4015-84dd-1422f5005500 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:10.186659 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea84718-c730-4015-84dd-1422f5005500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:10.186991 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea84718-c730-4015-84dd-1422f5005500 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:10.187569 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e1a7c6-9875-412e-b65c-e891f6226c01 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:10.187681 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea84718-c730-4015-84dd-1422f5005500 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:10.189517 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea84718-c730-4015-84dd-1422f5005500 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:10.197771 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:10.220837 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 973/1931] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:59:10 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:59:10.224651 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e1a7c6-9875-412e-b65c-e891f6226c01 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:10.231205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 959/1932] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:59:10 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:59:10.236112 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea84718-c730-4015-84dd-1422f5005500 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:10.310418 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e1a7c6-9875-412e-b65c-e891f6226c01 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:10.339372 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea84718-c730-4015-84dd-1422f5005500 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:10.349111 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fabbcd-08fe-4b60-bd65-2e3824c8420e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:10.350522 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fabbcd-08fe-4b60-bd65-2e3824c8420e admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:10.350965 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fabbcd-08fe-4b60-bd65-2e3824c8420e admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:10.351705 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fabbcd-08fe-4b60-bd65-2e3824c8420e admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:10.352541 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fabbcd-08fe-4b60-bd65-2e3824c8420e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:10.358115 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fabbcd-08fe-4b60-bd65-2e3824c8420e admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:10.384226 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bcd36b-1a08-40e4-8adb-a8040badc56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:10.387898 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 960/1933] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:59:10 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:59:10.388237 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bcd36b-1a08-40e4-8adb-a8040badc56c admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:10.388237 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bcd36b-1a08-40e4-8adb-a8040badc56c admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:10.388237 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bcd36b-1a08-40e4-8adb-a8040badc56c admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:10.388237 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bcd36b-1a08-40e4-8adb-a8040badc56c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:10.389428 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bcd36b-1a08-40e4-8adb-a8040badc56c admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:10.389707 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fabbcd-08fe-4b60-bd65-2e3824c8420e admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:10.403567 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fabbcd-08fe-4b60-bd65-2e3824c8420e admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:10.409518 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc193d4-f55d-44b7-86ff-feb58801a59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:10.410397 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc193d4-f55d-44b7-86ff-feb58801a59d admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:10.410829 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc193d4-f55d-44b7-86ff-feb58801a59d admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:10.411619 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc193d4-f55d-44b7-86ff-feb58801a59d admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:10.412617 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc193d4-f55d-44b7-86ff-feb58801a59d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:10.414989 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc193d4-f55d-44b7-86ff-feb58801a59d admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:10.423091 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 974/1934] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:59:10 2022] POST /identity/v3/users => generated 292 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 11:59:10.427530 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bcd36b-1a08-40e4-8adb-a8040badc56c admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:10.440936 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 961/1935] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:10 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 11:59:10.441634 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc193d4-f55d-44b7-86ff-feb58801a59d admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:10.451820 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bcd36b-1a08-40e4-8adb-a8040badc56c admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:10.461456 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cbf66-634a-4a5b-8390-e82e14440774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:10.463529 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cbf66-634a-4a5b-8390-e82e14440774 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:10.463821 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cbf66-634a-4a5b-8390-e82e14440774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:10.464100 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cbf66-634a-4a5b-8390-e82e14440774 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:10.465050 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc193d4-f55d-44b7-86ff-feb58801a59d admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:10.467462 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9cbf66-634a-4a5b-8390-e82e14440774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:10.469865 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9cbf66-634a-4a5b-8390-e82e14440774 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:10.475402 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23976a8f-16bb-4e2a-9e45-8073f52d6f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:10.477553 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23976a8f-16bb-4e2a-9e45-8073f52d6f0d admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:10.478027 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23976a8f-16bb-4e2a-9e45-8073f52d6f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:10.478486 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23976a8f-16bb-4e2a-9e45-8073f52d6f0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:10.479922 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23976a8f-16bb-4e2a-9e45-8073f52d6f0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:10.483183 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23976a8f-16bb-4e2a-9e45-8073f52d6f0d admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:10.490892 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 975/1936] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:10 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 11:59:10.497244 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cbf66-634a-4a5b-8390-e82e14440774 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:10.504796 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 962/1937] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:10 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:59:10.509575 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23976a8f-16bb-4e2a-9e45-8073f52d6f0d admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:10.517080 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cbf66-634a-4a5b-8390-e82e14440774 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:10.524572 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23976a8f-16bb-4e2a-9e45-8073f52d6f0d admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:10.532106 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c703b-f322-4893-8504-037865a87528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:10.533224 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c703b-f322-4893-8504-037865a87528 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:10.533649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c703b-f322-4893-8504-037865a87528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:10.533965 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f4979-5839-43f7-8d1d-910708b20174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:10.534294 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c703b-f322-4893-8504-037865a87528 admin admin] PATH_INFO: `/v3/projects/b14ba37d88b64bcb913b3b16b8826056/users/be7ef47c70264285b1da8157868df3d7/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:10.535150 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f4979-5839-43f7-8d1d-910708b20174 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:10.536527 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f4979-5839-43f7-8d1d-910708b20174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:10.536527 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f4979-5839-43f7-8d1d-910708b20174 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:10.540157 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143f4979-5839-43f7-8d1d-910708b20174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:10.542039 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143f4979-5839-43f7-8d1d-910708b20174 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:10.556953 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:10.561402 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c703b-f322-4893-8504-037865a87528 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b14ba37d88b64bcb913b3b16b8826056, user_id=be7ef47c70264285b1da8157868df3d7, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:10.566295 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 976/1938] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:10 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:59:10.567073 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f4979-5839-43f7-8d1d-910708b20174 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:10.570434 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-143f4979-5839-43f7-8d1d-910708b20174 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:10.572621 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c703b-f322-4893-8504-037865a87528 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:10.604620 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 963/1939] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:59:10 2022] PUT /identity/v3/projects/b14ba37d88b64bcb913b3b16b8826056/users/be7ef47c70264285b1da8157868df3d7/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 11:59:10.614963 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c703b-f322-4893-8504-037865a87528 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:10.622861 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f4979-5839-43f7-8d1d-910708b20174 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:10.748344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f4013-9aa9-497b-95e3-7a6f5a46ee9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:10.749593 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f4013-9aa9-497b-95e3-7a6f5a46ee9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:10.750110 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f4013-9aa9-497b-95e3-7a6f5a46ee9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:10.750698 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f4013-9aa9-497b-95e3-7a6f5a46ee9c admin admin] PATH_INFO: `/v3/projects/b7c72c55ca164996829e935e7fc3b598` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:10.752413 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f4013-9aa9-497b-95e3-7a6f5a46ee9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7c72c55ca164996829e935e7fc3b598)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:10.756754 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f4013-9aa9-497b-95e3-7a6f5a46ee9c admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:10.770197 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:10.771939 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c703b-f322-4893-8504-037865a87528 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:10.803409 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c711e49b-559f-467c-80fb-a58eab509498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:10.805643 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711e49b-559f-467c-80fb-a58eab509498 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:10.805643 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711e49b-559f-467c-80fb-a58eab509498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:10.805850 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711e49b-559f-467c-80fb-a58eab509498 admin admin] PATH_INFO: `/v3/projects/6483d9380a744204a48fadb612e32eaa/users/799e5930669149758723feec7e62edad/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:10.834496 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-793f4013-9aa9-497b-95e3-7a6f5a46ee9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7c72c55ca164996829e935e7fc3b598', 'request_id': 'req-793f4013-9aa9-497b-95e3-7a6f5a46ee9c'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:10.842507 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c711e49b-559f-467c-80fb-a58eab509498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6483d9380a744204a48fadb612e32eaa, user_id=799e5930669149758723feec7e62edad, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:10.846763 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-793f4013-9aa9-497b-95e3-7a6f5a46ee9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7c72c55ca164996829e935e7fc3b598', 'request_id': 'req-793f4013-9aa9-497b-95e3-7a6f5a46ee9c'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:10.846920 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c711e49b-559f-467c-80fb-a58eab509498 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:10.859335 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-793f4013-9aa9-497b-95e3-7a6f5a46ee9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7c72c55ca164996829e935e7fc3b598', 'request_id': 'req-793f4013-9aa9-497b-95e3-7a6f5a46ee9c'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:10.877084 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 964/1940] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:59:10 2022] PUT /identity/v3/projects/6483d9380a744204a48fadb612e32eaa/users/799e5930669149758723feec7e62edad/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:10.878394 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40da91-a711-4cec-bf32-b11a05e851cf None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:10.878682 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40da91-a711-4cec-bf32-b11a05e851cf None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:10.878962 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40da91-a711-4cec-bf32-b11a05e851cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:10.904027 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-793f4013-9aa9-497b-95e3-7a6f5a46ee9c admin admin] The token cache is being invalidate because project b7c72c55ca164996829e935e7fc3b598 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 11:59:10.904323 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-793f4013-9aa9-497b-95e3-7a6f5a46ee9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:10.911377 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-793f4013-9aa9-497b-95e3-7a6f5a46ee9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:10.916591 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 977/1941] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 11:59:10 2022] DELETE /identity/v3/projects/b7c72c55ca164996829e935e7fc3b598 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:10.918422 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcf304-4c87-4599-8e1e-62626b1c7f19 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:10.918712 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcf304-4c87-4599-8e1e-62626b1c7f19 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:10.918999 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcf304-4c87-4599-8e1e-62626b1c7f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:10.947441 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-3d40da91-a711-4cec-bf32-b11a05e851cf None None] MFA Rules not processed for user `be7ef47c70264285b1da8157868df3d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:10.949657 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-3d40da91-a711-4cec-bf32-b11a05e851cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:10.993266 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-afdcf304-4c87-4599-8e1e-62626b1c7f19 None None] MFA Rules not processed for user `799e5930669149758723feec7e62edad`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:10.996705 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-afdcf304-4c87-4599-8e1e-62626b1c7f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:11.112689 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 965/1942] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:11.114412 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40da91-a711-4cec-bf32-b11a05e851cf None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:11.116482 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-3d40da91-a711-4cec-bf32-b11a05e851cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:11.134167 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 978/1943] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:11.135012 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdcf304-4c87-4599-8e1e-62626b1c7f19 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:11.148678 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-afdcf304-4c87-4599-8e1e-62626b1c7f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:11.217149 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40da91-a711-4cec-bf32-b11a05e851cf None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:11.222648 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6818886-7169-4118-aeeb-12a96d6f2b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:11.223825 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6818886-7169-4118-aeeb-12a96d6f2b44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:11.224210 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6818886-7169-4118-aeeb-12a96d6f2b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:11.224590 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6818886-7169-4118-aeeb-12a96d6f2b44 admin admin] PATH_INFO: `/v3/users/64f6fc4542f648429bb1df84187da7c6` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:11.225945 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6818886-7169-4118-aeeb-12a96d6f2b44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64f6fc4542f648429bb1df84187da7c6)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:11.228967 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6818886-7169-4118-aeeb-12a96d6f2b44 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:11.234706 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdcf304-4c87-4599-8e1e-62626b1c7f19 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:11.235487 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:11.242464 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6f18c-f04b-4a5e-83b4-5c8680fbb084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:11.243176 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6f18c-f04b-4a5e-83b4-5c8680fbb084 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:11.243464 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6f18c-f04b-4a5e-83b4-5c8680fbb084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:11.243765 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6f18c-f04b-4a5e-83b4-5c8680fbb084 admin admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:11.244468 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6f18c-f04b-4a5e-83b4-5c8680fbb084 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:11.246439 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6f18c-f04b-4a5e-83b4-5c8680fbb084 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:11.285512 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 979/1944] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:59:11 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:59:11.285512 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6f18c-f04b-4a5e-83b4-5c8680fbb084 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:11.286028 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-c9d6f18c-f04b-4a5e-83b4-5c8680fbb084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:11.294568 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e6818886-7169-4118-aeeb-12a96d6f2b44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64f6fc4542f648429bb1df84187da7c6'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:11.300646 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:11.302753 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e6818886-7169-4118-aeeb-12a96d6f2b44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64f6fc4542f648429bb1df84187da7c6'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:11.303461 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e6818886-7169-4118-aeeb-12a96d6f2b44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64f6fc4542f648429bb1df84187da7c6'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:11.317522 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e6818886-7169-4118-aeeb-12a96d6f2b44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64f6fc4542f648429bb1df84187da7c6'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:11.326069 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e6818886-7169-4118-aeeb-12a96d6f2b44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64f6fc4542f648429bb1df84187da7c6'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:11.332035 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 966/1945] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 11:59:11 2022] DELETE /identity/v3/users/64f6fc4542f648429bb1df84187da7c6 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:11.334994 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6818886-7169-4118-aeeb-12a96d6f2b44 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:11.334994 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-e6818886-7169-4118-aeeb-12a96d6f2b44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:11.365937 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6f18c-f04b-4a5e-83b4-5c8680fbb084 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:11.412584 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6818886-7169-4118-aeeb-12a96d6f2b44 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:11.419170 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60b6dd-7f5d-42a5-823a-0943dc8568a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:11.420133 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60b6dd-7f5d-42a5-823a-0943dc8568a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:11.421035 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60b6dd-7f5d-42a5-823a-0943dc8568a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:11.421323 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60b6dd-7f5d-42a5-823a-0943dc8568a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:11.422018 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b60b6dd-7f5d-42a5-823a-0943dc8568a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:11.424614 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b60b6dd-7f5d-42a5-823a-0943dc8568a5 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:11.433183 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abeacc9-7f49-4bc9-bf69-b9fefb432658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:11.433899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abeacc9-7f49-4bc9-bf69-b9fefb432658 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:11.434234 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abeacc9-7f49-4bc9-bf69-b9fefb432658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:11.434462 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abeacc9-7f49-4bc9-bf69-b9fefb432658 admin admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:11.435214 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abeacc9-7f49-4bc9-bf69-b9fefb432658 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:11.437718 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abeacc9-7f49-4bc9-bf69-b9fefb432658 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:11.447220 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 967/1946] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:59:11 2022] POST /identity/v3/users => generated 299 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:59:11.452733 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60b6dd-7f5d-42a5-823a-0943dc8568a5 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:11.464180 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60b6dd-7f5d-42a5-823a-0943dc8568a5 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:11.470766 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 980/1947] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:59:11 2022] POST /identity/v3/projects => generated 383 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:59:11.470945 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a50dc1-0358-474b-ae7b-75183d4c4d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:11.470945 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a50dc1-0358-474b-ae7b-75183d4c4d4f admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:11.470945 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a50dc1-0358-474b-ae7b-75183d4c4d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:11.470945 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a50dc1-0358-474b-ae7b-75183d4c4d4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:11.471233 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a50dc1-0358-474b-ae7b-75183d4c4d4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:11.471922 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abeacc9-7f49-4bc9-bf69-b9fefb432658 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:11.473065 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a50dc1-0358-474b-ae7b-75183d4c4d4f admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:11.473622 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-5abeacc9-7f49-4bc9-bf69-b9fefb432658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:11.484404 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 968/1948] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 11:59:11.488039 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a50dc1-0358-474b-ae7b-75183d4c4d4f admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:11.508055 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a50dc1-0358-474b-ae7b-75183d4c4d4f admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:11.569301 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abeacc9-7f49-4bc9-bf69-b9fefb432658 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:11.574340 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe00c3-f11d-44a0-af7d-b838a58eeaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:11.575175 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe00c3-f11d-44a0-af7d-b838a58eeaac admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:11.575462 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe00c3-f11d-44a0-af7d-b838a58eeaac admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:11.575775 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe00c3-f11d-44a0-af7d-b838a58eeaac admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:11.576467 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe00c3-f11d-44a0-af7d-b838a58eeaac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:11.578428 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe00c3-f11d-44a0-af7d-b838a58eeaac admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:11.579533 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3edba8-a240-4aae-a0d9-b5f6fbefaf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:11.580667 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3edba8-a240-4aae-a0d9-b5f6fbefaf19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:11.581044 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3edba8-a240-4aae-a0d9-b5f6fbefaf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:11.581418 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3edba8-a240-4aae-a0d9-b5f6fbefaf19 admin admin] PATH_INFO: `/v3/projects/493f017baa2c451396886f287d661f46/users/16ba6f6da3764db6b29945ffeb8ec904/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:11.586269 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:11.601094 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 981/1949] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:59:11 2022] POST /identity/v3/users => generated 298 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:59:11.605974 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe00c3-f11d-44a0-af7d-b838a58eeaac admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:11.608278 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3edba8-a240-4aae-a0d9-b5f6fbefaf19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=493f017baa2c451396886f287d661f46, user_id=16ba6f6da3764db6b29945ffeb8ec904, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:11.610935 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3edba8-a240-4aae-a0d9-b5f6fbefaf19 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:11.618273 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe00c3-f11d-44a0-af7d-b838a58eeaac admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:11.624749 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f854c7c-6c05-4779-b0e5-856a24bc0522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:11.625557 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f854c7c-6c05-4779-b0e5-856a24bc0522 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:11.625875 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f854c7c-6c05-4779-b0e5-856a24bc0522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:11.626176 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f854c7c-6c05-4779-b0e5-856a24bc0522 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:11.626861 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 969/1950] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:59:11 2022] PUT /identity/v3/projects/493f017baa2c451396886f287d661f46/users/16ba6f6da3764db6b29945ffeb8ec904/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 11:59:11.626994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f854c7c-6c05-4779-b0e5-856a24bc0522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:11.628771 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f854c7c-6c05-4779-b0e5-856a24bc0522 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:11.632411 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3edba8-a240-4aae-a0d9-b5f6fbefaf19 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:11.643937 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 982/1951] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:59:11.646978 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f854c7c-6c05-4779-b0e5-856a24bc0522 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:11.662109 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f854c7c-6c05-4779-b0e5-856a24bc0522 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:11.683108 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:11.724597 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3edba8-a240-4aae-a0d9-b5f6fbefaf19 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:11.724870 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2997eae-7a0b-4cd8-8d94-b6f60004fa57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:11.725758 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2997eae-7a0b-4cd8-8d94-b6f60004fa57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:11.726103 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2997eae-7a0b-4cd8-8d94-b6f60004fa57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:11.726897 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2997eae-7a0b-4cd8-8d94-b6f60004fa57 admin admin] PATH_INFO: `/v3/projects/5973f6431ec9412281de2ff2f1bb5364/users/e0f8a3a1b0474b9086b8bef008ec9374/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:11.729887 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5737f1-ec0c-4e6d-b737-f4295bc93b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:11.730575 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5737f1-ec0c-4e6d-b737-f4295bc93b55 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:11.730861 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5737f1-ec0c-4e6d-b737-f4295bc93b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:11.731153 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5737f1-ec0c-4e6d-b737-f4295bc93b55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:11.731912 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5737f1-ec0c-4e6d-b737-f4295bc93b55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:11.733513 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5737f1-ec0c-4e6d-b737-f4295bc93b55 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:11.742602 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2997eae-7a0b-4cd8-8d94-b6f60004fa57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5973f6431ec9412281de2ff2f1bb5364, user_id=e0f8a3a1b0474b9086b8bef008ec9374, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:11.746474 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 970/1952] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:59:11.746474 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5737f1-ec0c-4e6d-b737-f4295bc93b55 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:11.746666 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2997eae-7a0b-4cd8-8d94-b6f60004fa57 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:11.746740 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-8a5737f1-ec0c-4e6d-b737-f4295bc93b55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:11.759658 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5737f1-ec0c-4e6d-b737-f4295bc93b55 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:11.760836 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 983/1953] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:59:11 2022] PUT /identity/v3/projects/5973f6431ec9412281de2ff2f1bb5364/users/e0f8a3a1b0474b9086b8bef008ec9374/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:11.764011 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2997eae-7a0b-4cd8-8d94-b6f60004fa57 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:11.818851 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0f96c-3ae2-4104-a525-908929ccdee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:11.821025 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0f96c-3ae2-4104-a525-908929ccdee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:11.821025 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0f96c-3ae2-4104-a525-908929ccdee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:11.821025 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0f96c-3ae2-4104-a525-908929ccdee0 admin admin] PATH_INFO: `/v3/projects/adfa79c362244703aa90f4652c11d348` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:11.829621 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2997eae-7a0b-4cd8-8d94-b6f60004fa57 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:11.831187 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0f96c-3ae2-4104-a525-908929ccdee0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adfa79c362244703aa90f4652c11d348)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:11.833031 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0f96c-3ae2-4104-a525-908929ccdee0 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:11.839631 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e982fa89-7db4-4bd3-815c-3b94e8b6d1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:11.841170 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982fa89-7db4-4bd3-815c-3b94e8b6d1d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:11.841525 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982fa89-7db4-4bd3-815c-3b94e8b6d1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:11.842395 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982fa89-7db4-4bd3-815c-3b94e8b6d1d8 admin admin] PATH_INFO: `/v3/projects/493f017baa2c451396886f287d661f46/users/16ba6f6da3764db6b29945ffeb8ec904/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:11.845043 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e982fa89-7db4-4bd3-815c-3b94e8b6d1d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=493f017baa2c451396886f287d661f46, user_id=16ba6f6da3764db6b29945ffeb8ec904, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:11.848131 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e982fa89-7db4-4bd3-815c-3b94e8b6d1d8 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:11.861760 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 984/1954] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:59:11 2022] PUT /identity/v3/projects/493f017baa2c451396886f287d661f46/users/16ba6f6da3764db6b29945ffeb8ec904/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:11.864540 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e982fa89-7db4-4bd3-815c-3b94e8b6d1d8 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:11.891050 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-4eb0f96c-3ae2-4104-a525-908929ccdee0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adfa79c362244703aa90f4652c11d348', 'request_id': 'req-4eb0f96c-3ae2-4104-a525-908929ccdee0'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:11.898918 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-4eb0f96c-3ae2-4104-a525-908929ccdee0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adfa79c362244703aa90f4652c11d348', 'request_id': 'req-4eb0f96c-3ae2-4104-a525-908929ccdee0'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:11.908387 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-4eb0f96c-3ae2-4104-a525-908929ccdee0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adfa79c362244703aa90f4652c11d348', 'request_id': 'req-4eb0f96c-3ae2-4104-a525-908929ccdee0'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:11.922358 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-4eb0f96c-3ae2-4104-a525-908929ccdee0 admin admin] The token cache is being invalidate because project adfa79c362244703aa90f4652c11d348 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 11:59:11.922652 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-4eb0f96c-3ae2-4104-a525-908929ccdee0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:11.923323 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-4eb0f96c-3ae2-4104-a525-908929ccdee0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:11.925495 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 971/1955] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 11:59:11 2022] DELETE /identity/v3/projects/adfa79c362244703aa90f4652c11d348 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:11.926290 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50093c-0788-439e-93bd-e04bf9ae1ebb None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:11.926545 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50093c-0788-439e-93bd-e04bf9ae1ebb None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:11.926788 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50093c-0788-439e-93bd-e04bf9ae1ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:11.943916 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e982fa89-7db4-4bd3-815c-3b94e8b6d1d8 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:11.947449 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:11.957055 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-4d50093c-0788-439e-93bd-e04bf9ae1ebb None None] MFA Rules not processed for user `16ba6f6da3764db6b29945ffeb8ec904`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:11.959873 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-4d50093c-0788-439e-93bd-e04bf9ae1ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:11.993103 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:12.011746 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406bb84-4bb1-428e-9622-51247d2f5aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:12.012584 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406bb84-4bb1-428e-9622-51247d2f5aed admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:12.012952 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406bb84-4bb1-428e-9622-51247d2f5aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:12.013286 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406bb84-4bb1-428e-9622-51247d2f5aed admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:12.014093 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f406bb84-4bb1-428e-9622-51247d2f5aed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:12.015873 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f406bb84-4bb1-428e-9622-51247d2f5aed admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:12.027995 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 985/1956] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:59:12.029180 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32a2c3-1f39-49ad-bdd5-c37964842fdc None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:12.029468 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32a2c3-1f39-49ad-bdd5-c37964842fdc None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:12.029745 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32a2c3-1f39-49ad-bdd5-c37964842fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:12.044797 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 972/1957] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:11 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:12.045796 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50093c-0788-439e-93bd-e04bf9ae1ebb None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:12.047385 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-4d50093c-0788-439e-93bd-e04bf9ae1ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:12.055174 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-4e32a2c3-1f39-49ad-bdd5-c37964842fdc None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:12.056468 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-4e32a2c3-1f39-49ad-bdd5-c37964842fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:12.071185 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 986/1958] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:12.072530 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32a2c3-1f39-49ad-bdd5-c37964842fdc None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:12.075862 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50093c-0788-439e-93bd-e04bf9ae1ebb None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:12.076536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-4e32a2c3-1f39-49ad-bdd5-c37964842fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:12.081428 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1ae29-90c3-4888-8c69-c5db04b2a49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:12.082336 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1ae29-90c3-4888-8c69-c5db04b2a49b admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:12.082646 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1ae29-90c3-4888-8c69-c5db04b2a49b admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:12.082923 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1ae29-90c3-4888-8c69-c5db04b2a49b admin admin] PATH_INFO: `/v3/projects/5973f6431ec9412281de2ff2f1bb5364/users/e0f8a3a1b0474b9086b8bef008ec9374/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:12.084996 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec1ae29-90c3-4888-8c69-c5db04b2a49b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5973f6431ec9412281de2ff2f1bb5364, user_id=e0f8a3a1b0474b9086b8bef008ec9374, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:12.091584 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec1ae29-90c3-4888-8c69-c5db04b2a49b admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:12.106362 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 973/1959] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:59:12 2022] PUT /identity/v3/projects/5973f6431ec9412281de2ff2f1bb5364/users/e0f8a3a1b0474b9086b8bef008ec9374/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:12.107833 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3f51a-868e-4e97-a93f-45f1009c4375 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:12.108147 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3f51a-868e-4e97-a93f-45f1009c4375 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:12.108403 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3f51a-868e-4e97-a93f-45f1009c4375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:12.155871 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-15f3f51a-868e-4e97-a93f-45f1009c4375 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:12.157111 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-15f3f51a-868e-4e97-a93f-45f1009c4375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:12.181342 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32a2c3-1f39-49ad-bdd5-c37964842fdc None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:12.254198 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77989c91-8cbd-4f00-a247-9b7bfaa46c7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:12.254863 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77989c91-8cbd-4f00-a247-9b7bfaa46c7e service cinder] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:12.255145 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77989c91-8cbd-4f00-a247-9b7bfaa46c7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:12.255417 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77989c91-8cbd-4f00-a247-9b7bfaa46c7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:12.282473 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 974/1960] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:12.284477 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014e3e7-bb3d-4e5a-8271-1f87bf6a06a9 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:12.284767 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014e3e7-bb3d-4e5a-8271-1f87bf6a06a9 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:12.285047 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014e3e7-bb3d-4e5a-8271-1f87bf6a06a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:12.316599 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-4014e3e7-bb3d-4e5a-8271-1f87bf6a06a9 None None] MFA Rules not processed for user `e0f8a3a1b0474b9086b8bef008ec9374`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:12.317802 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-4014e3e7-bb3d-4e5a-8271-1f87bf6a06a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:12.341979 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77989c91-8cbd-4f00-a247-9b7bfaa46c7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:12.343714 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77989c91-8cbd-4f00-a247-9b7bfaa46c7e service cinder] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:12.354772 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 987/1961] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:59:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:59:12.355626 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77989c91-8cbd-4f00-a247-9b7bfaa46c7e service cinder] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:12.367437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77989c91-8cbd-4f00-a247-9b7bfaa46c7e service cinder] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:12.382958 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c7b71-606e-4b9f-a121-939287edde27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:12.383678 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c7b71-606e-4b9f-a121-939287edde27 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:12.383966 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c7b71-606e-4b9f-a121-939287edde27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:12.384241 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c7b71-606e-4b9f-a121-939287edde27 admin admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:12.384987 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c7b71-606e-4b9f-a121-939287edde27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:59:12.385287 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c7b71-606e-4b9f-a121-939287edde27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:12.386888 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c7b71-606e-4b9f-a121-939287edde27 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:12.406964 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 988/1962] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 11:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:59:12.407205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 975/1963] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:12.408484 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c7b71-606e-4b9f-a121-939287edde27 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:12.414435 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4014e3e7-bb3d-4e5a-8271-1f87bf6a06a9 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:12.419431 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c7b71-606e-4b9f-a121-939287edde27 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:12.425863 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ae726-2d0c-4539-8aad-54486ca6e434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:12.426335 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4014e3e7-bb3d-4e5a-8271-1f87bf6a06a9 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:12.426545 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ae726-2d0c-4539-8aad-54486ca6e434 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:12.426889 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ae726-2d0c-4539-8aad-54486ca6e434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:12.427234 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ae726-2d0c-4539-8aad-54486ca6e434 admin admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:12.427887 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ae726-2d0c-4539-8aad-54486ca6e434 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:12.430355 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ae726-2d0c-4539-8aad-54486ca6e434 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:12.431148 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf574fbd-9a10-4eaf-adbd-735048e77a37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:12.431861 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf574fbd-9a10-4eaf-adbd-735048e77a37 service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:12.432148 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf574fbd-9a10-4eaf-adbd-735048e77a37 service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:12.432421 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf574fbd-9a10-4eaf-adbd-735048e77a37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:12.439933 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:12.442700 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf574fbd-9a10-4eaf-adbd-735048e77a37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:12.444704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf574fbd-9a10-4eaf-adbd-735048e77a37 service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:12.457293 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 976/1964] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:59:12 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 11:59:12.458233 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf574fbd-9a10-4eaf-adbd-735048e77a37 service cinder] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:12.459663 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 989/1965] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:59:12 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:59:12.459990 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-bf574fbd-9a10-4eaf-adbd-735048e77a37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:12.462662 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ae726-2d0c-4539-8aad-54486ca6e434 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:12.468349 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:12.477393 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf574fbd-9a10-4eaf-adbd-735048e77a37 service cinder] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:12.539427 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ae726-2d0c-4539-8aad-54486ca6e434 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:12.545359 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae763d-2f61-43f8-a789-0163a292449d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:12.546038 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae763d-2f61-43f8-a789-0163a292449d admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:12.546320 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae763d-2f61-43f8-a789-0163a292449d admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:12.546627 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae763d-2f61-43f8-a789-0163a292449d admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:12.547279 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ae763d-2f61-43f8-a789-0163a292449d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:12.549340 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ae763d-2f61-43f8-a789-0163a292449d admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:12.550977 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4269fb-6092-4dac-a9f8-3ba55211d2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:12.552176 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4269fb-6092-4dac-a9f8-3ba55211d2fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:12.552560 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4269fb-6092-4dac-a9f8-3ba55211d2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:12.552932 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4269fb-6092-4dac-a9f8-3ba55211d2fb admin admin] PATH_INFO: `/v3/users/be7ef47c70264285b1da8157868df3d7` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:12.554885 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4269fb-6092-4dac-a9f8-3ba55211d2fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=be7ef47c70264285b1da8157868df3d7)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:12.557249 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4269fb-6092-4dac-a9f8-3ba55211d2fb admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:12.577518 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 990/1966] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:59:12 2022] POST /identity/v3/users => generated 287 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 11:59:12.581622 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae763d-2f61-43f8-a789-0163a292449d admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:12.608545 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-2c4269fb-6092-4dac-a9f8-3ba55211d2fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be7ef47c70264285b1da8157868df3d7'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:12.616058 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-2c4269fb-6092-4dac-a9f8-3ba55211d2fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be7ef47c70264285b1da8157868df3d7'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:12.617317 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-2c4269fb-6092-4dac-a9f8-3ba55211d2fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be7ef47c70264285b1da8157868df3d7'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:12.629686 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-2c4269fb-6092-4dac-a9f8-3ba55211d2fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be7ef47c70264285b1da8157868df3d7'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:12.637686 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-2c4269fb-6092-4dac-a9f8-3ba55211d2fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be7ef47c70264285b1da8157868df3d7'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:12.639154 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae763d-2f61-43f8-a789-0163a292449d admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:12.643040 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa8def-7913-47e5-a687-1d8d800fb087 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:12.643938 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa8def-7913-47e5-a687-1d8d800fb087 service cinder] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:12.644178 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 977/1967] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 11:59:12 2022] DELETE /identity/v3/users/be7ef47c70264285b1da8157868df3d7 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:12.644297 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa8def-7913-47e5-a687-1d8d800fb087 service cinder] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:12.644497 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa8def-7913-47e5-a687-1d8d800fb087 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:12.644962 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4269fb-6092-4dac-a9f8-3ba55211d2fb admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:12.646320 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-2c4269fb-6092-4dac-a9f8-3ba55211d2fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:12.646438 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-d6aa8def-7913-47e5-a687-1d8d800fb087 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:12.710487 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa8def-7913-47e5-a687-1d8d800fb087 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:12.711957 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa8def-7913-47e5-a687-1d8d800fb087 service cinder] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:12.716932 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4269fb-6092-4dac-a9f8-3ba55211d2fb admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:12.720922 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 991/1968] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:59:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:59:12.721707 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e7f40-5ed6-4816-a779-49900751349f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:12.722158 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aab4bb-3fce-41da-9d59-0b7f8549396b None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:12.722432 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e7f40-5ed6-4816-a779-49900751349f admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:12.722536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aab4bb-3fce-41da-9d59-0b7f8549396b None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:12.722708 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aab4bb-3fce-41da-9d59-0b7f8549396b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:12.722800 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e7f40-5ed6-4816-a779-49900751349f admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:12.722977 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e7f40-5ed6-4816-a779-49900751349f admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:12.723721 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e7f40-5ed6-4816-a779-49900751349f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:12.725311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e7f40-5ed6-4816-a779-49900751349f admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:12.736569 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 978/1969] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:59:12.740444 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e7f40-5ed6-4816-a779-49900751349f admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:12.741344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-b9aab4bb-3fce-41da-9d59-0b7f8549396b None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:12.743145 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-b9aab4bb-3fce-41da-9d59-0b7f8549396b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:12.751918 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e7f40-5ed6-4816-a779-49900751349f admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:12.757128 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 992/1970] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:12.760289 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e1156-dbb9-44d0-806c-53e4b3f05777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:12.760968 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e1156-dbb9-44d0-806c-53e4b3f05777 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:12.761251 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e1156-dbb9-44d0-806c-53e4b3f05777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:12.761530 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e1156-dbb9-44d0-806c-53e4b3f05777 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:12.762253 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e1156-dbb9-44d0-806c-53e4b3f05777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:12.763806 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aab4bb-3fce-41da-9d59-0b7f8549396b None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:12.764217 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e1156-dbb9-44d0-806c-53e4b3f05777 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:12.765620 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-b9aab4bb-3fce-41da-9d59-0b7f8549396b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:12.770934 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:12.781834 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 979/1971] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:59:12.783212 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e1156-dbb9-44d0-806c-53e4b3f05777 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:12.795329 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e1156-dbb9-44d0-806c-53e4b3f05777 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:12.800272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776079d-56ff-4816-bd97-2c1e5f1583a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:12.801160 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776079d-56ff-4816-bd97-2c1e5f1583a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:12.801446 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776079d-56ff-4816-bd97-2c1e5f1583a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:12.801730 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776079d-56ff-4816-bd97-2c1e5f1583a6 admin admin] PATH_INFO: `/v3/projects/636673ade8cc4653a70a019a58975492/users/12c2c5752a41477ab3da3cb412b2638d/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:12.819165 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a776079d-56ff-4816-bd97-2c1e5f1583a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=636673ade8cc4653a70a019a58975492, user_id=12c2c5752a41477ab3da3cb412b2638d, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:12.822007 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a776079d-56ff-4816-bd97-2c1e5f1583a6 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:12.823121 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:12.838079 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aab4bb-3fce-41da-9d59-0b7f8549396b None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:12.838477 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 980/1972] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:59:12 2022] PUT /identity/v3/projects/636673ade8cc4653a70a019a58975492/users/12c2c5752a41477ab3da3cb412b2638d/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:12.849841 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa887429-5260-4977-adef-3cd7de776413 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:12.850215 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa887429-5260-4977-adef-3cd7de776413 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:12.850619 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa887429-5260-4977-adef-3cd7de776413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:12.880423 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-fa887429-5260-4977-adef-3cd7de776413 None None] MFA Rules not processed for user `12c2c5752a41477ab3da3cb412b2638d`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:12.882266 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-fa887429-5260-4977-adef-3cd7de776413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:12.899123 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46136e-87a7-4bb5-a4cf-76c495a3cd67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:12.900019 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46136e-87a7-4bb5-a4cf-76c495a3cd67 service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:12.900517 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46136e-87a7-4bb5-a4cf-76c495a3cd67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:12.900909 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46136e-87a7-4bb5-a4cf-76c495a3cd67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:12.968887 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 981/1973] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 11:59:12.969721 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da46136e-87a7-4bb5-a4cf-76c495a3cd67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:12.971775 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da46136e-87a7-4bb5-a4cf-76c495a3cd67 service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:12.984377 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa887429-5260-4977-adef-3cd7de776413 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:12.985946 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-fa887429-5260-4977-adef-3cd7de776413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:12.986084 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 993/1974] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:59:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:59:13.075811 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa887429-5260-4977-adef-3cd7de776413 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:13.080309 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69db232-25fa-4668-b6cd-3ae85087ce16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:13.081671 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69db232-25fa-4668-b6cd-3ae85087ce16 service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:13.082102 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69db232-25fa-4668-b6cd-3ae85087ce16 service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:13.082394 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69db232-25fa-4668-b6cd-3ae85087ce16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:13.096845 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69db232-25fa-4668-b6cd-3ae85087ce16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:13.098554 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69db232-25fa-4668-b6cd-3ae85087ce16 service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:13.108644 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 982/1975] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:59:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 11:59:13.130364 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46136e-87a7-4bb5-a4cf-76c495a3cd67 service neutron] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:13.141342 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46136e-87a7-4bb5-a4cf-76c495a3cd67 service neutron] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:13.145926 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce6eac-30a7-4fcf-9430-51264bb4a056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:13.146906 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce6eac-30a7-4fcf-9430-51264bb4a056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:13.147187 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce6eac-30a7-4fcf-9430-51264bb4a056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:13.147788 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce6eac-30a7-4fcf-9430-51264bb4a056 admin admin] PATH_INFO: `/v3/users/12c2c5752a41477ab3da3cb412b2638d` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:13.149637 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce6eac-30a7-4fcf-9430-51264bb4a056 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12c2c5752a41477ab3da3cb412b2638d)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:13.151722 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce6eac-30a7-4fcf-9430-51264bb4a056 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:13.219931 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-b5ce6eac-30a7-4fcf-9430-51264bb4a056 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12c2c5752a41477ab3da3cb412b2638d'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:13.220612 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-b5ce6eac-30a7-4fcf-9430-51264bb4a056 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12c2c5752a41477ab3da3cb412b2638d'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:13.235923 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-b5ce6eac-30a7-4fcf-9430-51264bb4a056 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12c2c5752a41477ab3da3cb412b2638d'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:13.245788 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-b5ce6eac-30a7-4fcf-9430-51264bb4a056 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12c2c5752a41477ab3da3cb412b2638d'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:13.255205 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-b5ce6eac-30a7-4fcf-9430-51264bb4a056 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12c2c5752a41477ab3da3cb412b2638d'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:13.262784 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 994/1976] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 11:59:13 2022] DELETE /identity/v3/users/12c2c5752a41477ab3da3cb412b2638d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:13.267520 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb28cf0-ed42-4a16-8577-7cbc94e595af None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:13.267816 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb28cf0-ed42-4a16-8577-7cbc94e595af None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:13.268095 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb28cf0-ed42-4a16-8577-7cbc94e595af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:13.289084 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-3eb28cf0-ed42-4a16-8577-7cbc94e595af None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:13.290360 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-3eb28cf0-ed42-4a16-8577-7cbc94e595af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:13.302080 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce6eac-30a7-4fcf-9430-51264bb4a056 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:13.303825 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-b5ce6eac-30a7-4fcf-9430-51264bb4a056 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:13.338787 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:13.365404 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 983/1977] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:13.376986 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb28cf0-ed42-4a16-8577-7cbc94e595af None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:13.381422 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-3eb28cf0-ed42-4a16-8577-7cbc94e595af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:13.394406 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:13.413141 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce6eac-30a7-4fcf-9430-51264bb4a056 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:13.418800 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33464138-cea9-4d1a-b607-1a043fb7830a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:13.420012 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33464138-cea9-4d1a-b607-1a043fb7830a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:13.420285 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33464138-cea9-4d1a-b607-1a043fb7830a admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:13.420547 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33464138-cea9-4d1a-b607-1a043fb7830a admin admin] PATH_INFO: `/v3/projects/b14ba37d88b64bcb913b3b16b8826056` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:13.421822 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33464138-cea9-4d1a-b607-1a043fb7830a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b14ba37d88b64bcb913b3b16b8826056)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:13.423762 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33464138-cea9-4d1a-b607-1a043fb7830a admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:13.463917 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb28cf0-ed42-4a16-8577-7cbc94e595af None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:13.468700 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492f270-5f99-4c1d-acdc-e4f664854e1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:13.469411 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492f270-5f99-4c1d-acdc-e4f664854e1c service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:13.469753 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492f270-5f99-4c1d-acdc-e4f664854e1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:13.470035 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492f270-5f99-4c1d-acdc-e4f664854e1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:13.484550 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8492f270-5f99-4c1d-acdc-e4f664854e1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:13.484902 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-33464138-cea9-4d1a-b607-1a043fb7830a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b14ba37d88b64bcb913b3b16b8826056', 'request_id': 'req-33464138-cea9-4d1a-b607-1a043fb7830a'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:13.486105 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8492f270-5f99-4c1d-acdc-e4f664854e1c service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:13.493254 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-33464138-cea9-4d1a-b607-1a043fb7830a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b14ba37d88b64bcb913b3b16b8826056', 'request_id': 'req-33464138-cea9-4d1a-b607-1a043fb7830a'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:13.508112 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 984/1978] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:59:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 11:59:13.509272 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-33464138-cea9-4d1a-b607-1a043fb7830a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b14ba37d88b64bcb913b3b16b8826056', 'request_id': 'req-33464138-cea9-4d1a-b607-1a043fb7830a'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:13.524336 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-33464138-cea9-4d1a-b607-1a043fb7830a admin admin] The token cache is being invalidate because project b14ba37d88b64bcb913b3b16b8826056 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 11:59:13.524677 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-33464138-cea9-4d1a-b607-1a043fb7830a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:13.525316 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-33464138-cea9-4d1a-b607-1a043fb7830a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:13.529250 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 995/1979] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 11:59:13 2022] DELETE /identity/v3/projects/b14ba37d88b64bcb913b3b16b8826056 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:13.531227 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492f270-5f99-4c1d-acdc-e4f664854e1c service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:13.542112 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492f270-5f99-4c1d-acdc-e4f664854e1c service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:13.622968 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659769f0-68f2-4914-9b11-05c89db9f726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:13.623884 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659769f0-68f2-4914-9b11-05c89db9f726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:13.624228 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659769f0-68f2-4914-9b11-05c89db9f726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:13.624435 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659769f0-68f2-4914-9b11-05c89db9f726 admin admin] PATH_INFO: `/v3/users/16ba6f6da3764db6b29945ffeb8ec904` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:13.625628 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659769f0-68f2-4914-9b11-05c89db9f726 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16ba6f6da3764db6b29945ffeb8ec904)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:13.627551 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659769f0-68f2-4914-9b11-05c89db9f726 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:13.689608 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-659769f0-68f2-4914-9b11-05c89db9f726 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16ba6f6da3764db6b29945ffeb8ec904'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:13.697277 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-659769f0-68f2-4914-9b11-05c89db9f726 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16ba6f6da3764db6b29945ffeb8ec904'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:13.698009 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-659769f0-68f2-4914-9b11-05c89db9f726 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16ba6f6da3764db6b29945ffeb8ec904'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:13.713902 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-659769f0-68f2-4914-9b11-05c89db9f726 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16ba6f6da3764db6b29945ffeb8ec904'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:13.722541 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-659769f0-68f2-4914-9b11-05c89db9f726 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16ba6f6da3764db6b29945ffeb8ec904'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:13.730340 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 985/1980] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 11:59:13 2022] DELETE /identity/v3/users/16ba6f6da3764db6b29945ffeb8ec904 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:13.808521 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33464138-cea9-4d1a-b607-1a043fb7830a admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:13.810123 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-33464138-cea9-4d1a-b607-1a043fb7830a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:13.833938 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33464138-cea9-4d1a-b607-1a043fb7830a admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:13.895848 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c9e9e-87a7-4002-b0f0-e43f9531aa14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:13.897191 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c9e9e-87a7-4002-b0f0-e43f9531aa14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:13.897191 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c9e9e-87a7-4002-b0f0-e43f9531aa14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:13.897848 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c9e9e-87a7-4002-b0f0-e43f9531aa14 admin admin] PATH_INFO: `/v3/projects/636673ade8cc4653a70a019a58975492` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:13.898782 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857c9e9e-87a7-4002-b0f0-e43f9531aa14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=636673ade8cc4653a70a019a58975492)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:13.900782 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857c9e9e-87a7-4002-b0f0-e43f9531aa14 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:13.950578 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-857c9e9e-87a7-4002-b0f0-e43f9531aa14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '636673ade8cc4653a70a019a58975492', 'request_id': 'req-857c9e9e-87a7-4002-b0f0-e43f9531aa14'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:13.952537 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:13.957645 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-857c9e9e-87a7-4002-b0f0-e43f9531aa14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '636673ade8cc4653a70a019a58975492', 'request_id': 'req-857c9e9e-87a7-4002-b0f0-e43f9531aa14'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:13.966356 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-857c9e9e-87a7-4002-b0f0-e43f9531aa14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '636673ade8cc4653a70a019a58975492', 'request_id': 'req-857c9e9e-87a7-4002-b0f0-e43f9531aa14'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:13.978016 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-857c9e9e-87a7-4002-b0f0-e43f9531aa14 admin admin] The token cache is being invalidate because project 636673ade8cc4653a70a019a58975492 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 11:59:13.978433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-857c9e9e-87a7-4002-b0f0-e43f9531aa14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:13.979175 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-857c9e9e-87a7-4002-b0f0-e43f9531aa14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:13.980916 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 996/1981] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 11:59:13 2022] DELETE /identity/v3/projects/636673ade8cc4653a70a019a58975492 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:13.985781 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82008e45-35aa-4136-91d0-f656e0ceee74 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:13.986234 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82008e45-35aa-4136-91d0-f656e0ceee74 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:13.986370 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82008e45-35aa-4136-91d0-f656e0ceee74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:14.005169 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-82008e45-35aa-4136-91d0-f656e0ceee74 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:14.006395 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-82008e45-35aa-4136-91d0-f656e0ceee74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:14.033935 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c9e9e-87a7-4002-b0f0-e43f9531aa14 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:14.035428 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-857c9e9e-87a7-4002-b0f0-e43f9531aa14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:14.040439 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:14.086743 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 986/1982] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 11:59:14.088571 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ab8f3-5c1e-4848-b467-4eb4b2418d53 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:14.088988 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ab8f3-5c1e-4848-b467-4eb4b2418d53 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:14.089346 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ab8f3-5c1e-4848-b467-4eb4b2418d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:14.109677 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-5f3ab8f3-5c1e-4848-b467-4eb4b2418d53 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:14.111062 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-5f3ab8f3-5c1e-4848-b467-4eb4b2418d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:14.118060 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c9e9e-87a7-4002-b0f0-e43f9531aa14 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:14.119916 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 987/1983] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:14.123018 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b32a5-930f-43f4-b21b-164bc098431d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:14.123916 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b32a5-930f-43f4-b21b-164bc098431d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:14.124030 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ab8f3-5c1e-4848-b467-4eb4b2418d53 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:14.124201 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b32a5-930f-43f4-b21b-164bc098431d admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:14.124473 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b32a5-930f-43f4-b21b-164bc098431d admin admin] PATH_INFO: `/v3/projects/493f017baa2c451396886f287d661f46` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:14.125658 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b32a5-930f-43f4-b21b-164bc098431d admin admin] RBAC: Authorizing `identity:delete_project(project_id=493f017baa2c451396886f287d661f46)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:14.127876 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b32a5-930f-43f4-b21b-164bc098431d admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:14.134075 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ab8f3-5c1e-4848-b467-4eb4b2418d53 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:14.139051 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ba014-622e-40ca-82bd-675ce3b347c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:14.139728 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ba014-622e-40ca-82bd-675ce3b347c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:14.140015 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ba014-622e-40ca-82bd-675ce3b347c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:14.140290 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ba014-622e-40ca-82bd-675ce3b347c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:14.141005 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ba014-622e-40ca-82bd-675ce3b347c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:59:14.141312 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ba014-622e-40ca-82bd-675ce3b347c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:14.142893 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ba014-622e-40ca-82bd-675ce3b347c0 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:14.155106 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 988/1984] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 11:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:59:14.159931 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ba014-622e-40ca-82bd-675ce3b347c0 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:14.170701 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ba014-622e-40ca-82bd-675ce3b347c0 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:14.177179 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-011b32a5-930f-43f4-b21b-164bc098431d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '493f017baa2c451396886f287d661f46', 'request_id': 'req-011b32a5-930f-43f4-b21b-164bc098431d'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:14.183461 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-011b32a5-930f-43f4-b21b-164bc098431d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '493f017baa2c451396886f287d661f46', 'request_id': 'req-011b32a5-930f-43f4-b21b-164bc098431d'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:14.192870 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-011b32a5-930f-43f4-b21b-164bc098431d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '493f017baa2c451396886f287d661f46', 'request_id': 'req-011b32a5-930f-43f4-b21b-164bc098431d'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:14.204481 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-011b32a5-930f-43f4-b21b-164bc098431d admin admin] The token cache is being invalidate because project 493f017baa2c451396886f287d661f46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 11:59:14.204847 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-011b32a5-930f-43f4-b21b-164bc098431d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:14.205501 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-011b32a5-930f-43f4-b21b-164bc098431d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:14.207124 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 997/1985] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 11:59:14 2022] DELETE /identity/v3/projects/493f017baa2c451396886f287d661f46 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 11:59:14.211981 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d73a11-bd01-4813-bb05-9b69021fc81d None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:14.212272 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d73a11-bd01-4813-bb05-9b69021fc81d None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:14.212660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d73a11-bd01-4813-bb05-9b69021fc81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:14.230102 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622ff45-298b-44c0-8820-2d2e66a3a0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:14.230765 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622ff45-298b-44c0-8820-2d2e66a3a0bc admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:14.230909 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-f2d73a11-bd01-4813-bb05-9b69021fc81d None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:14.231054 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622ff45-298b-44c0-8820-2d2e66a3a0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:14.231336 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622ff45-298b-44c0-8820-2d2e66a3a0bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:14.232053 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622ff45-298b-44c0-8820-2d2e66a3a0bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:14.232154 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-f2d73a11-bd01-4813-bb05-9b69021fc81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:14.233955 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622ff45-298b-44c0-8820-2d2e66a3a0bc admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:14.240122 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 998/1986] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 11:59:14.248033 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cb14c-6e06-4815-8125-12dd8c5df58a None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:14.248326 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cb14c-6e06-4815-8125-12dd8c5df58a None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:14.248780 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cb14c-6e06-4815-8125-12dd8c5df58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:14.261219 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 989/1987] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:59:14 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:59:14.265346 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622ff45-298b-44c0-8820-2d2e66a3a0bc admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:14.267239 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-7622ff45-298b-44c0-8820-2d2e66a3a0bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:14.270829 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-0e7cb14c-6e06-4815-8125-12dd8c5df58a None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:14.272189 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-0e7cb14c-6e06-4815-8125-12dd8c5df58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:14.337313 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 999/1988] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 11:59:14.341377 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7cb14c-6e06-4815-8125-12dd8c5df58a None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:14.346479 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:14.350627 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7cb14c-6e06-4815-8125-12dd8c5df58a None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:14.350791 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622ff45-298b-44c0-8820-2d2e66a3a0bc admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:14.356074 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf7fe0-225f-4973-847d-02723a283a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:14.356746 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf7fe0-225f-4973-847d-02723a283a49 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:14.357036 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf7fe0-225f-4973-847d-02723a283a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:14.357321 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf7fe0-225f-4973-847d-02723a283a49 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:14.358173 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf7fe0-225f-4973-847d-02723a283a49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:14.358299 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4c973-835e-4e1f-9649-adc77aa65eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:14.358971 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4c973-835e-4e1f-9649-adc77aa65eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:14.359533 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4c973-835e-4e1f-9649-adc77aa65eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:14.359826 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4c973-835e-4e1f-9649-adc77aa65eb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:14.360173 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf7fe0-225f-4973-847d-02723a283a49 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:14.360765 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd4c973-835e-4e1f-9649-adc77aa65eb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:59:14.361137 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd4c973-835e-4e1f-9649-adc77aa65eb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:14.363014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd4c973-835e-4e1f-9649-adc77aa65eb4 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:14.378938 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1000/1989] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 11:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:59:14.380204 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4c973-835e-4e1f-9649-adc77aa65eb4 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:14.380750 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 990/1990] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:59:14 2022] POST /identity/v3/users => generated 289 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 11:59:14.384402 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf7fe0-225f-4973-847d-02723a283a49 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:14.389972 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4c973-835e-4e1f-9649-adc77aa65eb4 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:14.393801 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf7fe0-225f-4973-847d-02723a283a49 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:14.394721 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8f6fb-9122-4b26-a10e-f6009d8fb452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:14.395363 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8f6fb-9122-4b26-a10e-f6009d8fb452 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:14.395689 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8f6fb-9122-4b26-a10e-f6009d8fb452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:14.395968 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8f6fb-9122-4b26-a10e-f6009d8fb452 admin admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:14.396642 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8f6fb-9122-4b26-a10e-f6009d8fb452 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:14.398656 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f5a5b-2999-49b2-9618-bfe6326e0920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:14.398870 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8f6fb-9122-4b26-a10e-f6009d8fb452 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:14.399290 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f5a5b-2999-49b2-9618-bfe6326e0920 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:14.399602 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f5a5b-2999-49b2-9618-bfe6326e0920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:14.399880 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f5a5b-2999-49b2-9618-bfe6326e0920 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:14.400581 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f5a5b-2999-49b2-9618-bfe6326e0920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:14.402137 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f5a5b-2999-49b2-9618-bfe6326e0920 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:14.412149 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 991/1991] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 11:59:14.416276 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f5a5b-2999-49b2-9618-bfe6326e0920 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:14.425846 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f5a5b-2999-49b2-9618-bfe6326e0920 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:14.430901 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1001/1992] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:59:14 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 11:59:14.432731 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8f6fb-9122-4b26-a10e-f6009d8fb452 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:14.439084 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:14.494325 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1dd76-fc84-42d5-ab4c-011efb332ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:14.495000 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1dd76-fc84-42d5-ab4c-011efb332ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:14.495281 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1dd76-fc84-42d5-ab4c-011efb332ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:14.495585 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1dd76-fc84-42d5-ab4c-011efb332ea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:14.496312 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f1dd76-fc84-42d5-ab4c-011efb332ea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:14.498105 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f1dd76-fc84-42d5-ab4c-011efb332ea7 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:14.507128 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8f6fb-9122-4b26-a10e-f6009d8fb452 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:14.511535 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 992/1993] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 11:59:14.512394 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df430a7-af4a-493e-ad0d-6c5ab2a44101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:14.513108 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df430a7-af4a-493e-ad0d-6c5ab2a44101 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:14.513397 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df430a7-af4a-493e-ad0d-6c5ab2a44101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:14.513677 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df430a7-af4a-493e-ad0d-6c5ab2a44101 admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:14.514561 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df430a7-af4a-493e-ad0d-6c5ab2a44101 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:14.515689 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1dd76-fc84-42d5-ab4c-011efb332ea7 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:14.516533 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df430a7-af4a-493e-ad0d-6c5ab2a44101 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:14.526826 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1dd76-fc84-42d5-ab4c-011efb332ea7 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:14.532330 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5ee9b-27a7-4bdc-9740-8d0bac382770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:14.533416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5ee9b-27a7-4bdc-9740-8d0bac382770 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:14.533918 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5ee9b-27a7-4bdc-9740-8d0bac382770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:14.534265 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5ee9b-27a7-4bdc-9740-8d0bac382770 admin admin] PATH_INFO: `/v3/projects/bb1074ce67f448ccb05fe5b2a08d9bde/users/9aa7bf5bdfe64fce865aceee7415c0fc/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:14.542776 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1002/1994] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:59:14 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:59:14.546018 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df430a7-af4a-493e-ad0d-6c5ab2a44101 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:14.555966 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df430a7-af4a-493e-ad0d-6c5ab2a44101 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:14.561399 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574344e6-dc30-4c1e-8246-9fe60842df6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:14.562174 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574344e6-dc30-4c1e-8246-9fe60842df6c admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:14.562522 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574344e6-dc30-4c1e-8246-9fe60842df6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:14.562863 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574344e6-dc30-4c1e-8246-9fe60842df6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:14.563697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574344e6-dc30-4c1e-8246-9fe60842df6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:14.565365 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574344e6-dc30-4c1e-8246-9fe60842df6c admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:14.568399 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd5ee9b-27a7-4bdc-9740-8d0bac382770 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb1074ce67f448ccb05fe5b2a08d9bde, user_id=9aa7bf5bdfe64fce865aceee7415c0fc, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:14.571097 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd5ee9b-27a7-4bdc-9740-8d0bac382770 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:14.577630 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1003/1995] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 11:59:14.582342 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574344e6-dc30-4c1e-8246-9fe60842df6c admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:14.591272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 993/1996] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:59:14 2022] PUT /identity/v3/projects/bb1074ce67f448ccb05fe5b2a08d9bde/users/9aa7bf5bdfe64fce865aceee7415c0fc/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 11:59:14.597100 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574344e6-dc30-4c1e-8246-9fe60842df6c admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:14.600862 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba3262-ecea-4240-bf92-6f629be197e6 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:14.601713 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba3262-ecea-4240-bf92-6f629be197e6 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:14.601992 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba3262-ecea-4240-bf92-6f629be197e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:14.633696 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-b6ba3262-ecea-4240-bf92-6f629be197e6 None None] MFA Rules not processed for user `9aa7bf5bdfe64fce865aceee7415c0fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:14.634901 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-b6ba3262-ecea-4240-bf92-6f629be197e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:14.670357 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e025b8d-ccba-433c-8286-ebf2e0e86079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:14.671125 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e025b8d-ccba-433c-8286-ebf2e0e86079 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:14.671562 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e025b8d-ccba-433c-8286-ebf2e0e86079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:14.671916 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e025b8d-ccba-433c-8286-ebf2e0e86079 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:14.672743 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e025b8d-ccba-433c-8286-ebf2e0e86079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:14.674688 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e025b8d-ccba-433c-8286-ebf2e0e86079 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:14.687586 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1004/1997] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:59:14.691720 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e025b8d-ccba-433c-8286-ebf2e0e86079 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:14.703254 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e025b8d-ccba-433c-8286-ebf2e0e86079 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:14.709471 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace2ff90-036a-4284-ba9a-dc0779c9efbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:14.710936 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2ff90-036a-4284-ba9a-dc0779c9efbd admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:14.711319 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2ff90-036a-4284-ba9a-dc0779c9efbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:14.711731 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2ff90-036a-4284-ba9a-dc0779c9efbd admin admin] PATH_INFO: `/v3/projects/22f2f8e603954aa7a302a718fa2b053a/users/6fd22208312141bebc2a76497d9c7178/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:14.712593 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 994/1998] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:14.716789 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba3262-ecea-4240-bf92-6f629be197e6 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:14.729763 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba3262-ecea-4240-bf92-6f629be197e6 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:14.736964 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce655817-b377-470f-9676-101f3c7a144f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:14.737634 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce655817-b377-470f-9676-101f3c7a144f admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:14.737932 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce655817-b377-470f-9676-101f3c7a144f admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:14.738193 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce655817-b377-470f-9676-101f3c7a144f admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:14.738868 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce655817-b377-470f-9676-101f3c7a144f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:14.742385 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace2ff90-036a-4284-ba9a-dc0779c9efbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=22f2f8e603954aa7a302a718fa2b053a, user_id=6fd22208312141bebc2a76497d9c7178, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:14.745086 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace2ff90-036a-4284-ba9a-dc0779c9efbd admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:14.746147 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce655817-b377-470f-9676-101f3c7a144f admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:14.776986 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1005/1999] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:59:14 2022] PUT /identity/v3/projects/22f2f8e603954aa7a302a718fa2b053a/users/6fd22208312141bebc2a76497d9c7178/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 11:59:14.782144 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 995/2000] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:59:14 2022] POST /identity/v3/projects => generated 375 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:59:14.786355 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace2ff90-036a-4284-ba9a-dc0779c9efbd admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:14.786770 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce70f03-a87a-4fe6-bdeb-6192017019e2 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:14.787126 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce70f03-a87a-4fe6-bdeb-6192017019e2 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:14.787420 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce70f03-a87a-4fe6-bdeb-6192017019e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:14.813335 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:14.815924 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-0ce70f03-a87a-4fe6-bdeb-6192017019e2 None None] MFA Rules not processed for user `6fd22208312141bebc2a76497d9c7178`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:14.817188 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-0ce70f03-a87a-4fe6-bdeb-6192017019e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:14.861625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace2ff90-036a-4284-ba9a-dc0779c9efbd admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:14.874047 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:14.901267 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 996/2001] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 11:59:14.906222 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce70f03-a87a-4fe6-bdeb-6192017019e2 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:14.922063 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4371f87-e4ab-4f4d-a718-1105e88d9277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:14.922686 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4371f87-e4ab-4f4d-a718-1105e88d9277 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:14.922971 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4371f87-e4ab-4f4d-a718-1105e88d9277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:14.923250 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4371f87-e4ab-4f4d-a718-1105e88d9277 admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:14.923970 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4371f87-e4ab-4f4d-a718-1105e88d9277 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:14.925877 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4371f87-e4ab-4f4d-a718-1105e88d9277 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:14.949702 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1006/2002] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:59:14 2022] POST /identity/v3/users => generated 288 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 11:59:14.950997 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4371f87-e4ab-4f4d-a718-1105e88d9277 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:14.962208 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4371f87-e4ab-4f4d-a718-1105e88d9277 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:14.966772 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988a8f9-86a2-4ad0-b168-92f19ea02580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:14.967434 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988a8f9-86a2-4ad0-b168-92f19ea02580 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:14.967751 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988a8f9-86a2-4ad0-b168-92f19ea02580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:14.968028 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988a8f9-86a2-4ad0-b168-92f19ea02580 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:14.968782 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988a8f9-86a2-4ad0-b168-92f19ea02580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:14.970411 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988a8f9-86a2-4ad0-b168-92f19ea02580 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:14.971916 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce70f03-a87a-4fe6-bdeb-6192017019e2 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:14.977159 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243fe76-0da7-4413-9036-03d760a09e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:14.977818 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243fe76-0da7-4413-9036-03d760a09e5e admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:14.978103 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243fe76-0da7-4413-9036-03d760a09e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:14.978380 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243fe76-0da7-4413-9036-03d760a09e5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:14.979075 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b243fe76-0da7-4413-9036-03d760a09e5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:14.980366 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1007/2003] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:59:14.983322 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b243fe76-0da7-4413-9036-03d760a09e5e admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:14.984202 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988a8f9-86a2-4ad0-b168-92f19ea02580 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:14.993620 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988a8f9-86a2-4ad0-b168-92f19ea02580 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:14.998681 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106ef39-8f1b-4f25-ba83-546ee8f2d7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:14.999330 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106ef39-8f1b-4f25-ba83-546ee8f2d7eb admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:14.999655 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106ef39-8f1b-4f25-ba83-546ee8f2d7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:14.999966 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106ef39-8f1b-4f25-ba83-546ee8f2d7eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:15.000727 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106ef39-8f1b-4f25-ba83-546ee8f2d7eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:15.002314 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106ef39-8f1b-4f25-ba83-546ee8f2d7eb admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:15.010566 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 997/2004] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:59:14 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 11:59:15.011376 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243fe76-0da7-4413-9036-03d760a09e5e admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:15.013461 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1008/2005] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 11:59:15.017237 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106ef39-8f1b-4f25-ba83-546ee8f2d7eb admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:15.027775 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106ef39-8f1b-4f25-ba83-546ee8f2d7eb admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:15.082630 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243fe76-0da7-4413-9036-03d760a09e5e admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:15.087382 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671874dc-530e-491f-b9b1-945ba77b1f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:15.088380 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671874dc-530e-491f-b9b1-945ba77b1f0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:15.088735 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671874dc-530e-491f-b9b1-945ba77b1f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:15.088948 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd3b22-ccf3-4a89-8561-f5d797bb01a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:15.089123 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671874dc-530e-491f-b9b1-945ba77b1f0a admin admin] PATH_INFO: `/v3/projects/ce5a281bc8cb40bf8b80e2dfb7de2b55/users/f10a6e92cd4d4ece8e8eed0d42cbb0a6/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:15.090003 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd3b22-ccf3-4a89-8561-f5d797bb01a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:15.090589 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd3b22-ccf3-4a89-8561-f5d797bb01a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:15.090589 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd3b22-ccf3-4a89-8561-f5d797bb01a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:15.091529 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd3b22-ccf3-4a89-8561-f5d797bb01a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:15.093895 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd3b22-ccf3-4a89-8561-f5d797bb01a6 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:15.105560 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671874dc-530e-491f-b9b1-945ba77b1f0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce5a281bc8cb40bf8b80e2dfb7de2b55, user_id=f10a6e92cd4d4ece8e8eed0d42cbb0a6, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:15.108776 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671874dc-530e-491f-b9b1-945ba77b1f0a admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:15.119416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 998/2006] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:59:15 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 11:59:15.122962 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd3b22-ccf3-4a89-8561-f5d797bb01a6 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:15.135488 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd3b22-ccf3-4a89-8561-f5d797bb01a6 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:15.136746 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1009/2007] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:59:15 2022] PUT /identity/v3/projects/ce5a281bc8cb40bf8b80e2dfb7de2b55/users/f10a6e92cd4d4ece8e8eed0d42cbb0a6/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 11:59:15.147644 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8da4d-422e-4fb4-8cfa-f8a029d9c54a None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:15.148697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8da4d-422e-4fb4-8cfa-f8a029d9c54a None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:15.148982 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8da4d-422e-4fb4-8cfa-f8a029d9c54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:15.176665 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-85b8da4d-422e-4fb4-8cfa-f8a029d9c54a None None] MFA Rules not processed for user `f10a6e92cd4d4ece8e8eed0d42cbb0a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:15.177942 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-85b8da4d-422e-4fb4-8cfa-f8a029d9c54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:15.183152 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:15.202998 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01afbd54-a4c6-43bd-b41a-1e6bbbf2f59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:15.203727 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afbd54-a4c6-43bd-b41a-1e6bbbf2f59b admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:15.204013 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afbd54-a4c6-43bd-b41a-1e6bbbf2f59b admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:15.204288 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afbd54-a4c6-43bd-b41a-1e6bbbf2f59b admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:15.205009 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01afbd54-a4c6-43bd-b41a-1e6bbbf2f59b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:15.206630 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01afbd54-a4c6-43bd-b41a-1e6bbbf2f59b admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:15.207888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:15.221527 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 999/2008] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 11:59:15.222625 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01afbd54-a4c6-43bd-b41a-1e6bbbf2f59b admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:15.232365 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01afbd54-a4c6-43bd-b41a-1e6bbbf2f59b admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:15.236907 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec259381-d9f3-4717-a9bf-85b0398b7cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:15.237948 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec259381-d9f3-4717-a9bf-85b0398b7cab admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:15.237948 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec259381-d9f3-4717-a9bf-85b0398b7cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:15.238225 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec259381-d9f3-4717-a9bf-85b0398b7cab admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:15.238761 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec259381-d9f3-4717-a9bf-85b0398b7cab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:15.240386 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec259381-d9f3-4717-a9bf-85b0398b7cab admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:15.246340 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1010/2009] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 11:59:15.250440 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1000/2010] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 11:59:15.250900 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b8da4d-422e-4fb4-8cfa-f8a029d9c54a None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:15.254265 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec259381-d9f3-4717-a9bf-85b0398b7cab admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:15.261990 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b8da4d-422e-4fb4-8cfa-f8a029d9c54a None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:15.264139 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec259381-d9f3-4717-a9bf-85b0398b7cab admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:15.266540 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a2df22-5fdd-4b8c-96e8-944f4aa831f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:15.267529 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2df22-5fdd-4b8c-96e8-944f4aa831f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:15.267850 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2df22-5fdd-4b8c-96e8-944f4aa831f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:15.268123 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2df22-5fdd-4b8c-96e8-944f4aa831f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:15.268777 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54422806-da46-42cd-8b05-4304d347a2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:15.268884 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a2df22-5fdd-4b8c-96e8-944f4aa831f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:15.269618 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54422806-da46-42cd-8b05-4304d347a2e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:15.269899 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54422806-da46-42cd-8b05-4304d347a2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:15.270175 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54422806-da46-42cd-8b05-4304d347a2e6 admin admin] PATH_INFO: `/v3/projects/a1dc8ca7d2ba4aabb8e21eb5518532e5/users/db8d8f5470da40dba3c13e707183cced/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:15.270682 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a2df22-5fdd-4b8c-96e8-944f4aa831f6 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:15.286255 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54422806-da46-42cd-8b05-4304d347a2e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1dc8ca7d2ba4aabb8e21eb5518532e5, user_id=db8d8f5470da40dba3c13e707183cced, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:15.289010 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54422806-da46-42cd-8b05-4304d347a2e6 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:15.302888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1001/2011] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:59:15 2022] PUT /identity/v3/projects/a1dc8ca7d2ba4aabb8e21eb5518532e5/users/db8d8f5470da40dba3c13e707183cced/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 11:59:15.303298 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1011/2012] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:59:15 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 11:59:15.311269 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54422806-da46-42cd-8b05-4304d347a2e6 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:15.317805 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4bee7-aec4-40bd-af81-6e0c06e672f9 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:15.318106 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4bee7-aec4-40bd-af81-6e0c06e672f9 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:15.318650 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4bee7-aec4-40bd-af81-6e0c06e672f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:15.346619 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-96f4bee7-aec4-40bd-af81-6e0c06e672f9 None None] MFA Rules not processed for user `db8d8f5470da40dba3c13e707183cced`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:15.347852 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-96f4bee7-aec4-40bd-af81-6e0c06e672f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:15.378900 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54422806-da46-42cd-8b05-4304d347a2e6 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:15.428906 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1012/2013] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 11:59:15.434062 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4bee7-aec4-40bd-af81-6e0c06e672f9 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:15.437819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c65a9-62b9-4bd8-ab13-8c2e21535ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:15.438485 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c65a9-62b9-4bd8-ab13-8c2e21535ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:15.438767 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c65a9-62b9-4bd8-ab13-8c2e21535ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:15.439039 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c65a9-62b9-4bd8-ab13-8c2e21535ce9 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:15.439794 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c65a9-62b9-4bd8-ab13-8c2e21535ce9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:15.441794 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c65a9-62b9-4bd8-ab13-8c2e21535ce9 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:15.444574 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4bee7-aec4-40bd-af81-6e0c06e672f9 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:15.450399 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8396b688-28de-4527-863c-eed71e2b5ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:15.451372 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396b688-28de-4527-863c-eed71e2b5ee5 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:15.451779 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396b688-28de-4527-863c-eed71e2b5ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:15.452166 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396b688-28de-4527-863c-eed71e2b5ee5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:15.452875 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8396b688-28de-4527-863c-eed71e2b5ee5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:15.455111 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8396b688-28de-4527-863c-eed71e2b5ee5 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:15.462724 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1002/2014] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:59:15 2022] POST /identity/v3/users => generated 295 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:59:15.466460 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c65a9-62b9-4bd8-ab13-8c2e21535ce9 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:15.477369 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c65a9-62b9-4bd8-ab13-8c2e21535ce9 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:15.482615 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec4f60-488a-4dea-8292-a6f0d3b3e172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:15.483289 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec4f60-488a-4dea-8292-a6f0d3b3e172 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:15.483584 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec4f60-488a-4dea-8292-a6f0d3b3e172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:15.483863 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec4f60-488a-4dea-8292-a6f0d3b3e172 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:15.484625 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec4f60-488a-4dea-8292-a6f0d3b3e172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:15.486282 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec4f60-488a-4dea-8292-a6f0d3b3e172 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:15.489201 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1013/2015] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:59:15 2022] POST /identity/v3/projects => generated 387 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 11:59:15.493980 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8396b688-28de-4527-863c-eed71e2b5ee5 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:15.500873 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1003/2016] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 11:59:15.505118 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec4f60-488a-4dea-8292-a6f0d3b3e172 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:15.515681 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec4f60-488a-4dea-8292-a6f0d3b3e172 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:15.552039 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:15.562841 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:15.564330 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8396b688-28de-4527-863c-eed71e2b5ee5 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:15.569485 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a92760-7398-4eb5-9552-d842327ff3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:15.570720 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a92760-7398-4eb5-9552-d842327ff3bb admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:15.571007 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a92760-7398-4eb5-9552-d842327ff3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:15.571292 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a92760-7398-4eb5-9552-d842327ff3bb admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:15.572034 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a92760-7398-4eb5-9552-d842327ff3bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:15.574004 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a92760-7398-4eb5-9552-d842327ff3bb admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:15.579133 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d2632-7838-4672-8bb4-ebffd73a0c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:15.580048 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d2632-7838-4672-8bb4-ebffd73a0c70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:15.580329 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d2632-7838-4672-8bb4-ebffd73a0c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:15.580605 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d2632-7838-4672-8bb4-ebffd73a0c70 admin admin] PATH_INFO: `/v3/projects/2b0b4db94a68470090b8a786ca0e39da/users/1d48fe2008d94171a90328c3b5fe03c0/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:15.594164 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1014/2017] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:59:15 2022] POST /identity/v3/users => generated 300 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:59:15.596418 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d2632-7838-4672-8bb4-ebffd73a0c70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b0b4db94a68470090b8a786ca0e39da, user_id=1d48fe2008d94171a90328c3b5fe03c0, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:15.597983 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a92760-7398-4eb5-9552-d842327ff3bb admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:15.599235 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d2632-7838-4672-8bb4-ebffd73a0c70 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:15.608550 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a92760-7398-4eb5-9552-d842327ff3bb admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:15.615311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1004/2018] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:59:15 2022] PUT /identity/v3/projects/2b0b4db94a68470090b8a786ca0e39da/users/1d48fe2008d94171a90328c3b5fe03c0/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 11:59:15.620002 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d2632-7838-4672-8bb4-ebffd73a0c70 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:15.683026 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d58288-e390-4f08-8c02-9561c576e1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:15.683828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d58288-e390-4f08-8c02-9561c576e1db admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:15.684184 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d58288-e390-4f08-8c02-9561c576e1db admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:15.684529 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d58288-e390-4f08-8c02-9561c576e1db admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:15.685327 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d58288-e390-4f08-8c02-9561c576e1db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:15.687026 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d58288-e390-4f08-8c02-9561c576e1db admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:15.700405 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d2632-7838-4672-8bb4-ebffd73a0c70 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:15.702525 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1015/2019] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:59:15.705265 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d58288-e390-4f08-8c02-9561c576e1db admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:15.705855 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b83e056-ffa5-4f37-be2b-06c1a076803c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:15.706563 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83e056-ffa5-4f37-be2b-06c1a076803c admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:15.706848 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83e056-ffa5-4f37-be2b-06c1a076803c admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:15.707129 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83e056-ffa5-4f37-be2b-06c1a076803c admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:15.707904 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b83e056-ffa5-4f37-be2b-06c1a076803c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:15.710614 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b83e056-ffa5-4f37-be2b-06c1a076803c admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:15.713425 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d58288-e390-4f08-8c02-9561c576e1db admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:15.718321 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6576b-cb99-42f3-94be-18e54c0e55cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:15.719213 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6576b-cb99-42f3-94be-18e54c0e55cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:15.719483 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6576b-cb99-42f3-94be-18e54c0e55cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:15.719786 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6576b-cb99-42f3-94be-18e54c0e55cf admin admin] PATH_INFO: `/v3/projects/e0fae42713bb4e73bc53b0181d9abc30/users/2d8cfdedf82147d39233839d05b48b37/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:15.722136 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1005/2020] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 11:59:15.726524 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b83e056-ffa5-4f37-be2b-06c1a076803c admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:15.736974 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b83e056-ffa5-4f37-be2b-06c1a076803c admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:15.737771 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b6576b-cb99-42f3-94be-18e54c0e55cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0fae42713bb4e73bc53b0181d9abc30, user_id=2d8cfdedf82147d39233839d05b48b37, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:15.740560 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b6576b-cb99-42f3-94be-18e54c0e55cf admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:15.742580 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c886d5-b9c4-4d46-aa6a-93f1e0e0bbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:15.743472 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c886d5-b9c4-4d46-aa6a-93f1e0e0bbb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:15.743790 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c886d5-b9c4-4d46-aa6a-93f1e0e0bbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:15.744069 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c886d5-b9c4-4d46-aa6a-93f1e0e0bbb7 admin admin] PATH_INFO: `/v3/projects/2b0b4db94a68470090b8a786ca0e39da/users/1d48fe2008d94171a90328c3b5fe03c0/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:15.748137 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c886d5-b9c4-4d46-aa6a-93f1e0e0bbb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b0b4db94a68470090b8a786ca0e39da, user_id=1d48fe2008d94171a90328c3b5fe03c0, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:15.751624 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c886d5-b9c4-4d46-aa6a-93f1e0e0bbb7 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:15.756830 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1016/2021] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:59:15 2022] PUT /identity/v3/projects/e0fae42713bb4e73bc53b0181d9abc30/users/2d8cfdedf82147d39233839d05b48b37/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:15.761219 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6576b-cb99-42f3-94be-18e54c0e55cf admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:15.765806 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1006/2022] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:59:15 2022] PUT /identity/v3/projects/2b0b4db94a68470090b8a786ca0e39da/users/1d48fe2008d94171a90328c3b5fe03c0/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 11:59:15.776929 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c8532-6d0e-4e04-806e-a8f1da19c57f None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:15.777299 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c8532-6d0e-4e04-806e-a8f1da19c57f None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:15.777645 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c8532-6d0e-4e04-806e-a8f1da19c57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:15.818339 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-d56c8532-6d0e-4e04-806e-a8f1da19c57f None None] MFA Rules not processed for user `1d48fe2008d94171a90328c3b5fe03c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:15.820003 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-d56c8532-6d0e-4e04-806e-a8f1da19c57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:15.838712 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6576b-cb99-42f3-94be-18e54c0e55cf admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:15.939573 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1007/2023] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:15 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:15.945322 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c332e70-1c9b-445f-8707-c4b7566fb646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:15.946869 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c332e70-1c9b-445f-8707-c4b7566fb646 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:15.947447 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c332e70-1c9b-445f-8707-c4b7566fb646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:15.947923 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c332e70-1c9b-445f-8707-c4b7566fb646 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:15.949030 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c332e70-1c9b-445f-8707-c4b7566fb646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:15.950500 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c8532-6d0e-4e04-806e-a8f1da19c57f None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:15.950933 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c332e70-1c9b-445f-8707-c4b7566fb646 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:15.952370 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-d56c8532-6d0e-4e04-806e-a8f1da19c57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:15.953575 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:15.963604 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1017/2024] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:59:15.968541 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c332e70-1c9b-445f-8707-c4b7566fb646 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:15.984861 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c332e70-1c9b-445f-8707-c4b7566fb646 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:16.001678 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146070d-fa36-4e9c-a24a-f37f6562f54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:16.003089 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146070d-fa36-4e9c-a24a-f37f6562f54d admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:16.003383 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146070d-fa36-4e9c-a24a-f37f6562f54d admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:16.003694 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146070d-fa36-4e9c-a24a-f37f6562f54d admin admin] PATH_INFO: `/v3/projects/e0fae42713bb4e73bc53b0181d9abc30/users/2d8cfdedf82147d39233839d05b48b37/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:16.009637 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6146070d-fa36-4e9c-a24a-f37f6562f54d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0fae42713bb4e73bc53b0181d9abc30, user_id=2d8cfdedf82147d39233839d05b48b37, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:16.012556 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6146070d-fa36-4e9c-a24a-f37f6562f54d admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:16.032132 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1018/2025] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:59:15 2022] PUT /identity/v3/projects/e0fae42713bb4e73bc53b0181d9abc30/users/2d8cfdedf82147d39233839d05b48b37/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 11:59:16.033860 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:16.043411 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857de6b-004a-4732-9192-317ef27d43f3 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:16.043876 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857de6b-004a-4732-9192-317ef27d43f3 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:16.044315 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857de6b-004a-4732-9192-317ef27d43f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:16.071447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c8532-6d0e-4e04-806e-a8f1da19c57f None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:16.074490 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-7857de6b-004a-4732-9192-317ef27d43f3 None None] MFA Rules not processed for user `2d8cfdedf82147d39233839d05b48b37`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:16.075928 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-7857de6b-004a-4732-9192-317ef27d43f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:16.161449 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4685ab-54c9-4f0e-9885-5ab4eb1ca3cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:16.162672 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4685ab-54c9-4f0e-9885-5ab4eb1ca3cd service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:16.162974 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4685ab-54c9-4f0e-9885-5ab4eb1ca3cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:16.163240 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4685ab-54c9-4f0e-9885-5ab4eb1ca3cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:16.176108 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1019/2026] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:16 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:16.239004 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857de6b-004a-4732-9192-317ef27d43f3 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:16.240358 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4685ab-54c9-4f0e-9885-5ab4eb1ca3cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:16.241143 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-7857de6b-004a-4732-9192-317ef27d43f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:16.242090 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4685ab-54c9-4f0e-9885-5ab4eb1ca3cd service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:16.252073 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1008/2027] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:59:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 11:59:16.258069 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857de6b-004a-4732-9192-317ef27d43f3 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:16.262708 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24182d1-8e33-4c1e-846f-49363ed17cc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:16.263727 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24182d1-8e33-4c1e-846f-49363ed17cc0 service cinder] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:16.264027 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24182d1-8e33-4c1e-846f-49363ed17cc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:16.264863 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24182d1-8e33-4c1e-846f-49363ed17cc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:16.278926 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24182d1-8e33-4c1e-846f-49363ed17cc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:16.280715 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24182d1-8e33-4c1e-846f-49363ed17cc0 service cinder] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:16.293496 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1020/2028] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:59:16 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 11:59:17.354312 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4685ab-54c9-4f0e-9885-5ab4eb1ca3cd service cinder] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:17.369188 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4685ab-54c9-4f0e-9885-5ab4eb1ca3cd service cinder] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:17.373020 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58557a3d-84f6-4ffe-b275-238d78b9c785 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:17.373823 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58557a3d-84f6-4ffe-b275-238d78b9c785 service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:17.374105 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58557a3d-84f6-4ffe-b275-238d78b9c785 service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:17.374383 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58557a3d-84f6-4ffe-b275-238d78b9c785 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:17.438210 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58557a3d-84f6-4ffe-b275-238d78b9c785 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:17.439694 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58557a3d-84f6-4ffe-b275-238d78b9c785 service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:17.449379 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1009/2029] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:59:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:59:17.890297 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24182d1-8e33-4c1e-846f-49363ed17cc0 service cinder] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:17.899446 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24182d1-8e33-4c1e-846f-49363ed17cc0 service cinder] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:17.903005 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a858e74-e33a-4ec2-909e-b8afa20afd27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:17.903686 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a858e74-e33a-4ec2-909e-b8afa20afd27 service cinder] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:17.903977 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a858e74-e33a-4ec2-909e-b8afa20afd27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:17.904584 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a858e74-e33a-4ec2-909e-b8afa20afd27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:17.960145 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a858e74-e33a-4ec2-909e-b8afa20afd27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:17.961587 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a858e74-e33a-4ec2-909e-b8afa20afd27 service cinder] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:17.970371 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1021/2030] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:59:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:59:18.789490 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58557a3d-84f6-4ffe-b275-238d78b9c785 service cinder] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:18.812717 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58557a3d-84f6-4ffe-b275-238d78b9c785 service cinder] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:18.817065 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc261bc-d542-4589-8cbd-eba585873555 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:18.817800 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc261bc-d542-4589-8cbd-eba585873555 service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:18.818150 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc261bc-d542-4589-8cbd-eba585873555 service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:18.818493 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc261bc-d542-4589-8cbd-eba585873555 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:18.870958 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:18.889816 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc261bc-d542-4589-8cbd-eba585873555 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:18.891366 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc261bc-d542-4589-8cbd-eba585873555 service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:18.911899 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1010/2031] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:59:18 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:59:18.925832 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a858e74-e33a-4ec2-909e-b8afa20afd27 service cinder] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:18.927491 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-6a858e74-e33a-4ec2-909e-b8afa20afd27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:19.007851 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:19.016515 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a858e74-e33a-4ec2-909e-b8afa20afd27 service cinder] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:19.034532 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2309af83-ca18-48d1-bfda-3de47699cf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:19.035808 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309af83-ca18-48d1-bfda-3de47699cf95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:19.036127 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309af83-ca18-48d1-bfda-3de47699cf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:19.036424 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309af83-ca18-48d1-bfda-3de47699cf95 admin admin] PATH_INFO: `/v3/users/799e5930669149758723feec7e62edad` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:19.037661 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2309af83-ca18-48d1-bfda-3de47699cf95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=799e5930669149758723feec7e62edad)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:19.040244 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2309af83-ca18-48d1-bfda-3de47699cf95 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:19.087101 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-2309af83-ca18-48d1-bfda-3de47699cf95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '799e5930669149758723feec7e62edad'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:19.087814 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-2309af83-ca18-48d1-bfda-3de47699cf95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '799e5930669149758723feec7e62edad'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:19.102749 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-2309af83-ca18-48d1-bfda-3de47699cf95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '799e5930669149758723feec7e62edad'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:19.110075 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-2309af83-ca18-48d1-bfda-3de47699cf95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '799e5930669149758723feec7e62edad'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:19.118200 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-2309af83-ca18-48d1-bfda-3de47699cf95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '799e5930669149758723feec7e62edad'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:19.124221 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1022/2032] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 11:59:18 2022] DELETE /identity/v3/users/799e5930669149758723feec7e62edad => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:19.128813 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc07451-4f7d-42da-8dce-fb544e066d49 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:19.129108 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc07451-4f7d-42da-8dce-fb544e066d49 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:19.129395 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc07451-4f7d-42da-8dce-fb544e066d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:19.148020 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-cbc07451-4f7d-42da-8dce-fb544e066d49 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:19.149207 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-cbc07451-4f7d-42da-8dce-fb544e066d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:19.206088 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1011/2033] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:19.216331 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2309af83-ca18-48d1-bfda-3de47699cf95 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:19.217811 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-2309af83-ca18-48d1-bfda-3de47699cf95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:19.282516 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2309af83-ca18-48d1-bfda-3de47699cf95 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:19.286131 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119c586-c4cf-40f0-856a-61cec0bcb535 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:19.286775 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119c586-c4cf-40f0-856a-61cec0bcb535 service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:19.287054 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119c586-c4cf-40f0-856a-61cec0bcb535 service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:19.287327 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119c586-c4cf-40f0-856a-61cec0bcb535 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:19.296160 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a119c586-c4cf-40f0-856a-61cec0bcb535 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:19.297593 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a119c586-c4cf-40f0-856a-61cec0bcb535 service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:19.307315 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1023/2034] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:59:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:59:19.617246 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc07451-4f7d-42da-8dce-fb544e066d49 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:19.620823 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-cbc07451-4f7d-42da-8dce-fb544e066d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:19.652361 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc07451-4f7d-42da-8dce-fb544e066d49 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:19.657387 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533e07e-b941-4270-8b23-67c055aa4ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:19.658275 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533e07e-b941-4270-8b23-67c055aa4ecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:19.658662 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533e07e-b941-4270-8b23-67c055aa4ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:19.658813 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533e07e-b941-4270-8b23-67c055aa4ecf admin admin] PATH_INFO: `/v3/projects/6483d9380a744204a48fadb612e32eaa` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:19.660399 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f533e07e-b941-4270-8b23-67c055aa4ecf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6483d9380a744204a48fadb612e32eaa)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:19.662395 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f533e07e-b941-4270-8b23-67c055aa4ecf admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:19.716124 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-f533e07e-b941-4270-8b23-67c055aa4ecf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6483d9380a744204a48fadb612e32eaa', 'request_id': 'req-f533e07e-b941-4270-8b23-67c055aa4ecf'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:19.723001 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-f533e07e-b941-4270-8b23-67c055aa4ecf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6483d9380a744204a48fadb612e32eaa', 'request_id': 'req-f533e07e-b941-4270-8b23-67c055aa4ecf'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:19.731880 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-f533e07e-b941-4270-8b23-67c055aa4ecf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6483d9380a744204a48fadb612e32eaa', 'request_id': 'req-f533e07e-b941-4270-8b23-67c055aa4ecf'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:19.744589 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-f533e07e-b941-4270-8b23-67c055aa4ecf admin admin] The token cache is being invalidate because project 6483d9380a744204a48fadb612e32eaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 11:59:19.744875 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-f533e07e-b941-4270-8b23-67c055aa4ecf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:19.745512 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-f533e07e-b941-4270-8b23-67c055aa4ecf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:19.747237 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1012/2035] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 11:59:19 2022] DELETE /identity/v3/projects/6483d9380a744204a48fadb612e32eaa => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:19.752412 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119c586-c4cf-40f0-856a-61cec0bcb535 service neutron] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:19.763180 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119c586-c4cf-40f0-856a-61cec0bcb535 service neutron] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:19.910990 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4996b5-8740-47fd-82e3-1bfe0001c474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:19.927856 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4996b5-8740-47fd-82e3-1bfe0001c474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:19.928937 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4996b5-8740-47fd-82e3-1bfe0001c474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:19.929945 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4996b5-8740-47fd-82e3-1bfe0001c474 admin admin] PATH_INFO: `/v3/users/e0f8a3a1b0474b9086b8bef008ec9374` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:19.936526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4996b5-8740-47fd-82e3-1bfe0001c474 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0f8a3a1b0474b9086b8bef008ec9374)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:19.941656 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4996b5-8740-47fd-82e3-1bfe0001c474 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:19.977505 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:20.045555 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-4a4996b5-8740-47fd-82e3-1bfe0001c474 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0f8a3a1b0474b9086b8bef008ec9374'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:20.046271 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-4a4996b5-8740-47fd-82e3-1bfe0001c474 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0f8a3a1b0474b9086b8bef008ec9374'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:20.078719 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-4a4996b5-8740-47fd-82e3-1bfe0001c474 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0f8a3a1b0474b9086b8bef008ec9374'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:20.093183 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-4a4996b5-8740-47fd-82e3-1bfe0001c474 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0f8a3a1b0474b9086b8bef008ec9374'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:20.119361 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-4a4996b5-8740-47fd-82e3-1bfe0001c474 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0f8a3a1b0474b9086b8bef008ec9374'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:20.133952 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1024/2036] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 11:59:19 2022] DELETE /identity/v3/users/e0f8a3a1b0474b9086b8bef008ec9374 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:20.490339 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533e07e-b941-4270-8b23-67c055aa4ecf admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:20.495321 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-f533e07e-b941-4270-8b23-67c055aa4ecf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:20.515722 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533e07e-b941-4270-8b23-67c055aa4ecf admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:20.595910 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51cf21-8c00-4c61-bb3a-a8eb357f7a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:20.597082 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51cf21-8c00-4c61-bb3a-a8eb357f7a4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:20.597465 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51cf21-8c00-4c61-bb3a-a8eb357f7a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:20.597837 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51cf21-8c00-4c61-bb3a-a8eb357f7a4d admin admin] PATH_INFO: `/v3/projects/5973f6431ec9412281de2ff2f1bb5364` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:20.599122 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51cf21-8c00-4c61-bb3a-a8eb357f7a4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5973f6431ec9412281de2ff2f1bb5364)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:20.601758 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51cf21-8c00-4c61-bb3a-a8eb357f7a4d admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:20.610402 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:20.664793 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-cf51cf21-8c00-4c61-bb3a-a8eb357f7a4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5973f6431ec9412281de2ff2f1bb5364', 'request_id': 'req-cf51cf21-8c00-4c61-bb3a-a8eb357f7a4d'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:20.670968 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-cf51cf21-8c00-4c61-bb3a-a8eb357f7a4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5973f6431ec9412281de2ff2f1bb5364', 'request_id': 'req-cf51cf21-8c00-4c61-bb3a-a8eb357f7a4d'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:20.678267 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-cf51cf21-8c00-4c61-bb3a-a8eb357f7a4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5973f6431ec9412281de2ff2f1bb5364', 'request_id': 'req-cf51cf21-8c00-4c61-bb3a-a8eb357f7a4d'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:20.689388 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-cf51cf21-8c00-4c61-bb3a-a8eb357f7a4d admin admin] The token cache is being invalidate because project 5973f6431ec9412281de2ff2f1bb5364 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 11:59:20.689676 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-cf51cf21-8c00-4c61-bb3a-a8eb357f7a4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:20.690362 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-cf51cf21-8c00-4c61-bb3a-a8eb357f7a4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:20.691959 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1013/2037] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 11:59:20 2022] DELETE /identity/v3/projects/5973f6431ec9412281de2ff2f1bb5364 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:20.696817 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56469972-0266-4063-8a73-01fb0f07d3c6 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:20.697174 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56469972-0266-4063-8a73-01fb0f07d3c6 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:20.697572 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56469972-0266-4063-8a73-01fb0f07d3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:20.715714 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-56469972-0266-4063-8a73-01fb0f07d3c6 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:20.716902 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-56469972-0266-4063-8a73-01fb0f07d3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:20.775685 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1025/2038] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:20.783541 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48be0b-f58b-416c-8e19-9bb9ae010c7a None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:20.783898 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48be0b-f58b-416c-8e19-9bb9ae010c7a None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:20.784512 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48be0b-f58b-416c-8e19-9bb9ae010c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:20.803173 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-7c48be0b-f58b-416c-8e19-9bb9ae010c7a None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:20.804483 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-7c48be0b-f58b-416c-8e19-9bb9ae010c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:20.812736 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1014/2039] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:20.817105 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56469972-0266-4063-8a73-01fb0f07d3c6 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:20.828243 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56469972-0266-4063-8a73-01fb0f07d3c6 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:20.832992 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37b24a-2427-4658-b3ae-2c5fdb63a32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:20.833633 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37b24a-2427-4658-b3ae-2c5fdb63a32d admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:20.833911 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37b24a-2427-4658-b3ae-2c5fdb63a32d admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:20.834180 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37b24a-2427-4658-b3ae-2c5fdb63a32d admin admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:20.834906 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c37b24a-2427-4658-b3ae-2c5fdb63a32d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:59:20.835765 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c37b24a-2427-4658-b3ae-2c5fdb63a32d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:20.837383 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c37b24a-2427-4658-b3ae-2c5fdb63a32d admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:20.850378 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1026/2040] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 11:59:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:59:20.855225 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48be0b-f58b-416c-8e19-9bb9ae010c7a None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:20.865894 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48be0b-f58b-416c-8e19-9bb9ae010c7a None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:20.872888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b916c-03cc-48e5-a463-58f3b9f5e795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:20.874304 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b916c-03cc-48e5-a463-58f3b9f5e795 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:20.874705 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b916c-03cc-48e5-a463-58f3b9f5e795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:20.875024 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b916c-03cc-48e5-a463-58f3b9f5e795 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:20.876293 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b916c-03cc-48e5-a463-58f3b9f5e795 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:20.879348 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b916c-03cc-48e5-a463-58f3b9f5e795 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:20.903557 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37b24a-2427-4658-b3ae-2c5fdb63a32d admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:20.905242 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-4c37b24a-2427-4658-b3ae-2c5fdb63a32d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:20.928578 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37b24a-2427-4658-b3ae-2c5fdb63a32d admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:20.929474 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1015/2041] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:59:20 2022] POST /identity/v3/projects => generated 377 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 11:59:20.933566 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b916c-03cc-48e5-a463-58f3b9f5e795 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:20.992122 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be39e9-86ad-4a1d-aee2-a2dc4e157321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:20.993037 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be39e9-86ad-4a1d-aee2-a2dc4e157321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:20.993323 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be39e9-86ad-4a1d-aee2-a2dc4e157321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:20.993600 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be39e9-86ad-4a1d-aee2-a2dc4e157321 admin admin] PATH_INFO: `/v3/users/8c37523b770c41799670f463dec3f22c` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:20.994857 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be39e9-86ad-4a1d-aee2-a2dc4e157321 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c37523b770c41799670f463dec3f22c)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:20.997466 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be39e9-86ad-4a1d-aee2-a2dc4e157321 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:21.002585 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b916c-03cc-48e5-a463-58f3b9f5e795 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:21.009541 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e25fa-0275-4ea8-9297-c582c0869f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:21.010656 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e25fa-0275-4ea8-9297-c582c0869f7c admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:21.010656 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e25fa-0275-4ea8-9297-c582c0869f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:21.011467 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e25fa-0275-4ea8-9297-c582c0869f7c admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:21.012382 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3e25fa-0275-4ea8-9297-c582c0869f7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:21.015176 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3e25fa-0275-4ea8-9297-c582c0869f7c admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:21.032781 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:21.045661 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1016/2042] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:59:20 2022] POST /identity/v3/users => generated 289 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:59:21.049884 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e25fa-0275-4ea8-9297-c582c0869f7c admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:21.064193 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e25fa-0275-4ea8-9297-c582c0869f7c admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:21.070028 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-91be39e9-86ad-4a1d-aee2-a2dc4e157321 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c37523b770c41799670f463dec3f22c'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:21.070946 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e7ca9-7b5f-4ae0-a55e-1cb3c0bd5efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:21.071455 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e7ca9-7b5f-4ae0-a55e-1cb3c0bd5efc admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:21.071918 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-91be39e9-86ad-4a1d-aee2-a2dc4e157321 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c37523b770c41799670f463dec3f22c'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:21.072053 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e7ca9-7b5f-4ae0-a55e-1cb3c0bd5efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:21.072387 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e7ca9-7b5f-4ae0-a55e-1cb3c0bd5efc admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:21.073295 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e7ca9-7b5f-4ae0-a55e-1cb3c0bd5efc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:21.086629 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e7ca9-7b5f-4ae0-a55e-1cb3c0bd5efc admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:21.089993 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1017/2043] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 11:59:21.093051 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-91be39e9-86ad-4a1d-aee2-a2dc4e157321 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c37523b770c41799670f463dec3f22c'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:21.093479 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e7ca9-7b5f-4ae0-a55e-1cb3c0bd5efc admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:21.096163 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-c63e7ca9-7b5f-4ae0-a55e-1cb3c0bd5efc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:21.102142 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-91be39e9-86ad-4a1d-aee2-a2dc4e157321 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c37523b770c41799670f463dec3f22c'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:21.111012 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-91be39e9-86ad-4a1d-aee2-a2dc4e157321 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c37523b770c41799670f463dec3f22c'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:21.111792 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e7ca9-7b5f-4ae0-a55e-1cb3c0bd5efc admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:21.117888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63999b06-6861-4e42-8caf-9dd2550dabe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:21.119063 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63999b06-6861-4e42-8caf-9dd2550dabe0 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:21.119483 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63999b06-6861-4e42-8caf-9dd2550dabe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:21.120366 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63999b06-6861-4e42-8caf-9dd2550dabe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:21.120685 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63999b06-6861-4e42-8caf-9dd2550dabe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:21.122462 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63999b06-6861-4e42-8caf-9dd2550dabe0 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:21.126196 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1027/2044] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 11:59:20 2022] DELETE /identity/v3/users/8c37523b770c41799670f463dec3f22c => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:21.130861 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0570265-02fc-40b6-a2b3-2ac096e40a81 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:21.131304 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0570265-02fc-40b6-a2b3-2ac096e40a81 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:21.131761 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0570265-02fc-40b6-a2b3-2ac096e40a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:21.142359 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1018/2045] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:59:21.145163 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63999b06-6861-4e42-8caf-9dd2550dabe0 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:21.156376 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-f0570265-02fc-40b6-a2b3-2ac096e40a81 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:21.158066 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63999b06-6861-4e42-8caf-9dd2550dabe0 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:21.158210 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-f0570265-02fc-40b6-a2b3-2ac096e40a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:21.203457 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:21.245129 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f0794-0f86-49b1-ab67-a4a7ad67ff33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:21.246266 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f0794-0f86-49b1-ab67-a4a7ad67ff33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:21.246693 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f0794-0f86-49b1-ab67-a4a7ad67ff33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:21.249281 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1028/2046] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:21.250033 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f0794-0f86-49b1-ab67-a4a7ad67ff33 admin admin] PATH_INFO: `/v3/projects/fb902fdc0faa49fc9eb672d0c4c2179e/users/127bfc1abe61475bb210956b953e5b44/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:21.258611 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0570265-02fc-40b6-a2b3-2ac096e40a81 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:21.260197 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-f0570265-02fc-40b6-a2b3-2ac096e40a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:21.273992 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f0794-0f86-49b1-ab67-a4a7ad67ff33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb902fdc0faa49fc9eb672d0c4c2179e, user_id=127bfc1abe61475bb210956b953e5b44, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:21.276689 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f0794-0f86-49b1-ab67-a4a7ad67ff33 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:21.298346 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1019/2047] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:59:21 2022] PUT /identity/v3/projects/fb902fdc0faa49fc9eb672d0c4c2179e/users/127bfc1abe61475bb210956b953e5b44/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 11:59:21.310444 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3584e97-a3bf-430a-862f-7dc80f3248b7 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:21.310816 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3584e97-a3bf-430a-862f-7dc80f3248b7 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:21.311097 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3584e97-a3bf-430a-862f-7dc80f3248b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:21.334757 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0570265-02fc-40b6-a2b3-2ac096e40a81 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:21.339974 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-a3584e97-a3bf-430a-862f-7dc80f3248b7 None None] MFA Rules not processed for user `127bfc1abe61475bb210956b953e5b44`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:21.341490 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-a3584e97-a3bf-430a-862f-7dc80f3248b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:21.395785 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870062b0-a1c5-4bc1-a68f-66bb60beea78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:21.396534 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870062b0-a1c5-4bc1-a68f-66bb60beea78 service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:21.396911 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870062b0-a1c5-4bc1-a68f-66bb60beea78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:21.397261 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870062b0-a1c5-4bc1-a68f-66bb60beea78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:21.412224 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:21.433487 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1020/2048] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 11:59:21.438157 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3584e97-a3bf-430a-862f-7dc80f3248b7 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:21.497449 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870062b0-a1c5-4bc1-a68f-66bb60beea78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:21.499169 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870062b0-a1c5-4bc1-a68f-66bb60beea78 service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:21.512790 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1029/2049] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:59:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:59:21.600482 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3584e97-a3bf-430a-862f-7dc80f3248b7 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:21.610718 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814e4c2-0afc-40ed-a9b1-b0a0a969b867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:21.614051 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814e4c2-0afc-40ed-a9b1-b0a0a969b867 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:21.615198 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814e4c2-0afc-40ed-a9b1-b0a0a969b867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:21.615494 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814e4c2-0afc-40ed-a9b1-b0a0a969b867 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:21.617461 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2814e4c2-0afc-40ed-a9b1-b0a0a969b867 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:21.622675 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2814e4c2-0afc-40ed-a9b1-b0a0a969b867 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:21.676389 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870062b0-a1c5-4bc1-a68f-66bb60beea78 service neutron] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:21.676694 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1021/2050] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:59:21 2022] POST /identity/v3/projects => generated 377 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 11:59:21.688352 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870062b0-a1c5-4bc1-a68f-66bb60beea78 service neutron] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:21.816255 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3ae65-c032-4dee-92aa-87a5fc63e142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:21.816935 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3ae65-c032-4dee-92aa-87a5fc63e142 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:21.817358 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3ae65-c032-4dee-92aa-87a5fc63e142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:21.817643 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3ae65-c032-4dee-92aa-87a5fc63e142 admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:21.818333 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c3ae65-c032-4dee-92aa-87a5fc63e142 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:21.820377 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c3ae65-c032-4dee-92aa-87a5fc63e142 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:21.840995 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1030/2051] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:59:21 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 11:59:21.845097 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814e4c2-0afc-40ed-a9b1-b0a0a969b867 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:21.857000 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814e4c2-0afc-40ed-a9b1-b0a0a969b867 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:21.861854 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaada95-72eb-41a1-9707-0b2acac0a933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:21.862516 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaada95-72eb-41a1-9707-0b2acac0a933 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:21.862796 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaada95-72eb-41a1-9707-0b2acac0a933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:21.863070 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaada95-72eb-41a1-9707-0b2acac0a933 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:21.863936 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaada95-72eb-41a1-9707-0b2acac0a933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:21.865525 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaada95-72eb-41a1-9707-0b2acac0a933 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:21.877014 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1022/2052] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 11:59:21.882313 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3ae65-c032-4dee-92aa-87a5fc63e142 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:21.893573 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3ae65-c032-4dee-92aa-87a5fc63e142 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:21.900399 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78900e-2a3d-4cb5-ab25-6aa3cd6c75a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:21.901083 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78900e-2a3d-4cb5-ab25-6aa3cd6c75a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:21.901371 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78900e-2a3d-4cb5-ab25-6aa3cd6c75a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:21.901647 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78900e-2a3d-4cb5-ab25-6aa3cd6c75a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:21.902624 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78900e-2a3d-4cb5-ab25-6aa3cd6c75a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:21.904034 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78900e-2a3d-4cb5-ab25-6aa3cd6c75a3 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:21.915539 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1031/2053] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:59:21.919670 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaada95-72eb-41a1-9707-0b2acac0a933 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:21.930770 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaada95-72eb-41a1-9707-0b2acac0a933 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:21.936628 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899010f-825c-4697-b4f4-05f625760c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:21.937600 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899010f-825c-4697-b4f4-05f625760c14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:21.938593 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899010f-825c-4697-b4f4-05f625760c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:21.938835 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899010f-825c-4697-b4f4-05f625760c14 admin admin] PATH_INFO: `/v3/projects/22df859928de4f97bff0f748f9d3d4b6/users/a62b729742994849b57285d64ba12c17/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:21.953983 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6899010f-825c-4697-b4f4-05f625760c14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22df859928de4f97bff0f748f9d3d4b6, user_id=a62b729742994849b57285d64ba12c17, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:21.956652 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6899010f-825c-4697-b4f4-05f625760c14 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:21.959748 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:21.970902 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1023/2054] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:59:21 2022] PUT /identity/v3/projects/22df859928de4f97bff0f748f9d3d4b6/users/a62b729742994849b57285d64ba12c17/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:21.981604 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac6c06-c42d-4c38-bdfb-c9e89ad6d7fd None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:21.982065 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac6c06-c42d-4c38-bdfb-c9e89ad6d7fd None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:21.982288 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac6c06-c42d-4c38-bdfb-c9e89ad6d7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:22.033461 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-1dac6c06-c42d-4c38-bdfb-c9e89ad6d7fd None None] MFA Rules not processed for user `a62b729742994849b57285d64ba12c17`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:22.034734 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-1dac6c06-c42d-4c38-bdfb-c9e89ad6d7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:22.122714 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1032/2055] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:22.127004 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899010f-825c-4697-b4f4-05f625760c14 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:22.181034 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac6c06-c42d-4c38-bdfb-c9e89ad6d7fd None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:22.182496 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-1dac6c06-c42d-4c38-bdfb-c9e89ad6d7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:22.205661 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:22.226988 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899010f-825c-4697-b4f4-05f625760c14 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:22.232949 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1039d5e-0a1b-48d2-9a4e-4af4f3fac6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:22.233626 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1039d5e-0a1b-48d2-9a4e-4af4f3fac6b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:22.233908 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1039d5e-0a1b-48d2-9a4e-4af4f3fac6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:22.234183 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1039d5e-0a1b-48d2-9a4e-4af4f3fac6b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:22.234925 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1039d5e-0a1b-48d2-9a4e-4af4f3fac6b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:22.236924 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1039d5e-0a1b-48d2-9a4e-4af4f3fac6b5 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:22.265442 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1024/2056] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:59:22 2022] POST /identity/v3/projects => generated 377 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 11:59:22.265787 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac6c06-c42d-4c38-bdfb-c9e89ad6d7fd None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:22.269417 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1039d5e-0a1b-48d2-9a4e-4af4f3fac6b5 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:22.332690 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4eb336-4a7e-49f6-8c65-2c103d459931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:22.333886 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4eb336-4a7e-49f6-8c65-2c103d459931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:22.334167 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4eb336-4a7e-49f6-8c65-2c103d459931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:22.334435 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4eb336-4a7e-49f6-8c65-2c103d459931 admin admin] PATH_INFO: `/v3/projects/4c6392bea30c46109807845b269614e8` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:22.335712 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4eb336-4a7e-49f6-8c65-2c103d459931 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c6392bea30c46109807845b269614e8)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:22.337631 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4eb336-4a7e-49f6-8c65-2c103d459931 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:22.341604 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1039d5e-0a1b-48d2-9a4e-4af4f3fac6b5 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:22.348127 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ddf4b1-3a59-448d-9ea5-ce540f1e0f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:22.348840 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ddf4b1-3a59-448d-9ea5-ce540f1e0f5a admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:22.349127 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ddf4b1-3a59-448d-9ea5-ce540f1e0f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:22.350014 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ddf4b1-3a59-448d-9ea5-ce540f1e0f5a admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:22.350634 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ddf4b1-3a59-448d-9ea5-ce540f1e0f5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:22.352641 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ddf4b1-3a59-448d-9ea5-ce540f1e0f5a admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:22.375607 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1025/2057] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:59:22 2022] POST /identity/v3/users => generated 295 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 11:59:22.379843 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ddf4b1-3a59-448d-9ea5-ce540f1e0f5a admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:22.392195 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ddf4b1-3a59-448d-9ea5-ce540f1e0f5a admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:22.394238 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-5c4eb336-4a7e-49f6-8c65-2c103d459931 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c6392bea30c46109807845b269614e8', 'request_id': 'req-5c4eb336-4a7e-49f6-8c65-2c103d459931'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:22.401330 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-5c4eb336-4a7e-49f6-8c65-2c103d459931 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c6392bea30c46109807845b269614e8', 'request_id': 'req-5c4eb336-4a7e-49f6-8c65-2c103d459931'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:22.415536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-5c4eb336-4a7e-49f6-8c65-2c103d459931 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c6392bea30c46109807845b269614e8', 'request_id': 'req-5c4eb336-4a7e-49f6-8c65-2c103d459931'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:22.430497 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-5c4eb336-4a7e-49f6-8c65-2c103d459931 admin admin] The token cache is being invalidate because project 4c6392bea30c46109807845b269614e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 11:59:22.430779 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-5c4eb336-4a7e-49f6-8c65-2c103d459931 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:22.431527 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-5c4eb336-4a7e-49f6-8c65-2c103d459931 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:22.442226 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1033/2058] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 11:59:22 2022] DELETE /identity/v3/projects/4c6392bea30c46109807845b269614e8 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 11:59:22.443744 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a66021-846e-4396-be3d-7c9058e5a49a None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:22.444132 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a66021-846e-4396-be3d-7c9058e5a49a None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:22.444457 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a66021-846e-4396-be3d-7c9058e5a49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:22.463264 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf882ec3-505e-4ce5-a341-9c75dacef681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:22.463932 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-d6a66021-846e-4396-be3d-7c9058e5a49a None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:22.464046 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf882ec3-505e-4ce5-a341-9c75dacef681 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:22.464269 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf882ec3-505e-4ce5-a341-9c75dacef681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:22.464535 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf882ec3-505e-4ce5-a341-9c75dacef681 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:22.465240 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-d6a66021-846e-4396-be3d-7c9058e5a49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:22.465358 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf882ec3-505e-4ce5-a341-9c75dacef681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:22.466885 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf882ec3-505e-4ce5-a341-9c75dacef681 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:22.474277 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1034/2059] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:22.483029 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1026/2060] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:59:22.484112 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf882ec3-505e-4ce5-a341-9c75dacef681 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:22.484227 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14758ab7-9d32-44a5-8651-f6d77bcaaee5 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:22.484416 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14758ab7-9d32-44a5-8651-f6d77bcaaee5 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:22.484696 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14758ab7-9d32-44a5-8651-f6d77bcaaee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:22.485873 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-cf882ec3-505e-4ce5-a341-9c75dacef681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:22.501720 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf882ec3-505e-4ce5-a341-9c75dacef681 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:22.504294 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-14758ab7-9d32-44a5-8651-f6d77bcaaee5 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:22.505578 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-14758ab7-9d32-44a5-8651-f6d77bcaaee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:22.507124 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed98456-f4b4-42cc-bf3f-1fd6d35fc211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:22.508055 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed98456-f4b4-42cc-bf3f-1fd6d35fc211 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:22.508341 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed98456-f4b4-42cc-bf3f-1fd6d35fc211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:22.508621 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed98456-f4b4-42cc-bf3f-1fd6d35fc211 admin admin] PATH_INFO: `/v3/projects/e0bd389c8bb24e02a31de2c9f8761fa3/users/d44957d0550a4c1b966ee53e6388d716/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:22.511902 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:22.515302 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1035/2061] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:22.520053 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14758ab7-9d32-44a5-8651-f6d77bcaaee5 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:22.529059 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed98456-f4b4-42cc-bf3f-1fd6d35fc211 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0bd389c8bb24e02a31de2c9f8761fa3, user_id=d44957d0550a4c1b966ee53e6388d716, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:22.530692 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14758ab7-9d32-44a5-8651-f6d77bcaaee5 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:22.532554 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed98456-f4b4-42cc-bf3f-1fd6d35fc211 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:22.535769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e5c57-696d-41fa-a0e0-59a5c4ce6b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:22.536455 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e5c57-696d-41fa-a0e0-59a5c4ce6b0c admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:22.536744 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e5c57-696d-41fa-a0e0-59a5c4ce6b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:22.537030 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e5c57-696d-41fa-a0e0-59a5c4ce6b0c admin admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:22.537765 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386e5c57-696d-41fa-a0e0-59a5c4ce6b0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:59:22.538625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386e5c57-696d-41fa-a0e0-59a5c4ce6b0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:22.540304 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386e5c57-696d-41fa-a0e0-59a5c4ce6b0c admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:22.548319 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1027/2062] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:59:22 2022] PUT /identity/v3/projects/e0bd389c8bb24e02a31de2c9f8761fa3/users/d44957d0550a4c1b966ee53e6388d716/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:22.552092 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed98456-f4b4-42cc-bf3f-1fd6d35fc211 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:22.556735 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1036/2063] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 11:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 11:59:22.561719 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e5c57-696d-41fa-a0e0-59a5c4ce6b0c admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:22.575803 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e5c57-696d-41fa-a0e0-59a5c4ce6b0c admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:22.605186 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:22.628970 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed98456-f4b4-42cc-bf3f-1fd6d35fc211 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:22.634328 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae303c-1802-47c0-b3fc-d7f58839a72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:22.635044 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae303c-1802-47c0-b3fc-d7f58839a72b admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:22.635393 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae303c-1802-47c0-b3fc-d7f58839a72b admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:22.635731 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae303c-1802-47c0-b3fc-d7f58839a72b admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:22.636510 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ae303c-1802-47c0-b3fc-d7f58839a72b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:22.638111 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ae303c-1802-47c0-b3fc-d7f58839a72b admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:22.640179 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260545f-794f-4cfe-966e-7da201b2bb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:22.640846 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260545f-794f-4cfe-966e-7da201b2bb1a admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:22.641131 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260545f-794f-4cfe-966e-7da201b2bb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:22.641407 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260545f-794f-4cfe-966e-7da201b2bb1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:22.642101 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d260545f-794f-4cfe-966e-7da201b2bb1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:22.644039 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d260545f-794f-4cfe-966e-7da201b2bb1a admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:22.650409 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1028/2064] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 11:59:22.654008 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae303c-1802-47c0-b3fc-d7f58839a72b admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:22.667101 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae303c-1802-47c0-b3fc-d7f58839a72b admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:22.672539 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd60ca2-834f-4a5f-9dda-b8f046b43164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:22.673730 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd60ca2-834f-4a5f-9dda-b8f046b43164 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:22.674030 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd60ca2-834f-4a5f-9dda-b8f046b43164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:22.674496 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd60ca2-834f-4a5f-9dda-b8f046b43164 admin admin] PATH_INFO: `/v3/projects/e0bd389c8bb24e02a31de2c9f8761fa3/users/d44957d0550a4c1b966ee53e6388d716/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:22.676651 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd60ca2-834f-4a5f-9dda-b8f046b43164 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0bd389c8bb24e02a31de2c9f8761fa3, user_id=d44957d0550a4c1b966ee53e6388d716, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:22.680086 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd60ca2-834f-4a5f-9dda-b8f046b43164 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:22.700180 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1029/2065] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:59:22 2022] PUT /identity/v3/projects/e0bd389c8bb24e02a31de2c9f8761fa3/users/d44957d0550a4c1b966ee53e6388d716/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 11:59:22.707539 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1037/2066] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:59:22 2022] POST /identity/v3/projects => generated 369 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:59:22.712294 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260545f-794f-4cfe-966e-7da201b2bb1a admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:22.714936 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54486a86-7010-4ff2-8f31-27fb86422fc8 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:22.715352 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54486a86-7010-4ff2-8f31-27fb86422fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:22.715673 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54486a86-7010-4ff2-8f31-27fb86422fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:22.753675 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-54486a86-7010-4ff2-8f31-27fb86422fc8 None None] MFA Rules not processed for user `d44957d0550a4c1b966ee53e6388d716`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:22.755113 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-54486a86-7010-4ff2-8f31-27fb86422fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:22.825603 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260545f-794f-4cfe-966e-7da201b2bb1a admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:22.831748 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8f493-ab9d-4796-b886-683c7f373cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:22.834482 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8f493-ab9d-4796-b886-683c7f373cf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:22.835460 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8f493-ab9d-4796-b886-683c7f373cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:22.835889 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8f493-ab9d-4796-b886-683c7f373cf7 admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:22.836921 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b8f493-ab9d-4796-b886-683c7f373cf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:22.840571 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b8f493-ab9d-4796-b886-683c7f373cf7 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:22.861102 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1030/2067] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:22 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:22.874439 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1038/2068] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:59:22 2022] POST /identity/v3/users => generated 285 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:59:22.878007 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54486a86-7010-4ff2-8f31-27fb86422fc8 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:22.891594 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54486a86-7010-4ff2-8f31-27fb86422fc8 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:22.899993 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81c816-88b8-4a15-8f25-1a0df81d0f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:22.900863 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81c816-88b8-4a15-8f25-1a0df81d0f66 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:22.901245 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81c816-88b8-4a15-8f25-1a0df81d0f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:22.901429 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81c816-88b8-4a15-8f25-1a0df81d0f66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:22.902744 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec81c816-88b8-4a15-8f25-1a0df81d0f66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:22.905534 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec81c816-88b8-4a15-8f25-1a0df81d0f66 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:22.921822 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1031/2069] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 11:59:22.925687 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8f493-ab9d-4796-b886-683c7f373cf7 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:22.947695 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8f493-ab9d-4796-b886-683c7f373cf7 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:22.955874 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b3ffd6-d583-4582-a540-b0cf5e0e877a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:22.956582 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3ffd6-d583-4582-a540-b0cf5e0e877a admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:22.956872 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3ffd6-d583-4582-a540-b0cf5e0e877a admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:22.957154 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3ffd6-d583-4582-a540-b0cf5e0e877a admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:22.957895 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b3ffd6-d583-4582-a540-b0cf5e0e877a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:22.959531 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b3ffd6-d583-4582-a540-b0cf5e0e877a admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:22.973538 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1039/2070] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:59:22.975151 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81c816-88b8-4a15-8f25-1a0df81d0f66 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:22.987762 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81c816-88b8-4a15-8f25-1a0df81d0f66 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:22.993410 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2147611-6ec3-44a2-bf14-a11b720ba760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:22.994428 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2147611-6ec3-44a2-bf14-a11b720ba760 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:22.994722 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2147611-6ec3-44a2-bf14-a11b720ba760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:22.994983 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2147611-6ec3-44a2-bf14-a11b720ba760 admin admin] PATH_INFO: `/v3/projects/75f93cd1b2a5494e933eedb3af0c283a/users/c82999dd117a4335ae779cd92d45db4b/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:23.012741 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2147611-6ec3-44a2-bf14-a11b720ba760 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75f93cd1b2a5494e933eedb3af0c283a, user_id=c82999dd117a4335ae779cd92d45db4b, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:23.015482 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2147611-6ec3-44a2-bf14-a11b720ba760 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:23.030616 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1032/2071] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:59:22 2022] PUT /identity/v3/projects/75f93cd1b2a5494e933eedb3af0c283a/users/c82999dd117a4335ae779cd92d45db4b/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:23.035587 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114ffda-60df-4e5e-8f60-e01c3c4187fd None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:23.036074 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114ffda-60df-4e5e-8f60-e01c3c4187fd None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:23.036167 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114ffda-60df-4e5e-8f60-e01c3c4187fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:23.052671 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2147611-6ec3-44a2-bf14-a11b720ba760 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:23.054562 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-c2147611-6ec3-44a2-bf14-a11b720ba760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:23.054920 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-3114ffda-60df-4e5e-8f60-e01c3c4187fd None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:23.056150 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-3114ffda-60df-4e5e-8f60-e01c3c4187fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:23.075186 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:23.119236 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2147611-6ec3-44a2-bf14-a11b720ba760 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:23.123573 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1040/2072] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:23.123741 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23b04e-ce7f-4600-acd3-098b2440e99d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:23.124182 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23b04e-ce7f-4600-acd3-098b2440e99d service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:23.124470 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23b04e-ce7f-4600-acd3-098b2440e99d service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:23.124750 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23b04e-ce7f-4600-acd3-098b2440e99d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:23.133915 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114ffda-60df-4e5e-8f60-e01c3c4187fd None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:23.135063 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-3114ffda-60df-4e5e-8f60-e01c3c4187fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:23.185821 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:23.206353 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc23b04e-ce7f-4600-acd3-098b2440e99d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:23.207538 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc23b04e-ce7f-4600-acd3-098b2440e99d service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:23.223838 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1033/2073] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:59:23 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:59:23.226447 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114ffda-60df-4e5e-8f60-e01c3c4187fd None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:23.232242 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75336d6-86d6-4c7d-8134-7c64940f9352 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:23.233190 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75336d6-86d6-4c7d-8134-7c64940f9352 service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:23.233585 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75336d6-86d6-4c7d-8134-7c64940f9352 service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:23.234373 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75336d6-86d6-4c7d-8134-7c64940f9352 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:23.253352 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75336d6-86d6-4c7d-8134-7c64940f9352 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:23.254868 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75336d6-86d6-4c7d-8134-7c64940f9352 service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:23.281002 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1041/2074] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:59:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 11:59:23.344380 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23b04e-ce7f-4600-acd3-098b2440e99d service cinder] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:23.346043 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-fc23b04e-ce7f-4600-acd3-098b2440e99d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:23.363452 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23b04e-ce7f-4600-acd3-098b2440e99d service cinder] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:23.373321 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a103db-96d7-414d-bf8f-7ead241f9496 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:23.373321 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a103db-96d7-414d-bf8f-7ead241f9496 service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:23.373834 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a103db-96d7-414d-bf8f-7ead241f9496 service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:23.375853 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a103db-96d7-414d-bf8f-7ead241f9496 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:23.382713 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-42a103db-96d7-414d-bf8f-7ead241f9496 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:23.486689 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a103db-96d7-414d-bf8f-7ead241f9496 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:23.488324 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a103db-96d7-414d-bf8f-7ead241f9496 service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:23.499332 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1034/2075] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:59:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:59:23.639904 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75336d6-86d6-4c7d-8134-7c64940f9352 service neutron] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:23.654753 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75336d6-86d6-4c7d-8134-7c64940f9352 service neutron] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:23.661981 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db652f0-74c0-4288-9552-6c86bdd7b6b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:23.662910 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db652f0-74c0-4288-9552-6c86bdd7b6b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:23.663700 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db652f0-74c0-4288-9552-6c86bdd7b6b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:23.664203 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db652f0-74c0-4288-9552-6c86bdd7b6b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:23.668641 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-8db652f0-74c0-4288-9552-6c86bdd7b6b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:23.864098 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db652f0-74c0-4288-9552-6c86bdd7b6b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:23.865813 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db652f0-74c0-4288-9552-6c86bdd7b6b7 service cinder] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:23.915981 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1042/2076] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:59:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:59:24.358956 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde268f-42c3-43a5-9e31-b8179c072797 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:24.359489 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde268f-42c3-43a5-9e31-b8179c072797 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:24.359489 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde268f-42c3-43a5-9e31-b8179c072797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:24.416046 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-dbde268f-42c3-43a5-9e31-b8179c072797 None None] MFA Rules not processed for user `c82999dd117a4335ae779cd92d45db4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:24.417560 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-dbde268f-42c3-43a5-9e31-b8179c072797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:24.499037 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:24.525605 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1035/2077] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:24 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:24.792787 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db652f0-74c0-4288-9552-6c86bdd7b6b7 service cinder] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:24.808772 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db652f0-74c0-4288-9552-6c86bdd7b6b7 service cinder] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:24.824678 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a02dc-df82-4ea1-b8a0-f3fe78bc05ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:24.827920 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a02dc-df82-4ea1-b8a0-f3fe78bc05ae service cinder] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:24.828430 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a02dc-df82-4ea1-b8a0-f3fe78bc05ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:24.828972 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a02dc-df82-4ea1-b8a0-f3fe78bc05ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:24.859382 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a02dc-df82-4ea1-b8a0-f3fe78bc05ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:24.863272 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a02dc-df82-4ea1-b8a0-f3fe78bc05ae service cinder] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:24.893444 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1043/2078] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:59:24 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 11:59:25.827359 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde268f-42c3-43a5-9e31-b8179c072797 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:25.828872 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-dbde268f-42c3-43a5-9e31-b8179c072797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:25.849995 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde268f-42c3-43a5-9e31-b8179c072797 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:25.856667 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917761ab-9791-4c1d-8eea-09875bcb1dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:25.857934 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917761ab-9791-4c1d-8eea-09875bcb1dab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:25.858490 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917761ab-9791-4c1d-8eea-09875bcb1dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:25.858862 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917761ab-9791-4c1d-8eea-09875bcb1dab admin admin] PATH_INFO: `/v3/users/9aa7bf5bdfe64fce865aceee7415c0fc` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:25.860321 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917761ab-9791-4c1d-8eea-09875bcb1dab admin admin] RBAC: Authorizing `identity:delete_user(user_id=9aa7bf5bdfe64fce865aceee7415c0fc)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:25.863183 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917761ab-9791-4c1d-8eea-09875bcb1dab admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:25.924470 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-917761ab-9791-4c1d-8eea-09875bcb1dab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9aa7bf5bdfe64fce865aceee7415c0fc'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:25.934771 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-917761ab-9791-4c1d-8eea-09875bcb1dab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9aa7bf5bdfe64fce865aceee7415c0fc'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:25.935571 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-917761ab-9791-4c1d-8eea-09875bcb1dab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9aa7bf5bdfe64fce865aceee7415c0fc'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:25.950328 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-917761ab-9791-4c1d-8eea-09875bcb1dab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9aa7bf5bdfe64fce865aceee7415c0fc'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:25.958845 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-917761ab-9791-4c1d-8eea-09875bcb1dab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9aa7bf5bdfe64fce865aceee7415c0fc'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:25.967856 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1036/2079] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 11:59:25 2022] DELETE /identity/v3/users/9aa7bf5bdfe64fce865aceee7415c0fc => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:25.973135 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d649a7-f46a-4283-8c0f-a6f56295c456 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:25.974063 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d649a7-f46a-4283-8c0f-a6f56295c456 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:25.974403 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d649a7-f46a-4283-8c0f-a6f56295c456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:26.004048 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-80d649a7-f46a-4283-8c0f-a6f56295c456 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:26.005265 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-80d649a7-f46a-4283-8c0f-a6f56295c456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:26.113589 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1044/2080] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:26.123979 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917761ab-9791-4c1d-8eea-09875bcb1dab admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:26.125429 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-917761ab-9791-4c1d-8eea-09875bcb1dab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:26.207582 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917761ab-9791-4c1d-8eea-09875bcb1dab admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:26.210827 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8848130-bcf3-4472-b461-93045e518ba8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:26.211472 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8848130-bcf3-4472-b461-93045e518ba8 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:26.211878 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8848130-bcf3-4472-b461-93045e518ba8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:26.212151 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8848130-bcf3-4472-b461-93045e518ba8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:26.221961 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8848130-bcf3-4472-b461-93045e518ba8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:26.223484 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8848130-bcf3-4472-b461-93045e518ba8 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:26.234038 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1037/2081] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:59:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:59:26.443980 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa62651-77f9-45f8-ac13-15b5d3a11e8e None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:26.444811 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa62651-77f9-45f8-ac13-15b5d3a11e8e None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:26.445276 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa62651-77f9-45f8-ac13-15b5d3a11e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:26.464882 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-6fa62651-77f9-45f8-ac13-15b5d3a11e8e None None] MFA Rules not processed for user `c82999dd117a4335ae779cd92d45db4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:26.466948 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-6fa62651-77f9-45f8-ac13-15b5d3a11e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:26.533007 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8848130-bcf3-4472-b461-93045e518ba8 service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:26.534630 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-e8848130-bcf3-4472-b461-93045e518ba8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:26.541062 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1045/2082] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:26 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:26.548642 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8848130-bcf3-4472-b461-93045e518ba8 service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:26.554057 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe6308d-575e-4fb8-a579-4e504ef501eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:26.554985 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6308d-575e-4fb8-a579-4e504ef501eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:26.555204 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6308d-575e-4fb8-a579-4e504ef501eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:26.555482 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6308d-575e-4fb8-a579-4e504ef501eb admin admin] PATH_INFO: `/v3/projects/bb1074ce67f448ccb05fe5b2a08d9bde` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:26.556811 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe6308d-575e-4fb8-a579-4e504ef501eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb1074ce67f448ccb05fe5b2a08d9bde)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:26.558724 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe6308d-575e-4fb8-a579-4e504ef501eb admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:26.636181 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-9fe6308d-575e-4fb8-a579-4e504ef501eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb1074ce67f448ccb05fe5b2a08d9bde', 'request_id': 'req-9fe6308d-575e-4fb8-a579-4e504ef501eb'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:26.643240 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-9fe6308d-575e-4fb8-a579-4e504ef501eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb1074ce67f448ccb05fe5b2a08d9bde', 'request_id': 'req-9fe6308d-575e-4fb8-a579-4e504ef501eb'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:26.648265 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:26.659897 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-9fe6308d-575e-4fb8-a579-4e504ef501eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb1074ce67f448ccb05fe5b2a08d9bde', 'request_id': 'req-9fe6308d-575e-4fb8-a579-4e504ef501eb'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:26.680387 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-9fe6308d-575e-4fb8-a579-4e504ef501eb admin admin] The token cache is being invalidate because project bb1074ce67f448ccb05fe5b2a08d9bde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 11:59:26.680848 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-9fe6308d-575e-4fb8-a579-4e504ef501eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:26.682504 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-9fe6308d-575e-4fb8-a579-4e504ef501eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:26.687545 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1038/2083] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 11:59:26 2022] DELETE /identity/v3/projects/bb1074ce67f448ccb05fe5b2a08d9bde => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 11:59:26.689077 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa62651-77f9-45f8-ac13-15b5d3a11e8e None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:26.701628 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa62651-77f9-45f8-ac13-15b5d3a11e8e None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:26.706944 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=100 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:26.777111 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9db5bc-15db-4a2c-bfb8-c8da624183d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:26.778029 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9db5bc-15db-4a2c-bfb8-c8da624183d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:26.778314 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9db5bc-15db-4a2c-bfb8-c8da624183d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:26.778595 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9db5bc-15db-4a2c-bfb8-c8da624183d8 admin admin] PATH_INFO: `/v3/users/f10a6e92cd4d4ece8e8eed0d42cbb0a6` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:26.779897 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9db5bc-15db-4a2c-bfb8-c8da624183d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f10a6e92cd4d4ece8e8eed0d42cbb0a6)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:26.781833 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9db5bc-15db-4a2c-bfb8-c8da624183d8 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:26.836088 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe6308d-575e-4fb8-a579-4e504ef501eb admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:26.838537 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-9fe6308d-575e-4fb8-a579-4e504ef501eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:26.839160 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-4b9db5bc-15db-4a2c-bfb8-c8da624183d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f10a6e92cd4d4ece8e8eed0d42cbb0a6'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:26.840075 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-4b9db5bc-15db-4a2c-bfb8-c8da624183d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f10a6e92cd4d4ece8e8eed0d42cbb0a6'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:26.858394 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-4b9db5bc-15db-4a2c-bfb8-c8da624183d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f10a6e92cd4d4ece8e8eed0d42cbb0a6'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:26.865672 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe6308d-575e-4fb8-a579-4e504ef501eb admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:26.869273 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-4b9db5bc-15db-4a2c-bfb8-c8da624183d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f10a6e92cd4d4ece8e8eed0d42cbb0a6'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:26.871655 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9789914c-7f9e-478d-ada7-fa51e1a1f0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:26.873472 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789914c-7f9e-478d-ada7-fa51e1a1f0d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:26.874081 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789914c-7f9e-478d-ada7-fa51e1a1f0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:26.874478 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789914c-7f9e-478d-ada7-fa51e1a1f0d4 admin admin] PATH_INFO: `/v3/users/6fd22208312141bebc2a76497d9c7178` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:26.876120 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9789914c-7f9e-478d-ada7-fa51e1a1f0d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fd22208312141bebc2a76497d9c7178)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:26.877979 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-4b9db5bc-15db-4a2c-bfb8-c8da624183d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f10a6e92cd4d4ece8e8eed0d42cbb0a6'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:26.879230 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9789914c-7f9e-478d-ada7-fa51e1a1f0d4 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:26.887280 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1046/2084] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 11:59:26 2022] DELETE /identity/v3/users/f10a6e92cd4d4ece8e8eed0d42cbb0a6 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:26.937723 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-9789914c-7f9e-478d-ada7-fa51e1a1f0d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fd22208312141bebc2a76497d9c7178'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:26.946077 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-9789914c-7f9e-478d-ada7-fa51e1a1f0d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fd22208312141bebc2a76497d9c7178'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:26.946800 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-9789914c-7f9e-478d-ada7-fa51e1a1f0d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fd22208312141bebc2a76497d9c7178'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:26.965918 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-9789914c-7f9e-478d-ada7-fa51e1a1f0d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fd22208312141bebc2a76497d9c7178'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:26.977550 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-9789914c-7f9e-478d-ada7-fa51e1a1f0d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fd22208312141bebc2a76497d9c7178'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:26.986489 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1039/2085] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 11:59:26 2022] DELETE /identity/v3/users/6fd22208312141bebc2a76497d9c7178 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 11:59:26.991036 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27766367-2fdb-4657-9c1c-9eb6089358b9 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:26.992164 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27766367-2fdb-4657-9c1c-9eb6089358b9 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:26.992258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27766367-2fdb-4657-9c1c-9eb6089358b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:27.011818 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-27766367-2fdb-4657-9c1c-9eb6089358b9 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:27.013000 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-27766367-2fdb-4657-9c1c-9eb6089358b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:27.086898 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1047/2086] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:27.098011 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9789914c-7f9e-478d-ada7-fa51e1a1f0d4 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:27.101349 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-9789914c-7f9e-478d-ada7-fa51e1a1f0d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:27.175253 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9789914c-7f9e-478d-ada7-fa51e1a1f0d4 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:27.180840 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e86796-8172-4f0c-b5e1-e74ea9fdc58f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:27.181495 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e86796-8172-4f0c-b5e1-e74ea9fdc58f service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:27.181848 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e86796-8172-4f0c-b5e1-e74ea9fdc58f service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:27.182058 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e86796-8172-4f0c-b5e1-e74ea9fdc58f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:27.192053 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e86796-8172-4f0c-b5e1-e74ea9fdc58f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:27.193511 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e86796-8172-4f0c-b5e1-e74ea9fdc58f service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:27.207630 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1040/2087] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:59:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:59:27.221005 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27766367-2fdb-4657-9c1c-9eb6089358b9 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:27.222458 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-27766367-2fdb-4657-9c1c-9eb6089358b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:27.248198 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27766367-2fdb-4657-9c1c-9eb6089358b9 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:27.253976 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c6d03-6a4e-4403-acc7-9f5c3a739244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:27.254871 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c6d03-6a4e-4403-acc7-9f5c3a739244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:27.255198 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c6d03-6a4e-4403-acc7-9f5c3a739244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:27.255557 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c6d03-6a4e-4403-acc7-9f5c3a739244 admin admin] PATH_INFO: `/v3/projects/ce5a281bc8cb40bf8b80e2dfb7de2b55` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:27.258278 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c6d03-6a4e-4403-acc7-9f5c3a739244 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce5a281bc8cb40bf8b80e2dfb7de2b55)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:27.260280 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c6d03-6a4e-4403-acc7-9f5c3a739244 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:27.291208 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:27.325430 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-972c6d03-6a4e-4403-acc7-9f5c3a739244 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce5a281bc8cb40bf8b80e2dfb7de2b55', 'request_id': 'req-972c6d03-6a4e-4403-acc7-9f5c3a739244'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:27.333820 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-972c6d03-6a4e-4403-acc7-9f5c3a739244 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce5a281bc8cb40bf8b80e2dfb7de2b55', 'request_id': 'req-972c6d03-6a4e-4403-acc7-9f5c3a739244'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:27.351083 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-972c6d03-6a4e-4403-acc7-9f5c3a739244 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce5a281bc8cb40bf8b80e2dfb7de2b55', 'request_id': 'req-972c6d03-6a4e-4403-acc7-9f5c3a739244'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:27.366680 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-972c6d03-6a4e-4403-acc7-9f5c3a739244 admin admin] The token cache is being invalidate because project ce5a281bc8cb40bf8b80e2dfb7de2b55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 11:59:27.367113 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-972c6d03-6a4e-4403-acc7-9f5c3a739244 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:27.368149 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-972c6d03-6a4e-4403-acc7-9f5c3a739244 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:27.370029 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1048/2088] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 11:59:27 2022] DELETE /identity/v3/projects/ce5a281bc8cb40bf8b80e2dfb7de2b55 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:27.375375 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e86796-8172-4f0c-b5e1-e74ea9fdc58f service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:27.389608 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e86796-8172-4f0c-b5e1-e74ea9fdc58f service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:27.417000 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c6d03-6a4e-4403-acc7-9f5c3a739244 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:27.420655 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-972c6d03-6a4e-4403-acc7-9f5c3a739244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:27.520520 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77375ac7-07c3-411a-8f5f-d8aba7ef3526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:27.521407 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77375ac7-07c3-411a-8f5f-d8aba7ef3526 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:27.521694 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77375ac7-07c3-411a-8f5f-d8aba7ef3526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:27.522031 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77375ac7-07c3-411a-8f5f-d8aba7ef3526 admin admin] PATH_INFO: `/v3/users/1d48fe2008d94171a90328c3b5fe03c0` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:27.523955 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77375ac7-07c3-411a-8f5f-d8aba7ef3526 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d48fe2008d94171a90328c3b5fe03c0)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:27.526282 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77375ac7-07c3-411a-8f5f-d8aba7ef3526 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:27.529411 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c6d03-6a4e-4403-acc7-9f5c3a739244 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:27.533945 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:27.537624 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320716d-bc34-43a7-9f7f-df9ffea41a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:27.539941 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320716d-bc34-43a7-9f7f-df9ffea41a1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:27.540312 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320716d-bc34-43a7-9f7f-df9ffea41a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:27.540681 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320716d-bc34-43a7-9f7f-df9ffea41a1b admin admin] PATH_INFO: `/v3/users/127bfc1abe61475bb210956b953e5b44` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:27.544760 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2320716d-bc34-43a7-9f7f-df9ffea41a1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=127bfc1abe61475bb210956b953e5b44)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:27.547147 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2320716d-bc34-43a7-9f7f-df9ffea41a1b admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:27.601042 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-77375ac7-07c3-411a-8f5f-d8aba7ef3526 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d48fe2008d94171a90328c3b5fe03c0'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:27.605919 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-2320716d-bc34-43a7-9f7f-df9ffea41a1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '127bfc1abe61475bb210956b953e5b44'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:27.607385 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-2320716d-bc34-43a7-9f7f-df9ffea41a1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '127bfc1abe61475bb210956b953e5b44'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:27.611220 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-77375ac7-07c3-411a-8f5f-d8aba7ef3526 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d48fe2008d94171a90328c3b5fe03c0'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:27.612303 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-77375ac7-07c3-411a-8f5f-d8aba7ef3526 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d48fe2008d94171a90328c3b5fe03c0'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:27.628034 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-2320716d-bc34-43a7-9f7f-df9ffea41a1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '127bfc1abe61475bb210956b953e5b44'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:27.637580 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-77375ac7-07c3-411a-8f5f-d8aba7ef3526 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d48fe2008d94171a90328c3b5fe03c0'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:27.641044 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-2320716d-bc34-43a7-9f7f-df9ffea41a1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '127bfc1abe61475bb210956b953e5b44'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:27.653059 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-2320716d-bc34-43a7-9f7f-df9ffea41a1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '127bfc1abe61475bb210956b953e5b44'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:27.660797 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1049/2089] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 11:59:27 2022] DELETE /identity/v3/users/127bfc1abe61475bb210956b953e5b44 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:27.661342 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-77375ac7-07c3-411a-8f5f-d8aba7ef3526 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d48fe2008d94171a90328c3b5fe03c0'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:27.666610 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541c8f0-1c87-4ff4-b6cc-b55f03d20d40 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:27.666901 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541c8f0-1c87-4ff4-b6cc-b55f03d20d40 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:27.667175 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541c8f0-1c87-4ff4-b6cc-b55f03d20d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:27.672923 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1041/2090] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 11:59:27 2022] DELETE /identity/v3/users/1d48fe2008d94171a90328c3b5fe03c0 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 11:59:27.690743 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-a541c8f0-1c87-4ff4-b6cc-b55f03d20d40 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:27.692491 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-a541c8f0-1c87-4ff4-b6cc-b55f03d20d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:27.723551 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:27.780006 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77375ac7-07c3-411a-8f5f-d8aba7ef3526 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:27.781403 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-77375ac7-07c3-411a-8f5f-d8aba7ef3526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:27.813173 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1050/2091] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 11:59:27.829228 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a541c8f0-1c87-4ff4-b6cc-b55f03d20d40 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:27.834163 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-a541c8f0-1c87-4ff4-b6cc-b55f03d20d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:27.883266 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77375ac7-07c3-411a-8f5f-d8aba7ef3526 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:27.898915 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5572f5-b929-411d-bbc0-93cdcd813864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:27.900748 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5572f5-b929-411d-bbc0-93cdcd813864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:27.901162 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5572f5-b929-411d-bbc0-93cdcd813864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:27.901575 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5572f5-b929-411d-bbc0-93cdcd813864 admin admin] PATH_INFO: `/v3/projects/22f2f8e603954aa7a302a718fa2b053a` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:27.906529 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5572f5-b929-411d-bbc0-93cdcd813864 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22f2f8e603954aa7a302a718fa2b053a)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:27.910281 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5572f5-b929-411d-bbc0-93cdcd813864 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:27.924238 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a541c8f0-1c87-4ff4-b6cc-b55f03d20d40 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:27.928232 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260f06a-622d-4968-82f9-5305720d5f28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:27.928998 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260f06a-622d-4968-82f9-5305720d5f28 service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:27.929371 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260f06a-622d-4968-82f9-5305720d5f28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:27.929720 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260f06a-622d-4968-82f9-5305720d5f28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:27.940212 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260f06a-622d-4968-82f9-5305720d5f28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:27.941732 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260f06a-622d-4968-82f9-5305720d5f28 service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:27.953623 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1051/2092] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:59:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:59:27.968164 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-fc5572f5-b929-411d-bbc0-93cdcd813864 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22f2f8e603954aa7a302a718fa2b053a', 'request_id': 'req-fc5572f5-b929-411d-bbc0-93cdcd813864'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:27.979909 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-fc5572f5-b929-411d-bbc0-93cdcd813864 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22f2f8e603954aa7a302a718fa2b053a', 'request_id': 'req-fc5572f5-b929-411d-bbc0-93cdcd813864'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:27.991997 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-fc5572f5-b929-411d-bbc0-93cdcd813864 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22f2f8e603954aa7a302a718fa2b053a', 'request_id': 'req-fc5572f5-b929-411d-bbc0-93cdcd813864'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:28.004554 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-fc5572f5-b929-411d-bbc0-93cdcd813864 admin admin] The token cache is being invalidate because project 22f2f8e603954aa7a302a718fa2b053a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 11:59:28.005093 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-fc5572f5-b929-411d-bbc0-93cdcd813864 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:28.005958 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-fc5572f5-b929-411d-bbc0-93cdcd813864 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:28.008263 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1042/2093] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 11:59:27 2022] DELETE /identity/v3/projects/22f2f8e603954aa7a302a718fa2b053a => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 11:59:28.012782 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260f06a-622d-4968-82f9-5305720d5f28 service neutron] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:28.023879 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260f06a-622d-4968-82f9-5305720d5f28 service neutron] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:28.030929 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5572f5-b929-411d-bbc0-93cdcd813864 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:28.032887 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-fc5572f5-b929-411d-bbc0-93cdcd813864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:28.057829 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:28.111437 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5572f5-b929-411d-bbc0-93cdcd813864 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:28.116990 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b7cfad-a1d1-4260-9bad-63ea51ca3f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:28.117708 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e8277-fa07-4ffd-9c41-5db236baf18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:28.117838 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7cfad-a1d1-4260-9bad-63ea51ca3f41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:28.118140 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7cfad-a1d1-4260-9bad-63ea51ca3f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:28.118857 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7cfad-a1d1-4260-9bad-63ea51ca3f41 admin admin] PATH_INFO: `/v3/projects/2b0b4db94a68470090b8a786ca0e39da` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:28.119842 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e8277-fa07-4ffd-9c41-5db236baf18d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:28.120336 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b7cfad-a1d1-4260-9bad-63ea51ca3f41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b0b4db94a68470090b8a786ca0e39da)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:28.123636 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e8277-fa07-4ffd-9c41-5db236baf18d admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:28.123636 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e8277-fa07-4ffd-9c41-5db236baf18d admin admin] PATH_INFO: `/v3/users/db8d8f5470da40dba3c13e707183cced` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:28.124018 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b7cfad-a1d1-4260-9bad-63ea51ca3f41 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:28.128566 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e8277-fa07-4ffd-9c41-5db236baf18d admin admin] RBAC: Authorizing `identity:delete_user(user_id=db8d8f5470da40dba3c13e707183cced)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:28.132329 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e8277-fa07-4ffd-9c41-5db236baf18d admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:28.180719 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-49b7cfad-a1d1-4260-9bad-63ea51ca3f41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b0b4db94a68470090b8a786ca0e39da', 'request_id': 'req-49b7cfad-a1d1-4260-9bad-63ea51ca3f41'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:28.185441 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-106e8277-fa07-4ffd-9c41-5db236baf18d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db8d8f5470da40dba3c13e707183cced'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:28.186166 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-106e8277-fa07-4ffd-9c41-5db236baf18d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db8d8f5470da40dba3c13e707183cced'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:28.188301 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-49b7cfad-a1d1-4260-9bad-63ea51ca3f41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b0b4db94a68470090b8a786ca0e39da', 'request_id': 'req-49b7cfad-a1d1-4260-9bad-63ea51ca3f41'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:28.198020 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-49b7cfad-a1d1-4260-9bad-63ea51ca3f41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b0b4db94a68470090b8a786ca0e39da', 'request_id': 'req-49b7cfad-a1d1-4260-9bad-63ea51ca3f41'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:28.200980 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-106e8277-fa07-4ffd-9c41-5db236baf18d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db8d8f5470da40dba3c13e707183cced'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:28.209047 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-106e8277-fa07-4ffd-9c41-5db236baf18d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db8d8f5470da40dba3c13e707183cced'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:28.210864 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:28.213003 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-49b7cfad-a1d1-4260-9bad-63ea51ca3f41 admin admin] The token cache is being invalidate because project 2b0b4db94a68470090b8a786ca0e39da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 11:59:28.213402 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-49b7cfad-a1d1-4260-9bad-63ea51ca3f41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:28.214694 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-49b7cfad-a1d1-4260-9bad-63ea51ca3f41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:28.216465 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1043/2094] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 11:59:28 2022] DELETE /identity/v3/projects/2b0b4db94a68470090b8a786ca0e39da => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:28.219257 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-106e8277-fa07-4ffd-9c41-5db236baf18d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db8d8f5470da40dba3c13e707183cced'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:28.225849 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05124428-2fa1-4fd0-a1e5-02f2b930147d None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:28.226336 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05124428-2fa1-4fd0-a1e5-02f2b930147d None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:28.226763 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05124428-2fa1-4fd0-a1e5-02f2b930147d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:28.227540 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1052/2095] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 11:59:28 2022] DELETE /identity/v3/users/db8d8f5470da40dba3c13e707183cced => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 11:59:28.249138 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-05124428-2fa1-4fd0-a1e5-02f2b930147d None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:28.250458 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-05124428-2fa1-4fd0-a1e5-02f2b930147d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:28.290843 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e8277-fa07-4ffd-9c41-5db236baf18d admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:28.292989 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-106e8277-fa07-4ffd-9c41-5db236baf18d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:28.355873 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1044/2096] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 11:59:28.366658 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7086f-77e0-4c40-bd38-73434478a210 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:28.366957 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7086f-77e0-4c40-bd38-73434478a210 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:28.367228 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7086f-77e0-4c40-bd38-73434478a210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:28.387955 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-f4d7086f-77e0-4c40-bd38-73434478a210 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:28.390060 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-f4d7086f-77e0-4c40-bd38-73434478a210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:28.400099 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1045/2097] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:28.404667 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7086f-77e0-4c40-bd38-73434478a210 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:28.416684 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7086f-77e0-4c40-bd38-73434478a210 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:28.421382 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766546be-abd3-45dd-88bf-b14252b2df22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:28.422055 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766546be-abd3-45dd-88bf-b14252b2df22 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:28.422334 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766546be-abd3-45dd-88bf-b14252b2df22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:28.422616 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766546be-abd3-45dd-88bf-b14252b2df22 admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:28.423348 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766546be-abd3-45dd-88bf-b14252b2df22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:59:28.423691 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766546be-abd3-45dd-88bf-b14252b2df22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:28.425464 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766546be-abd3-45dd-88bf-b14252b2df22 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:28.431101 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e8277-fa07-4ffd-9c41-5db236baf18d admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:28.437309 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61668a-a30b-4ebb-b59c-4471c44c3a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:28.438601 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61668a-a30b-4ebb-b59c-4471c44c3a2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:28.439084 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61668a-a30b-4ebb-b59c-4471c44c3a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:28.439537 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1046/2098] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 11:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:59:28.440024 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61668a-a30b-4ebb-b59c-4471c44c3a2c admin admin] PATH_INFO: `/v3/projects/fb902fdc0faa49fc9eb672d0c4c2179e` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:28.441726 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa61668a-a30b-4ebb-b59c-4471c44c3a2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb902fdc0faa49fc9eb672d0c4c2179e)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:28.444193 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa61668a-a30b-4ebb-b59c-4471c44c3a2c admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:28.446512 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766546be-abd3-45dd-88bf-b14252b2df22 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:28.459929 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766546be-abd3-45dd-88bf-b14252b2df22 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:28.465077 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f9b32-9362-4659-a160-cc298e855ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:28.465876 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f9b32-9362-4659-a160-cc298e855ce3 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:28.466166 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f9b32-9362-4659-a160-cc298e855ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:28.466442 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f9b32-9362-4659-a160-cc298e855ce3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:28.467237 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f9b32-9362-4659-a160-cc298e855ce3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:28.469083 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f9b32-9362-4659-a160-cc298e855ce3 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:28.515996 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1047/2099] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:59:28 2022] POST /identity/v3/projects => generated 363 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 11:59:28.519864 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f9b32-9362-4659-a160-cc298e855ce3 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:28.528569 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-aa61668a-a30b-4ebb-b59c-4471c44c3a2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb902fdc0faa49fc9eb672d0c4c2179e', 'request_id': 'req-aa61668a-a30b-4ebb-b59c-4471c44c3a2c'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:28.531009 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:28.538363 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-aa61668a-a30b-4ebb-b59c-4471c44c3a2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb902fdc0faa49fc9eb672d0c4c2179e', 'request_id': 'req-aa61668a-a30b-4ebb-b59c-4471c44c3a2c'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:28.550548 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-aa61668a-a30b-4ebb-b59c-4471c44c3a2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb902fdc0faa49fc9eb672d0c4c2179e', 'request_id': 'req-aa61668a-a30b-4ebb-b59c-4471c44c3a2c'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:28.568489 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-aa61668a-a30b-4ebb-b59c-4471c44c3a2c admin admin] The token cache is being invalidate because project fb902fdc0faa49fc9eb672d0c4c2179e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 11:59:28.568880 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-aa61668a-a30b-4ebb-b59c-4471c44c3a2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:28.569731 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-aa61668a-a30b-4ebb-b59c-4471c44c3a2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:28.571522 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1053/2100] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 11:59:28 2022] DELETE /identity/v3/projects/fb902fdc0faa49fc9eb672d0c4c2179e => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:28.575309 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61668a-a30b-4ebb-b59c-4471c44c3a2c admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:28.577370 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-aa61668a-a30b-4ebb-b59c-4471c44c3a2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:28.608945 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f9b32-9362-4659-a160-cc298e855ce3 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:28.621754 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39364426-e8b9-436a-9fa0-17c940b83a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:28.629862 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39364426-e8b9-436a-9fa0-17c940b83a63 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:28.630154 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39364426-e8b9-436a-9fa0-17c940b83a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:28.630433 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39364426-e8b9-436a-9fa0-17c940b83a63 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:28.631526 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39364426-e8b9-436a-9fa0-17c940b83a63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:28.633721 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39364426-e8b9-436a-9fa0-17c940b83a63 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:28.661967 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1048/2101] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:59:28 2022] POST /identity/v3/users => generated 282 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:59:28.663604 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39364426-e8b9-436a-9fa0-17c940b83a63 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:28.665503 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-39364426-e8b9-436a-9fa0-17c940b83a63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:28.677540 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61668a-a30b-4ebb-b59c-4471c44c3a2c admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:28.678250 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39364426-e8b9-436a-9fa0-17c940b83a63 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:28.683540 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55102c13-3e09-4c4c-b5d1-47bc20df01e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:28.683965 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f67c30-c6e3-412a-ab9a-b22b4169ca90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:28.684522 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55102c13-3e09-4c4c-b5d1-47bc20df01e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:28.684842 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f67c30-c6e3-412a-ab9a-b22b4169ca90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:28.685033 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55102c13-3e09-4c4c-b5d1-47bc20df01e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:28.685151 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f67c30-c6e3-412a-ab9a-b22b4169ca90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:28.685280 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55102c13-3e09-4c4c-b5d1-47bc20df01e5 admin admin] PATH_INFO: `/v3/projects/a1dc8ca7d2ba4aabb8e21eb5518532e5` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:28.685425 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f67c30-c6e3-412a-ab9a-b22b4169ca90 admin admin] PATH_INFO: `/v3/users/a62b729742994849b57285d64ba12c17` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:28.686551 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55102c13-3e09-4c4c-b5d1-47bc20df01e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1dc8ca7d2ba4aabb8e21eb5518532e5)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:28.686677 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f67c30-c6e3-412a-ab9a-b22b4169ca90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a62b729742994849b57285d64ba12c17)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:28.688600 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55102c13-3e09-4c4c-b5d1-47bc20df01e5 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:28.688722 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f67c30-c6e3-412a-ab9a-b22b4169ca90 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:28.712909 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:28.741021 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-50f67c30-c6e3-412a-ab9a-b22b4169ca90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a62b729742994849b57285d64ba12c17'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:28.742108 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-55102c13-3e09-4c4c-b5d1-47bc20df01e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1dc8ca7d2ba4aabb8e21eb5518532e5', 'request_id': 'req-55102c13-3e09-4c4c-b5d1-47bc20df01e5'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:28.742255 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-50f67c30-c6e3-412a-ab9a-b22b4169ca90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a62b729742994849b57285d64ba12c17'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:28.747885 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-55102c13-3e09-4c4c-b5d1-47bc20df01e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1dc8ca7d2ba4aabb8e21eb5518532e5', 'request_id': 'req-55102c13-3e09-4c4c-b5d1-47bc20df01e5'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:28.756539 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-55102c13-3e09-4c4c-b5d1-47bc20df01e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1dc8ca7d2ba4aabb8e21eb5518532e5', 'request_id': 'req-55102c13-3e09-4c4c-b5d1-47bc20df01e5'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:28.758207 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-50f67c30-c6e3-412a-ab9a-b22b4169ca90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a62b729742994849b57285d64ba12c17'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:28.766067 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-50f67c30-c6e3-412a-ab9a-b22b4169ca90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a62b729742994849b57285d64ba12c17'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:28.768584 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-55102c13-3e09-4c4c-b5d1-47bc20df01e5 admin admin] The token cache is being invalidate because project a1dc8ca7d2ba4aabb8e21eb5518532e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 11:59:28.768875 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-55102c13-3e09-4c4c-b5d1-47bc20df01e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:28.769519 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-55102c13-3e09-4c4c-b5d1-47bc20df01e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:28.771093 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1049/2102] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 11:59:28 2022] DELETE /identity/v3/projects/a1dc8ca7d2ba4aabb8e21eb5518532e5 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:28.771879 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55102c13-3e09-4c4c-b5d1-47bc20df01e5 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:28.773701 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-55102c13-3e09-4c4c-b5d1-47bc20df01e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:28.777277 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-50f67c30-c6e3-412a-ab9a-b22b4169ca90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a62b729742994849b57285d64ba12c17'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:28.783656 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1054/2103] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 11:59:28 2022] DELETE /identity/v3/users/a62b729742994849b57285d64ba12c17 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 11:59:28.784450 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f67c30-c6e3-412a-ab9a-b22b4169ca90 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:28.785747 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-50f67c30-c6e3-412a-ab9a-b22b4169ca90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:28.869821 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f67c30-c6e3-412a-ab9a-b22b4169ca90 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:28.870724 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55102c13-3e09-4c4c-b5d1-47bc20df01e5 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:28.875308 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c52b6-cdd6-4256-8f78-3c053184d65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:28.876246 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487d352-2f2f-430c-80e6-ea0e26e6d5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:28.876375 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c52b6-cdd6-4256-8f78-3c053184d65b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:28.876533 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c52b6-cdd6-4256-8f78-3c053184d65b admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:28.876833 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c52b6-cdd6-4256-8f78-3c053184d65b admin admin] PATH_INFO: `/v3/users/2d8cfdedf82147d39233839d05b48b37` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:28.876942 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487d352-2f2f-430c-80e6-ea0e26e6d5ec admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:28.877182 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487d352-2f2f-430c-80e6-ea0e26e6d5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:28.877415 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487d352-2f2f-430c-80e6-ea0e26e6d5ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:28.878109 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e487d352-2f2f-430c-80e6-ea0e26e6d5ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:28.878343 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c52b6-cdd6-4256-8f78-3c053184d65b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d8cfdedf82147d39233839d05b48b37)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:28.879773 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e487d352-2f2f-430c-80e6-ea0e26e6d5ec admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:28.880386 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c52b6-cdd6-4256-8f78-3c053184d65b admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:28.895884 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1050/2104] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:59:28.897092 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487d352-2f2f-430c-80e6-ea0e26e6d5ec admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:28.909816 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487d352-2f2f-430c-80e6-ea0e26e6d5ec admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:28.917298 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e460ede-0d23-4d21-bbae-868df8591a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:28.917958 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e460ede-0d23-4d21-bbae-868df8591a69 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:28.918238 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e460ede-0d23-4d21-bbae-868df8591a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:28.918508 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e460ede-0d23-4d21-bbae-868df8591a69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:28.919217 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e460ede-0d23-4d21-bbae-868df8591a69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:28.921111 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e460ede-0d23-4d21-bbae-868df8591a69 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:28.934459 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1051/2105] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:59:28.936167 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e460ede-0d23-4d21-bbae-868df8591a69 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:28.941373 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:28.952535 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e460ede-0d23-4d21-bbae-868df8591a69 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:28.958430 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96541411-5126-4897-91f7-3da110087818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:28.959374 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96541411-5126-4897-91f7-3da110087818 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:28.960400 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96541411-5126-4897-91f7-3da110087818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:28.960801 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96541411-5126-4897-91f7-3da110087818 admin admin] PATH_INFO: `/v3/projects/df6d5157a2cf4a4397946886b6ede998/users/fd1ad1d901f641c29c14a25e98a16b7f/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:28.962480 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-636c52b6-cdd6-4256-8f78-3c053184d65b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d8cfdedf82147d39233839d05b48b37'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:28.963268 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-636c52b6-cdd6-4256-8f78-3c053184d65b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d8cfdedf82147d39233839d05b48b37'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:28.978620 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-636c52b6-cdd6-4256-8f78-3c053184d65b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d8cfdedf82147d39233839d05b48b37'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:28.980420 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96541411-5126-4897-91f7-3da110087818 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df6d5157a2cf4a4397946886b6ede998, user_id=fd1ad1d901f641c29c14a25e98a16b7f, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:28.983314 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96541411-5126-4897-91f7-3da110087818 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:28.986809 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-636c52b6-cdd6-4256-8f78-3c053184d65b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d8cfdedf82147d39233839d05b48b37'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:28.996548 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-636c52b6-cdd6-4256-8f78-3c053184d65b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d8cfdedf82147d39233839d05b48b37'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:28.999770 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1052/2106] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:59:28 2022] PUT /identity/v3/projects/df6d5157a2cf4a4397946886b6ede998/users/fd1ad1d901f641c29c14a25e98a16b7f/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 11:59:29.005047 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1055/2107] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 11:59:28 2022] DELETE /identity/v3/users/2d8cfdedf82147d39233839d05b48b37 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:29.009863 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e33e4-5a00-4d23-931f-86d90f63987d None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:29.010156 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e33e4-5a00-4d23-931f-86d90f63987d None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:29.010436 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e33e4-5a00-4d23-931f-86d90f63987d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:29.041397 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-b21e33e4-5a00-4d23-931f-86d90f63987d None None] MFA Rules not processed for user `fd1ad1d901f641c29c14a25e98a16b7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:29.042830 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-b21e33e4-5a00-4d23-931f-86d90f63987d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:29.096264 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c52b6-cdd6-4256-8f78-3c053184d65b admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:29.097782 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-636c52b6-cdd6-4256-8f78-3c053184d65b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:29.128500 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1053/2108] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:29 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:29.137970 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e33e4-5a00-4d23-931f-86d90f63987d None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:29.140153 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-b21e33e4-5a00-4d23-931f-86d90f63987d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:29.143866 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:29.197409 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c52b6-cdd6-4256-8f78-3c053184d65b admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:29.202914 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c8402b-6b81-4abe-b9a9-47abb23669cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:29.203857 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8402b-6b81-4abe-b9a9-47abb23669cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:29.204141 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8402b-6b81-4abe-b9a9-47abb23669cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:29.204420 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8402b-6b81-4abe-b9a9-47abb23669cf admin admin] PATH_INFO: `/v3/projects/22df859928de4f97bff0f748f9d3d4b6` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:29.205641 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c8402b-6b81-4abe-b9a9-47abb23669cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=22df859928de4f97bff0f748f9d3d4b6)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:29.208240 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c8402b-6b81-4abe-b9a9-47abb23669cf admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:29.223045 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e33e4-5a00-4d23-931f-86d90f63987d None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:29.226969 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f086bc-7eee-43f6-8aab-68d56138069b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:29.227656 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f086bc-7eee-43f6-8aab-68d56138069b service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:29.227945 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f086bc-7eee-43f6-8aab-68d56138069b service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:29.228225 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f086bc-7eee-43f6-8aab-68d56138069b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:29.237256 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f086bc-7eee-43f6-8aab-68d56138069b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:29.239327 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f086bc-7eee-43f6-8aab-68d56138069b service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:29.250338 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1054/2109] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:59:29 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 11:59:29.266403 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-b2c8402b-6b81-4abe-b9a9-47abb23669cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22df859928de4f97bff0f748f9d3d4b6', 'request_id': 'req-b2c8402b-6b81-4abe-b9a9-47abb23669cf'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:29.274022 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-b2c8402b-6b81-4abe-b9a9-47abb23669cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22df859928de4f97bff0f748f9d3d4b6', 'request_id': 'req-b2c8402b-6b81-4abe-b9a9-47abb23669cf'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:29.283772 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-b2c8402b-6b81-4abe-b9a9-47abb23669cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22df859928de4f97bff0f748f9d3d4b6', 'request_id': 'req-b2c8402b-6b81-4abe-b9a9-47abb23669cf'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:29.297740 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-b2c8402b-6b81-4abe-b9a9-47abb23669cf admin admin] The token cache is being invalidate because project 22df859928de4f97bff0f748f9d3d4b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 11:59:29.298383 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-b2c8402b-6b81-4abe-b9a9-47abb23669cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:29.299199 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-b2c8402b-6b81-4abe-b9a9-47abb23669cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:29.301057 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1056/2110] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 11:59:29 2022] DELETE /identity/v3/projects/22df859928de4f97bff0f748f9d3d4b6 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 11:59:29.305057 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f086bc-7eee-43f6-8aab-68d56138069b service cinder] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:29.313769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c8402b-6b81-4abe-b9a9-47abb23669cf admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:29.315717 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-b2c8402b-6b81-4abe-b9a9-47abb23669cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:29.317797 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f086bc-7eee-43f6-8aab-68d56138069b service cinder] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:29.414925 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9bf630-7185-4744-8a3d-f4e9076529fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:29.416084 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c8402b-6b81-4abe-b9a9-47abb23669cf admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:29.418447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9bf630-7185-4744-8a3d-f4e9076529fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:29.418689 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9bf630-7185-4744-8a3d-f4e9076529fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:29.418971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9bf630-7185-4744-8a3d-f4e9076529fd admin admin] PATH_INFO: `/v3/users/d44957d0550a4c1b966ee53e6388d716` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:29.422114 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860fab7-5008-42f7-be3e-d82b46ef2570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:29.422390 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860fab7-5008-42f7-be3e-d82b46ef2570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:29.422678 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860fab7-5008-42f7-be3e-d82b46ef2570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:29.422954 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860fab7-5008-42f7-be3e-d82b46ef2570 admin admin] PATH_INFO: `/v3/projects/e0fae42713bb4e73bc53b0181d9abc30` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:29.423799 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9bf630-7185-4744-8a3d-f4e9076529fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d44957d0550a4c1b966ee53e6388d716)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:29.425747 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9bf630-7185-4744-8a3d-f4e9076529fd admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:29.433896 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860fab7-5008-42f7-be3e-d82b46ef2570 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0fae42713bb4e73bc53b0181d9abc30)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:29.435911 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860fab7-5008-42f7-be3e-d82b46ef2570 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:29.442890 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:29.495243 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-0d9bf630-7185-4744-8a3d-f4e9076529fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd44957d0550a4c1b966ee53e6388d716'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:29.503824 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-0d9bf630-7185-4744-8a3d-f4e9076529fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd44957d0550a4c1b966ee53e6388d716'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:29.504566 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-0d9bf630-7185-4744-8a3d-f4e9076529fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd44957d0550a4c1b966ee53e6388d716'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:29.513409 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-5860fab7-5008-42f7-be3e-d82b46ef2570 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0fae42713bb4e73bc53b0181d9abc30', 'request_id': 'req-5860fab7-5008-42f7-be3e-d82b46ef2570'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:29.516356 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:29.524331 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-5860fab7-5008-42f7-be3e-d82b46ef2570 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0fae42713bb4e73bc53b0181d9abc30', 'request_id': 'req-5860fab7-5008-42f7-be3e-d82b46ef2570'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:29.525918 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-0d9bf630-7185-4744-8a3d-f4e9076529fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd44957d0550a4c1b966ee53e6388d716'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:29.536194 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-5860fab7-5008-42f7-be3e-d82b46ef2570 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0fae42713bb4e73bc53b0181d9abc30', 'request_id': 'req-5860fab7-5008-42f7-be3e-d82b46ef2570'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:29.544239 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-0d9bf630-7185-4744-8a3d-f4e9076529fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd44957d0550a4c1b966ee53e6388d716'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:29.549381 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-5860fab7-5008-42f7-be3e-d82b46ef2570 admin admin] The token cache is being invalidate because project e0fae42713bb4e73bc53b0181d9abc30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 11:59:29.549758 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-5860fab7-5008-42f7-be3e-d82b46ef2570 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:29.550697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-5860fab7-5008-42f7-be3e-d82b46ef2570 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:29.555191 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1055/2111] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 11:59:29 2022] DELETE /identity/v3/users/d44957d0550a4c1b966ee53e6388d716 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:29.555355 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1057/2112] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 11:59:29 2022] DELETE /identity/v3/projects/e0fae42713bb4e73bc53b0181d9abc30 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 11:59:29.558807 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02af5a5-25f1-4162-b2e4-4e391ca8510c None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:29.559177 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02af5a5-25f1-4162-b2e4-4e391ca8510c None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:29.559552 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02af5a5-25f1-4162-b2e4-4e391ca8510c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:29.581059 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-b02af5a5-25f1-4162-b2e4-4e391ca8510c None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:29.582304 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-b02af5a5-25f1-4162-b2e4-4e391ca8510c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:29.681521 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1056/2113] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:29.692321 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed0276-fc9d-4a50-be1c-01de6e374b8a None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:29.692606 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed0276-fc9d-4a50-be1c-01de6e374b8a None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:29.693245 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed0276-fc9d-4a50-be1c-01de6e374b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:29.723003 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-8fed0276-fc9d-4a50-be1c-01de6e374b8a None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:29.723003 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-8fed0276-fc9d-4a50-be1c-01de6e374b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:29.743771 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1058/2114] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:29.748799 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02af5a5-25f1-4162-b2e4-4e391ca8510c None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:29.761307 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02af5a5-25f1-4162-b2e4-4e391ca8510c None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:29.766273 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047fc177-a761-46b3-adeb-b51a48db2789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:29.766943 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047fc177-a761-46b3-adeb-b51a48db2789 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:29.767228 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047fc177-a761-46b3-adeb-b51a48db2789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:29.767524 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047fc177-a761-46b3-adeb-b51a48db2789 admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:29.768285 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047fc177-a761-46b3-adeb-b51a48db2789 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:59:29.768592 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047fc177-a761-46b3-adeb-b51a48db2789 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:29.770210 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047fc177-a761-46b3-adeb-b51a48db2789 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:29.783237 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1057/2115] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 11:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:59:29.787813 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed0276-fc9d-4a50-be1c-01de6e374b8a None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:29.797283 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed0276-fc9d-4a50-be1c-01de6e374b8a None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:29.802273 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4bf646-3ef5-4b99-8181-c554291800ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:29.802975 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bf646-3ef5-4b99-8181-c554291800ee admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:29.803251 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bf646-3ef5-4b99-8181-c554291800ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:29.804092 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4bf646-3ef5-4b99-8181-c554291800ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:29.804792 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4bf646-3ef5-4b99-8181-c554291800ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:29.806715 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4bf646-3ef5-4b99-8181-c554291800ee admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:29.835973 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1059/2116] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:59:29 2022] POST /identity/v3/projects => generated 405 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:59:29.840588 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047fc177-a761-46b3-adeb-b51a48db2789 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:29.851156 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047fc177-a761-46b3-adeb-b51a48db2789 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:29.904480 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4bf646-3ef5-4b99-8181-c554291800ee admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:29.906379 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-ea4bf646-3ef5-4b99-8181-c554291800ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:29.937414 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4354384-723a-4842-a461-e883fa223ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:29.938087 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4354384-723a-4842-a461-e883fa223ec9 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:29.938398 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4354384-723a-4842-a461-e883fa223ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:29.938671 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4354384-723a-4842-a461-e883fa223ec9 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:29.939346 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4354384-723a-4842-a461-e883fa223ec9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:29.941437 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4354384-723a-4842-a461-e883fa223ec9 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:29.962518 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1058/2117] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:59:29 2022] POST /identity/v3/users => generated 303 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:59:29.966572 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4354384-723a-4842-a461-e883fa223ec9 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:29.976798 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4354384-723a-4842-a461-e883fa223ec9 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:29.981556 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412e81c-325a-474a-946d-1875834698d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:29.982368 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412e81c-325a-474a-946d-1875834698d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:29.982654 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412e81c-325a-474a-946d-1875834698d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:29.982929 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412e81c-325a-474a-946d-1875834698d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:29.983683 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2412e81c-325a-474a-946d-1875834698d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:29.985384 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2412e81c-325a-474a-946d-1875834698d7 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:29.986791 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:29.987055 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4bf646-3ef5-4b99-8181-c554291800ee admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:29.992708 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0c7c7-a3b6-4619-a3ed-8a4671c32ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:29.993621 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0c7c7-a3b6-4619-a3ed-8a4671c32ed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:29.993932 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0c7c7-a3b6-4619-a3ed-8a4671c32ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:29.994232 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0c7c7-a3b6-4619-a3ed-8a4671c32ed3 admin admin] PATH_INFO: `/v3/projects/e0bd389c8bb24e02a31de2c9f8761fa3` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:29.995431 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de0c7c7-a3b6-4619-a3ed-8a4671c32ed3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0bd389c8bb24e02a31de2c9f8761fa3)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:29.997351 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de0c7c7-a3b6-4619-a3ed-8a4671c32ed3 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:29.999067 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1059/2118] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 11:59:30.002416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412e81c-325a-474a-946d-1875834698d7 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:30.012399 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412e81c-325a-474a-946d-1875834698d7 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:30.017214 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a34a8-1681-4f2d-8726-3c9e55ba8558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:30.017851 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a34a8-1681-4f2d-8726-3c9e55ba8558 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:30.018130 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a34a8-1681-4f2d-8726-3c9e55ba8558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:30.018411 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a34a8-1681-4f2d-8726-3c9e55ba8558 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:30.019122 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934a34a8-1681-4f2d-8726-3c9e55ba8558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:30.020728 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934a34a8-1681-4f2d-8726-3c9e55ba8558 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:30.031099 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1060/2119] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 11:59:30.035032 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a34a8-1681-4f2d-8726-3c9e55ba8558 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:30.043332 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-6de0c7c7-a3b6-4619-a3ed-8a4671c32ed3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0bd389c8bb24e02a31de2c9f8761fa3', 'request_id': 'req-6de0c7c7-a3b6-4619-a3ed-8a4671c32ed3'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:30.045922 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a34a8-1681-4f2d-8726-3c9e55ba8558 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:30.049000 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-6de0c7c7-a3b6-4619-a3ed-8a4671c32ed3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0bd389c8bb24e02a31de2c9f8761fa3', 'request_id': 'req-6de0c7c7-a3b6-4619-a3ed-8a4671c32ed3'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:30.057421 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-6de0c7c7-a3b6-4619-a3ed-8a4671c32ed3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0bd389c8bb24e02a31de2c9f8761fa3', 'request_id': 'req-6de0c7c7-a3b6-4619-a3ed-8a4671c32ed3'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:30.072860 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-6de0c7c7-a3b6-4619-a3ed-8a4671c32ed3 admin admin] The token cache is being invalidate because project e0bd389c8bb24e02a31de2c9f8761fa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 11:59:30.073151 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-6de0c7c7-a3b6-4619-a3ed-8a4671c32ed3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:30.074174 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-6de0c7c7-a3b6-4619-a3ed-8a4671c32ed3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:30.075813 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1060/2120] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 11:59:29 2022] DELETE /identity/v3/projects/e0bd389c8bb24e02a31de2c9f8761fa3 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:30.082661 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7e5e9-a205-4a0f-9b3f-2b982b46db57 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:30.082948 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7e5e9-a205-4a0f-9b3f-2b982b46db57 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:30.083228 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7e5e9-a205-4a0f-9b3f-2b982b46db57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:30.101352 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-8fd7e5e9-a205-4a0f-9b3f-2b982b46db57 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:30.102455 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-8fd7e5e9-a205-4a0f-9b3f-2b982b46db57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:30.105505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253e5bb-cb4c-45e1-bb66-c59995c9ba3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:30.106400 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253e5bb-cb4c-45e1-bb66-c59995c9ba3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:30.106685 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253e5bb-cb4c-45e1-bb66-c59995c9ba3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:30.106967 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253e5bb-cb4c-45e1-bb66-c59995c9ba3f admin admin] PATH_INFO: `/v3/projects/6e11d3dbc2524e5a974eb5491510125b/users/ce4af94840d54e5b8f931dc9c98cfa2b/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:30.110426 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1061/2121] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 11:59:30.119284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626f363-aa73-430c-a61d-6b28ea29060d None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:30.119596 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626f363-aa73-430c-a61d-6b28ea29060d None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:30.119874 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626f363-aa73-430c-a61d-6b28ea29060d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:30.122989 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f253e5bb-cb4c-45e1-bb66-c59995c9ba3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e11d3dbc2524e5a974eb5491510125b, user_id=ce4af94840d54e5b8f931dc9c98cfa2b, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:30.125693 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f253e5bb-cb4c-45e1-bb66-c59995c9ba3f admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:30.138948 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1061/2122] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:59:30 2022] PUT /identity/v3/projects/6e11d3dbc2524e5a974eb5491510125b/users/ce4af94840d54e5b8f931dc9c98cfa2b/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:30.140717 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-9626f363-aa73-430c-a61d-6b28ea29060d None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:30.141889 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-9626f363-aa73-430c-a61d-6b28ea29060d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:30.151248 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ce2cd-19a6-4224-af8d-1ffa02ce3bd5 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:30.151578 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ce2cd-19a6-4224-af8d-1ffa02ce3bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:30.151865 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ce2cd-19a6-4224-af8d-1ffa02ce3bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:30.172748 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:30.179468 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-775ce2cd-19a6-4224-af8d-1ffa02ce3bd5 None None] MFA Rules not processed for user `ce4af94840d54e5b8f931dc9c98cfa2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:30.180712 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-775ce2cd-19a6-4224-af8d-1ffa02ce3bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:30.205015 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1062/2123] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 11:59:30.209187 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9626f363-aa73-430c-a61d-6b28ea29060d None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:30.217954 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9626f363-aa73-430c-a61d-6b28ea29060d None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:30.223238 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b19bca7-e937-459c-a049-659a4246a116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:30.223915 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19bca7-e937-459c-a049-659a4246a116 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:30.224197 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19bca7-e937-459c-a049-659a4246a116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:30.224470 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19bca7-e937-459c-a049-659a4246a116 admin admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:30.225191 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b19bca7-e937-459c-a049-659a4246a116 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:59:30.226022 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b19bca7-e937-459c-a049-659a4246a116 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:30.227658 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b19bca7-e937-459c-a049-659a4246a116 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:30.242790 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1063/2124] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 11:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:59:30.243898 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b19bca7-e937-459c-a049-659a4246a116 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:30.245751 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1062/2125] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:30 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 11:59:30.250075 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ce2cd-19a6-4224-af8d-1ffa02ce3bd5 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:30.251527 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-775ce2cd-19a6-4224-af8d-1ffa02ce3bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:30.253507 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b19bca7-e937-459c-a049-659a4246a116 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:30.258147 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3398f9-e2a0-490a-83a9-62fdd804080e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:30.258807 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3398f9-e2a0-490a-83a9-62fdd804080e admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:30.259085 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3398f9-e2a0-490a-83a9-62fdd804080e admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:30.259359 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3398f9-e2a0-490a-83a9-62fdd804080e admin admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:30.260065 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3398f9-e2a0-490a-83a9-62fdd804080e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:30.261975 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3398f9-e2a0-490a-83a9-62fdd804080e admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:30.264981 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ce2cd-19a6-4224-af8d-1ffa02ce3bd5 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:30.269865 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eec38b-7b4c-4c25-9f88-fa7269f3b920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:30.270920 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eec38b-7b4c-4c25-9f88-fa7269f3b920 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:30.271207 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eec38b-7b4c-4c25-9f88-fa7269f3b920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:30.271483 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eec38b-7b4c-4c25-9f88-fa7269f3b920 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:30.272738 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eec38b-7b4c-4c25-9f88-fa7269f3b920 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:30.274611 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eec38b-7b4c-4c25-9f88-fa7269f3b920 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:30.289332 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1064/2126] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:59:30 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 11:59:30.293374 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3398f9-e2a0-490a-83a9-62fdd804080e admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:30.305195 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1063/2127] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:59:30 2022] POST /identity/v3/projects => generated 409 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 11:59:30.309287 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eec38b-7b4c-4c25-9f88-fa7269f3b920 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:30.348721 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:30.355778 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3398f9-e2a0-490a-83a9-62fdd804080e admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:30.372566 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eec38b-7b4c-4c25-9f88-fa7269f3b920 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:30.377272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45c6b5-1fc5-494a-b0ac-3f90fde6b925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:30.377935 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45c6b5-1fc5-494a-b0ac-3f90fde6b925 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:30.378227 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45c6b5-1fc5-494a-b0ac-3f90fde6b925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:30.378494 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45c6b5-1fc5-494a-b0ac-3f90fde6b925 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:30.379173 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45c6b5-1fc5-494a-b0ac-3f90fde6b925 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:30.381149 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45c6b5-1fc5-494a-b0ac-3f90fde6b925 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:30.404055 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1064/2128] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:59:30 2022] POST /identity/v3/users => generated 311 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 11:59:30.409095 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45c6b5-1fc5-494a-b0ac-3f90fde6b925 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:30.418173 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1aa2e-ebc1-43e6-8b2e-f5843464a521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:30.418868 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1aa2e-ebc1-43e6-8b2e-f5843464a521 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:30.419150 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1aa2e-ebc1-43e6-8b2e-f5843464a521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:30.419427 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1aa2e-ebc1-43e6-8b2e-f5843464a521 admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:30.419773 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45c6b5-1fc5-494a-b0ac-3f90fde6b925 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:30.420139 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f1aa2e-ebc1-43e6-8b2e-f5843464a521 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:30.422042 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f1aa2e-ebc1-43e6-8b2e-f5843464a521 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:30.424374 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba2599-8a4d-4e64-9701-5c34ca8f0e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:30.425017 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba2599-8a4d-4e64-9701-5c34ca8f0e5d admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:30.425301 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba2599-8a4d-4e64-9701-5c34ca8f0e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:30.425578 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba2599-8a4d-4e64-9701-5c34ca8f0e5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:30.426292 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba2599-8a4d-4e64-9701-5c34ca8f0e5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:30.428103 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba2599-8a4d-4e64-9701-5c34ca8f0e5d admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:30.439541 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1065/2129] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 11:59:30.443073 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba2599-8a4d-4e64-9701-5c34ca8f0e5d admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:30.443611 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1065/2130] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:59:30 2022] POST /identity/v3/users => generated 289 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 11:59:30.447396 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1aa2e-ebc1-43e6-8b2e-f5843464a521 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:30.456391 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba2599-8a4d-4e64-9701-5c34ca8f0e5d admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:30.457296 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1aa2e-ebc1-43e6-8b2e-f5843464a521 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:30.461922 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218975aa-bcd8-4ae5-86bb-f5d7af0c1b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:30.462367 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf40de0-6775-4018-81dc-ce8b7367ee68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:30.462825 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218975aa-bcd8-4ae5-86bb-f5d7af0c1b72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:30.462999 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf40de0-6775-4018-81dc-ce8b7367ee68 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:30.463104 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218975aa-bcd8-4ae5-86bb-f5d7af0c1b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:30.463280 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf40de0-6775-4018-81dc-ce8b7367ee68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:30.463388 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218975aa-bcd8-4ae5-86bb-f5d7af0c1b72 admin admin] PATH_INFO: `/v3/projects/e171a0351f44474b956200a90eb28ea8/users/12848324010942f7a07f33cf2c742460/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:30.463590 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf40de0-6775-4018-81dc-ce8b7367ee68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:30.464309 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf40de0-6775-4018-81dc-ce8b7367ee68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:30.465920 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf40de0-6775-4018-81dc-ce8b7367ee68 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:30.476721 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1066/2131] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 11:59:30.479136 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218975aa-bcd8-4ae5-86bb-f5d7af0c1b72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e171a0351f44474b956200a90eb28ea8, user_id=12848324010942f7a07f33cf2c742460, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:30.480571 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf40de0-6775-4018-81dc-ce8b7367ee68 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:30.482150 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218975aa-bcd8-4ae5-86bb-f5d7af0c1b72 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:30.490563 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf40de0-6775-4018-81dc-ce8b7367ee68 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:30.496182 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1066/2132] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:59:30 2022] PUT /identity/v3/projects/e171a0351f44474b956200a90eb28ea8/users/12848324010942f7a07f33cf2c742460/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 11:59:30.500604 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218975aa-bcd8-4ae5-86bb-f5d7af0c1b72 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:30.514994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:30.552086 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629af961-de20-47f2-8dec-a6408f9b3597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:30.553106 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629af961-de20-47f2-8dec-a6408f9b3597 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:30.553422 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629af961-de20-47f2-8dec-a6408f9b3597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:30.553704 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629af961-de20-47f2-8dec-a6408f9b3597 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:30.554581 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629af961-de20-47f2-8dec-a6408f9b3597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:30.556449 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629af961-de20-47f2-8dec-a6408f9b3597 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:30.566536 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218975aa-bcd8-4ae5-86bb-f5d7af0c1b72 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:30.569493 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1067/2133] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 11:59:30.573380 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629af961-de20-47f2-8dec-a6408f9b3597 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:30.574195 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8cdd87-1568-465a-bb3b-b40a6e5859e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:30.574860 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cdd87-1568-465a-bb3b-b40a6e5859e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:30.575143 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cdd87-1568-465a-bb3b-b40a6e5859e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:30.575417 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cdd87-1568-465a-bb3b-b40a6e5859e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:30.576172 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8cdd87-1568-465a-bb3b-b40a6e5859e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:30.577763 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8cdd87-1568-465a-bb3b-b40a6e5859e7 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:30.583803 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629af961-de20-47f2-8dec-a6408f9b3597 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:30.591699 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1067/2134] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 11:59:30.591843 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00a9bd-3b00-47cb-a41e-19878bdb9c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:30.591843 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00a9bd-3b00-47cb-a41e-19878bdb9c10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:30.591843 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00a9bd-3b00-47cb-a41e-19878bdb9c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:30.591843 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00a9bd-3b00-47cb-a41e-19878bdb9c10 admin admin] PATH_INFO: `/v3/projects/c914b119f38748f1886da5773a956c8f/users/d34e7e7bb1694956854491e4ace3ee18/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:30.592805 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8cdd87-1568-465a-bb3b-b40a6e5859e7 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:30.603478 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8cdd87-1568-465a-bb3b-b40a6e5859e7 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:30.607950 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd00a9bd-3b00-47cb-a41e-19878bdb9c10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c914b119f38748f1886da5773a956c8f, user_id=d34e7e7bb1694956854491e4ace3ee18, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:30.608295 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848db774-d1cd-4257-b4a7-030347bd8e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:30.609200 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848db774-d1cd-4257-b4a7-030347bd8e34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:30.609487 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848db774-d1cd-4257-b4a7-030347bd8e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:30.609755 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848db774-d1cd-4257-b4a7-030347bd8e34 admin admin] PATH_INFO: `/v3/projects/e171a0351f44474b956200a90eb28ea8/users/12848324010942f7a07f33cf2c742460/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:30.611741 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848db774-d1cd-4257-b4a7-030347bd8e34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e171a0351f44474b956200a90eb28ea8, user_id=12848324010942f7a07f33cf2c742460, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:30.612298 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd00a9bd-3b00-47cb-a41e-19878bdb9c10 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:30.614411 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848db774-d1cd-4257-b4a7-030347bd8e34 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:30.625387 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1068/2135] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:59:30 2022] PUT /identity/v3/projects/e171a0351f44474b956200a90eb28ea8/users/12848324010942f7a07f33cf2c742460/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:30.633138 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1068/2136] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:59:30 2022] PUT /identity/v3/projects/c914b119f38748f1886da5773a956c8f/users/d34e7e7bb1694956854491e4ace3ee18/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 11:59:30.639564 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb1bd4-e7b7-42df-a2c0-1e4f03faabfc None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:30.639857 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb1bd4-e7b7-42df-a2c0-1e4f03faabfc None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:30.640134 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb1bd4-e7b7-42df-a2c0-1e4f03faabfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:30.644108 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72cd2e1-8236-4c1f-be30-52a817d6de58 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:30.644406 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72cd2e1-8236-4c1f-be30-52a817d6de58 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:30.644690 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72cd2e1-8236-4c1f-be30-52a817d6de58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:30.667996 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-68fb1bd4-e7b7-42df-a2c0-1e4f03faabfc None None] MFA Rules not processed for user `12848324010942f7a07f33cf2c742460`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:30.669183 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-68fb1bd4-e7b7-42df-a2c0-1e4f03faabfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:30.671072 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-b72cd2e1-8236-4c1f-be30-52a817d6de58 None None] MFA Rules not processed for user `d34e7e7bb1694956854491e4ace3ee18`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:30.672277 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-b72cd2e1-8236-4c1f-be30-52a817d6de58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:30.741574 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:30.743098 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1069/2137] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 11:59:30.757194 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1069/2138] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:30 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:30.757543 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72cd2e1-8236-4c1f-be30-52a817d6de58 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:30.759748 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-b72cd2e1-8236-4c1f-be30-52a817d6de58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:30.764213 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb1bd4-e7b7-42df-a2c0-1e4f03faabfc None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:30.765582 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-68fb1bd4-e7b7-42df-a2c0-1e4f03faabfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:30.815117 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72cd2e1-8236-4c1f-be30-52a817d6de58 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:30.818744 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c49f39-ca5b-49ad-8b74-4e28b45ac395 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aa048aec48b4755ac13eae997bff2fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:30.820010 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c49f39-ca5b-49ad-8b74-4e28b45ac395 service glance] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:30.820288 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c49f39-ca5b-49ad-8b74-4e28b45ac395 service glance] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:30.820586 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c49f39-ca5b-49ad-8b74-4e28b45ac395 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:30.822981 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb1bd4-e7b7-42df-a2c0-1e4f03faabfc None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:30.826601 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb6b0a-8148-40b1-aee2-82d7ec653596 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:30.827238 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb6b0a-8148-40b1-aee2-82d7ec653596 service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:30.827550 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb6b0a-8148-40b1-aee2-82d7ec653596 service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:30.827835 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb6b0a-8148-40b1-aee2-82d7ec653596 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:30.829123 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c49f39-ca5b-49ad-8b74-4e28b45ac395 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:30.830545 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c49f39-ca5b-49ad-8b74-4e28b45ac395 service glance] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:30.837461 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cb6b0a-8148-40b1-aee2-82d7ec653596 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:30.838892 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cb6b0a-8148-40b1-aee2-82d7ec653596 service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:30.840435 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1070/2139] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:59:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:59:30.848751 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1070/2140] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:59:30 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 11:59:31.071699 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c49f39-ca5b-49ad-8b74-4e28b45ac395 service glance] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:31.081229 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c49f39-ca5b-49ad-8b74-4e28b45ac395 service glance] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:31.085636 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3698e4-8b31-42ba-9faf-2b29ae60a001 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:31.086274 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3698e4-8b31-42ba-9faf-2b29ae60a001 service cinder] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:31.086553 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3698e4-8b31-42ba-9faf-2b29ae60a001 service cinder] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:31.086823 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3698e4-8b31-42ba-9faf-2b29ae60a001 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:31.116927 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:31.147827 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3698e4-8b31-42ba-9faf-2b29ae60a001 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:31.149276 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3698e4-8b31-42ba-9faf-2b29ae60a001 service cinder] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:31.158914 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1071/2141] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:59:31 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:59:40.844334 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=27 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:41.154262 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=14 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:49.134406 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb6b0a-8148-40b1-aee2-82d7ec653596 service cinder] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:49.196095 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb6b0a-8148-40b1-aee2-82d7ec653596 service cinder] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:49.200961 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101e7f2-b4d2-434a-b263-7ace2b75b36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:49.201726 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101e7f2-b4d2-434a-b263-7ace2b75b36a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:49.202005 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101e7f2-b4d2-434a-b263-7ace2b75b36a admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:49.202280 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101e7f2-b4d2-434a-b263-7ace2b75b36a admin admin] PATH_INFO: `/v3/users/ce4af94840d54e5b8f931dc9c98cfa2b` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:49.203475 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8101e7f2-b4d2-434a-b263-7ace2b75b36a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce4af94840d54e5b8f931dc9c98cfa2b)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:49.205417 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8101e7f2-b4d2-434a-b263-7ace2b75b36a admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:49.263153 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-8101e7f2-b4d2-434a-b263-7ace2b75b36a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce4af94840d54e5b8f931dc9c98cfa2b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:49.271320 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-8101e7f2-b4d2-434a-b263-7ace2b75b36a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce4af94840d54e5b8f931dc9c98cfa2b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:49.272062 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-8101e7f2-b4d2-434a-b263-7ace2b75b36a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce4af94840d54e5b8f931dc9c98cfa2b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:49.284874 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-8101e7f2-b4d2-434a-b263-7ace2b75b36a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce4af94840d54e5b8f931dc9c98cfa2b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:49.292535 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-8101e7f2-b4d2-434a-b263-7ace2b75b36a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce4af94840d54e5b8f931dc9c98cfa2b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:49.298789 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1071/2142] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 11:59:49 2022] DELETE /identity/v3/users/ce4af94840d54e5b8f931dc9c98cfa2b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:49.303384 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8025903-0191-413c-b0bd-a60a599b7baf None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:49.303923 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8025903-0191-413c-b0bd-a60a599b7baf None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:49.304705 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8025903-0191-413c-b0bd-a60a599b7baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:49.322526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-e8025903-0191-413c-b0bd-a60a599b7baf None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:49.323746 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-e8025903-0191-413c-b0bd-a60a599b7baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:49.381305 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1072/2143] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:49.391619 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101e7f2-b4d2-434a-b263-7ace2b75b36a admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:49.393014 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-8101e7f2-b4d2-434a-b263-7ace2b75b36a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:49.450616 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101e7f2-b4d2-434a-b263-7ace2b75b36a admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:49.454652 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1030e-3e3a-46ca-8964-169b0facb486 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:49.455365 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1030e-3e3a-46ca-8964-169b0facb486 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:49.455715 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1030e-3e3a-46ca-8964-169b0facb486 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:49.455991 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1030e-3e3a-46ca-8964-169b0facb486 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:49.465615 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f1030e-3e3a-46ca-8964-169b0facb486 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:49.466965 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f1030e-3e3a-46ca-8964-169b0facb486 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:49.477761 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1072/2144] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:59:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:59:49.760344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8025903-0191-413c-b0bd-a60a599b7baf None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:49.761735 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-e8025903-0191-413c-b0bd-a60a599b7baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:49.778341 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8025903-0191-413c-b0bd-a60a599b7baf None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:49.783376 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9066dcf-1f2e-43c0-8fda-cfb850482a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:49.784358 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9066dcf-1f2e-43c0-8fda-cfb850482a5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:49.784740 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9066dcf-1f2e-43c0-8fda-cfb850482a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:49.785121 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9066dcf-1f2e-43c0-8fda-cfb850482a5b admin admin] PATH_INFO: `/v3/projects/6e11d3dbc2524e5a974eb5491510125b` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:49.786502 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9066dcf-1f2e-43c0-8fda-cfb850482a5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e11d3dbc2524e5a974eb5491510125b)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:49.788568 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9066dcf-1f2e-43c0-8fda-cfb850482a5b admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:49.838584 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-e9066dcf-1f2e-43c0-8fda-cfb850482a5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e11d3dbc2524e5a974eb5491510125b', 'request_id': 'req-e9066dcf-1f2e-43c0-8fda-cfb850482a5b'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:49.844745 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-e9066dcf-1f2e-43c0-8fda-cfb850482a5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e11d3dbc2524e5a974eb5491510125b', 'request_id': 'req-e9066dcf-1f2e-43c0-8fda-cfb850482a5b'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:49.863984 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-e9066dcf-1f2e-43c0-8fda-cfb850482a5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e11d3dbc2524e5a974eb5491510125b', 'request_id': 'req-e9066dcf-1f2e-43c0-8fda-cfb850482a5b'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:49.888357 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-e9066dcf-1f2e-43c0-8fda-cfb850482a5b admin admin] The token cache is being invalidate because project 6e11d3dbc2524e5a974eb5491510125b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 11:59:49.888665 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-e9066dcf-1f2e-43c0-8fda-cfb850482a5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:49.889370 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-e9066dcf-1f2e-43c0-8fda-cfb850482a5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:49.902609 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1073/2145] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 11:59:49 2022] DELETE /identity/v3/projects/6e11d3dbc2524e5a974eb5491510125b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:49.905420 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1030e-3e3a-46ca-8964-169b0facb486 service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:49.920545 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1030e-3e3a-46ca-8964-169b0facb486 service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:49.945887 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:50.053984 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f634fdc-f5b5-4f0f-81de-0e1c5d6adce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:50.064100 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f634fdc-f5b5-4f0f-81de-0e1c5d6adce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:50.064533 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f634fdc-f5b5-4f0f-81de-0e1c5d6adce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:50.064915 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f634fdc-f5b5-4f0f-81de-0e1c5d6adce1 admin admin] PATH_INFO: `/v3/users/12848324010942f7a07f33cf2c742460` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:50.070227 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f634fdc-f5b5-4f0f-81de-0e1c5d6adce1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12848324010942f7a07f33cf2c742460)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:50.072356 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f634fdc-f5b5-4f0f-81de-0e1c5d6adce1 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:50.163304 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-5f634fdc-f5b5-4f0f-81de-0e1c5d6adce1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12848324010942f7a07f33cf2c742460'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:50.173441 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-5f634fdc-f5b5-4f0f-81de-0e1c5d6adce1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12848324010942f7a07f33cf2c742460'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:50.174217 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-5f634fdc-f5b5-4f0f-81de-0e1c5d6adce1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12848324010942f7a07f33cf2c742460'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:50.205555 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-5f634fdc-f5b5-4f0f-81de-0e1c5d6adce1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12848324010942f7a07f33cf2c742460'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:50.222044 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-5f634fdc-f5b5-4f0f-81de-0e1c5d6adce1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12848324010942f7a07f33cf2c742460'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:50.239596 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1073/2146] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 11:59:49 2022] DELETE /identity/v3/users/12848324010942f7a07f33cf2c742460 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:50.754186 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9066dcf-1f2e-43c0-8fda-cfb850482a5b admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:50.755853 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-e9066dcf-1f2e-43c0-8fda-cfb850482a5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:50.769583 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9066dcf-1f2e-43c0-8fda-cfb850482a5b admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:50.832393 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e1ec2-6829-4058-bba6-f830836662a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:50.833270 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e1ec2-6829-4058-bba6-f830836662a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:50.834026 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e1ec2-6829-4058-bba6-f830836662a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:50.834315 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e1ec2-6829-4058-bba6-f830836662a8 admin admin] PATH_INFO: `/v3/projects/e171a0351f44474b956200a90eb28ea8` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:50.835564 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e1ec2-6829-4058-bba6-f830836662a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e171a0351f44474b956200a90eb28ea8)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:50.837475 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e1ec2-6829-4058-bba6-f830836662a8 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:50.869118 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:50.886995 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-9d1e1ec2-6829-4058-bba6-f830836662a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e171a0351f44474b956200a90eb28ea8', 'request_id': 'req-9d1e1ec2-6829-4058-bba6-f830836662a8'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:50.892432 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-9d1e1ec2-6829-4058-bba6-f830836662a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e171a0351f44474b956200a90eb28ea8', 'request_id': 'req-9d1e1ec2-6829-4058-bba6-f830836662a8'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:50.900139 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-9d1e1ec2-6829-4058-bba6-f830836662a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e171a0351f44474b956200a90eb28ea8', 'request_id': 'req-9d1e1ec2-6829-4058-bba6-f830836662a8'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:50.911622 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-9d1e1ec2-6829-4058-bba6-f830836662a8 admin admin] The token cache is being invalidate because project e171a0351f44474b956200a90eb28ea8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 11:59:50.911913 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-9d1e1ec2-6829-4058-bba6-f830836662a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:50.912570 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-9d1e1ec2-6829-4058-bba6-f830836662a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:50.914627 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1074/2147] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 11:59:50 2022] DELETE /identity/v3/projects/e171a0351f44474b956200a90eb28ea8 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:50.919918 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fb998-df35-40f4-981d-e8cf9b116d59 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:50.920215 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fb998-df35-40f4-981d-e8cf9b116d59 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:50.920518 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fb998-df35-40f4-981d-e8cf9b116d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:50.940287 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-372fb998-df35-40f4-981d-e8cf9b116d59 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:50.941480 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-372fb998-df35-40f4-981d-e8cf9b116d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:51.001197 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1074/2148] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:51.009473 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbf234-02ed-4397-a9ea-a44745dcabe0 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:51.009757 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbf234-02ed-4397-a9ea-a44745dcabe0 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:51.010031 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbf234-02ed-4397-a9ea-a44745dcabe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:51.027954 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-b4cbf234-02ed-4397-a9ea-a44745dcabe0 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:51.029128 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-b4cbf234-02ed-4397-a9ea-a44745dcabe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:51.036810 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1075/2149] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:51.041264 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372fb998-df35-40f4-981d-e8cf9b116d59 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:51.051020 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372fb998-df35-40f4-981d-e8cf9b116d59 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:51.056177 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c7b8b-701c-4ac1-8df4-6b26baf517ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:51.056813 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c7b8b-701c-4ac1-8df4-6b26baf517ea admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:51.057097 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c7b8b-701c-4ac1-8df4-6b26baf517ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:51.057374 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c7b8b-701c-4ac1-8df4-6b26baf517ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:51.058088 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c7b8b-701c-4ac1-8df4-6b26baf517ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:59:51.058393 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c7b8b-701c-4ac1-8df4-6b26baf517ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:51.060015 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c7b8b-701c-4ac1-8df4-6b26baf517ea admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:51.071374 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1075/2150] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 11:59:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:59:51.075395 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cbf234-02ed-4397-a9ea-a44745dcabe0 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:51.084498 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cbf234-02ed-4397-a9ea-a44745dcabe0 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:51.089095 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65e68a-b78e-448e-b2bf-3319fe8355a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:51.089737 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65e68a-b78e-448e-b2bf-3319fe8355a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:51.090016 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65e68a-b78e-448e-b2bf-3319fe8355a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:51.090286 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65e68a-b78e-448e-b2bf-3319fe8355a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:51.090961 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b65e68a-b78e-448e-b2bf-3319fe8355a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:51.092880 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b65e68a-b78e-448e-b2bf-3319fe8355a5 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:51.118205 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1076/2151] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:59:51 2022] POST /identity/v3/projects => generated 381 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:59:51.122174 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c7b8b-701c-4ac1-8df4-6b26baf517ea admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:51.132154 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c7b8b-701c-4ac1-8df4-6b26baf517ea admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:51.158384 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:51.194036 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c3569-4c9b-45dc-bffa-ee34a29c7d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:51.194743 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c3569-4c9b-45dc-bffa-ee34a29c7d77 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:51.195026 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c3569-4c9b-45dc-bffa-ee34a29c7d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:51.195300 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c3569-4c9b-45dc-bffa-ee34a29c7d77 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:51.196021 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c3569-4c9b-45dc-bffa-ee34a29c7d77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:51.197927 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c3569-4c9b-45dc-bffa-ee34a29c7d77 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:51.220518 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1076/2152] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:59:51 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:59:51.221767 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65e68a-b78e-448e-b2bf-3319fe8355a5 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:51.232729 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65e68a-b78e-448e-b2bf-3319fe8355a5 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:51.237508 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583ad51-cdb9-4754-9473-9f62a0542449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:51.238165 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583ad51-cdb9-4754-9473-9f62a0542449 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:51.238449 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583ad51-cdb9-4754-9473-9f62a0542449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:51.238727 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583ad51-cdb9-4754-9473-9f62a0542449 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:51.239456 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f583ad51-cdb9-4754-9473-9f62a0542449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:51.241071 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f583ad51-cdb9-4754-9473-9f62a0542449 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:51.252769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1077/2153] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:59:51.260069 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c3569-4c9b-45dc-bffa-ee34a29c7d77 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:51.270988 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c3569-4c9b-45dc-bffa-ee34a29c7d77 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:51.276638 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50890fb0-5846-48e1-92e2-95b14a178d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:51.277294 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50890fb0-5846-48e1-92e2-95b14a178d14 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:51.277575 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50890fb0-5846-48e1-92e2-95b14a178d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:51.277847 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50890fb0-5846-48e1-92e2-95b14a178d14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:51.278566 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50890fb0-5846-48e1-92e2-95b14a178d14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:51.280332 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50890fb0-5846-48e1-92e2-95b14a178d14 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:51.291008 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1077/2154] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:59:51.294912 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583ad51-cdb9-4754-9473-9f62a0542449 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:51.305458 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583ad51-cdb9-4754-9473-9f62a0542449 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:51.310095 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967506c9-485a-435e-b370-421b2a745daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:51.311003 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967506c9-485a-435e-b370-421b2a745daa admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:51.311282 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967506c9-485a-435e-b370-421b2a745daa admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:51.311588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967506c9-485a-435e-b370-421b2a745daa admin admin] PATH_INFO: `/v3/projects/4fe53ef28a9a4415b146b3a1709286f4/users/efd89450f871430b8a98bbea5d6e7e3f/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:51.326916 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967506c9-485a-435e-b370-421b2a745daa admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fe53ef28a9a4415b146b3a1709286f4, user_id=efd89450f871430b8a98bbea5d6e7e3f, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:51.329727 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967506c9-485a-435e-b370-421b2a745daa admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:51.347598 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1078/2155] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:59:51 2022] PUT /identity/v3/projects/4fe53ef28a9a4415b146b3a1709286f4/users/efd89450f871430b8a98bbea5d6e7e3f/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:51.356214 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f8d94-44fe-41f3-83ba-0d1accc2b1a1 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:51.356505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f8d94-44fe-41f3-83ba-0d1accc2b1a1 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:51.356782 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f8d94-44fe-41f3-83ba-0d1accc2b1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:51.386486 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-bc3f8d94-44fe-41f3-83ba-0d1accc2b1a1 None None] MFA Rules not processed for user `efd89450f871430b8a98bbea5d6e7e3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:51.387731 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-bc3f8d94-44fe-41f3-83ba-0d1accc2b1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:51.462510 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1078/2156] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:51.467067 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967506c9-485a-435e-b370-421b2a745daa admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:51.571097 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967506c9-485a-435e-b370-421b2a745daa admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:51.586802 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e227842-c57b-4b65-b1ff-d55e835723b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:51.587822 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e227842-c57b-4b65-b1ff-d55e835723b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:51.588318 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e227842-c57b-4b65-b1ff-d55e835723b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:51.588667 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e227842-c57b-4b65-b1ff-d55e835723b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:51.589471 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e227842-c57b-4b65-b1ff-d55e835723b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:51.591588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e227842-c57b-4b65-b1ff-d55e835723b9 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:51.622657 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1079/2157] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:59:51 2022] POST /identity/v3/projects => generated 379 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 11:59:51.623885 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f8d94-44fe-41f3-83ba-0d1accc2b1a1 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:51.635711 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f8d94-44fe-41f3-83ba-0d1accc2b1a1 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:51.692781 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687985a7-719b-436a-b916-eb0fb3d86c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:51.693439 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687985a7-719b-436a-b916-eb0fb3d86c81 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:51.693717 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687985a7-719b-436a-b916-eb0fb3d86c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:51.693986 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687985a7-719b-436a-b916-eb0fb3d86c81 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:51.695198 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687985a7-719b-436a-b916-eb0fb3d86c81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:51.697126 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687985a7-719b-436a-b916-eb0fb3d86c81 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:51.716477 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1079/2158] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:59:51 2022] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 11:59:51.720495 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e227842-c57b-4b65-b1ff-d55e835723b9 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:51.731857 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e227842-c57b-4b65-b1ff-d55e835723b9 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:51.737238 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1780f-f078-4f77-b9e4-9195194cde61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:51.737921 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1780f-f078-4f77-b9e4-9195194cde61 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:51.738206 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1780f-f078-4f77-b9e4-9195194cde61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:51.738482 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1780f-f078-4f77-b9e4-9195194cde61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:51.739218 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd1780f-f078-4f77-b9e4-9195194cde61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:51.740871 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd1780f-f078-4f77-b9e4-9195194cde61 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:51.752214 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1080/2159] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:59:51.756852 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687985a7-719b-436a-b916-eb0fb3d86c81 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:51.767265 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687985a7-719b-436a-b916-eb0fb3d86c81 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:51.771800 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5af94-f051-45c3-8032-54bca0de1e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:51.773542 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5af94-f051-45c3-8032-54bca0de1e2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:51.773823 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5af94-f051-45c3-8032-54bca0de1e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:51.774092 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5af94-f051-45c3-8032-54bca0de1e2f admin admin] PATH_INFO: `/v3/projects/7b0923e975924c339e6fc2b7970e9ed6/users/48b55e72111a42edbe4330f732092e62/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:51.788317 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b5af94-f051-45c3-8032-54bca0de1e2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b0923e975924c339e6fc2b7970e9ed6, user_id=48b55e72111a42edbe4330f732092e62, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:51.791184 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b5af94-f051-45c3-8032-54bca0de1e2f admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:51.806241 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1080/2160] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:59:51 2022] PUT /identity/v3/projects/7b0923e975924c339e6fc2b7970e9ed6/users/48b55e72111a42edbe4330f732092e62/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 11:59:51.810327 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1780f-f078-4f77-b9e4-9195194cde61 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:51.820818 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1780f-f078-4f77-b9e4-9195194cde61 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:51.840721 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:51.881313 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c3bbf-d9de-44cc-8d43-e92fe0375706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:51.881982 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c3bbf-d9de-44cc-8d43-e92fe0375706 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:51.882776 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c3bbf-d9de-44cc-8d43-e92fe0375706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:51.883050 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c3bbf-d9de-44cc-8d43-e92fe0375706 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:51.883805 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95c3bbf-d9de-44cc-8d43-e92fe0375706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:51.885403 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95c3bbf-d9de-44cc-8d43-e92fe0375706 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:51.895646 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1081/2161] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:59:51.900529 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5af94-f051-45c3-8032-54bca0de1e2f admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:51.906231 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:51.912248 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5af94-f051-45c3-8032-54bca0de1e2f admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:51.917344 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa668c6-8c3c-4eed-8f9f-c8e651ad4078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:51.918213 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa668c6-8c3c-4eed-8f9f-c8e651ad4078 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:51.918496 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa668c6-8c3c-4eed-8f9f-c8e651ad4078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:51.918770 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa668c6-8c3c-4eed-8f9f-c8e651ad4078 admin admin] PATH_INFO: `/v3/projects/7b0923e975924c339e6fc2b7970e9ed6/users/48b55e72111a42edbe4330f732092e62/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:51.920785 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa668c6-8c3c-4eed-8f9f-c8e651ad4078 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b0923e975924c339e6fc2b7970e9ed6, user_id=48b55e72111a42edbe4330f732092e62, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:51.923417 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa668c6-8c3c-4eed-8f9f-c8e651ad4078 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:51.934440 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1081/2162] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:59:51 2022] PUT /identity/v3/projects/7b0923e975924c339e6fc2b7970e9ed6/users/48b55e72111a42edbe4330f732092e62/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:51.944737 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a36bf-c2a9-4267-b3b6-fcb187568cf1 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:51.945026 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a36bf-c2a9-4267-b3b6-fcb187568cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:51.945806 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a36bf-c2a9-4267-b3b6-fcb187568cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:51.972040 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-443a36bf-c2a9-4267-b3b6-fcb187568cf1 None None] MFA Rules not processed for user `48b55e72111a42edbe4330f732092e62`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:51.973217 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-443a36bf-c2a9-4267-b3b6-fcb187568cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:52.046418 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1082/2163] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:51 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:52.057481 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa668c6-8c3c-4eed-8f9f-c8e651ad4078 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:52.059175 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-1aa668c6-8c3c-4eed-8f9f-c8e651ad4078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:52.116897 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa668c6-8c3c-4eed-8f9f-c8e651ad4078 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:52.121150 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62435f69-4a69-4317-b474-cbfacce6830d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:52.121795 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62435f69-4a69-4317-b474-cbfacce6830d service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:52.122080 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62435f69-4a69-4317-b474-cbfacce6830d service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:52.122362 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62435f69-4a69-4317-b474-cbfacce6830d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:52.131548 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62435f69-4a69-4317-b474-cbfacce6830d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:52.133981 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62435f69-4a69-4317-b474-cbfacce6830d service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:52.144955 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1082/2164] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:59:52 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:59:52.489192 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a36bf-c2a9-4267-b3b6-fcb187568cf1 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:52.555083 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a36bf-c2a9-4267-b3b6-fcb187568cf1 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:52.559740 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8260ff9-b0fd-4a76-a6a5-b3967bf2dd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:52.560612 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8260ff9-b0fd-4a76-a6a5-b3967bf2dd73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:52.560894 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8260ff9-b0fd-4a76-a6a5-b3967bf2dd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:52.561172 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8260ff9-b0fd-4a76-a6a5-b3967bf2dd73 admin admin] PATH_INFO: `/v3/users/efd89450f871430b8a98bbea5d6e7e3f` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:52.562612 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8260ff9-b0fd-4a76-a6a5-b3967bf2dd73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efd89450f871430b8a98bbea5d6e7e3f)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:52.564606 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8260ff9-b0fd-4a76-a6a5-b3967bf2dd73 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:52.622414 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-b8260ff9-b0fd-4a76-a6a5-b3967bf2dd73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efd89450f871430b8a98bbea5d6e7e3f'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:52.623073 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-b8260ff9-b0fd-4a76-a6a5-b3967bf2dd73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efd89450f871430b8a98bbea5d6e7e3f'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:52.626415 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:52.638855 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-b8260ff9-b0fd-4a76-a6a5-b3967bf2dd73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efd89450f871430b8a98bbea5d6e7e3f'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:52.646279 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-b8260ff9-b0fd-4a76-a6a5-b3967bf2dd73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efd89450f871430b8a98bbea5d6e7e3f'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:52.664910 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-b8260ff9-b0fd-4a76-a6a5-b3967bf2dd73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efd89450f871430b8a98bbea5d6e7e3f'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:52.674065 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1083/2165] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 11:59:52 2022] DELETE /identity/v3/users/efd89450f871430b8a98bbea5d6e7e3f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:52.678770 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a12a1f-614e-40aa-a6f5-d3442383bb2e None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:52.679222 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a12a1f-614e-40aa-a6f5-d3442383bb2e None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:52.679336 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a12a1f-614e-40aa-a6f5-d3442383bb2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:52.704994 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-71a12a1f-614e-40aa-a6f5-d3442383bb2e None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:52.706209 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-71a12a1f-614e-40aa-a6f5-d3442383bb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:52.766419 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1083/2166] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 11:59:52.776631 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8260ff9-b0fd-4a76-a6a5-b3967bf2dd73 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:52.777985 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-b8260ff9-b0fd-4a76-a6a5-b3967bf2dd73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:52.834056 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8260ff9-b0fd-4a76-a6a5-b3967bf2dd73 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:52.838349 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aac54d-e6fa-42cc-9571-9cc73b685fb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:52.838987 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aac54d-e6fa-42cc-9571-9cc73b685fb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:52.839266 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aac54d-e6fa-42cc-9571-9cc73b685fb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:52.839561 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aac54d-e6fa-42cc-9571-9cc73b685fb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:52.848539 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aac54d-e6fa-42cc-9571-9cc73b685fb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:52.849971 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aac54d-e6fa-42cc-9571-9cc73b685fb7 service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:52.860101 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1084/2167] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:59:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 11:59:53.134025 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a12a1f-614e-40aa-a6f5-d3442383bb2e None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:53.135434 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-71a12a1f-614e-40aa-a6f5-d3442383bb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:53.149868 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a12a1f-614e-40aa-a6f5-d3442383bb2e None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:53.154435 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bddef9-0525-44c7-a3c2-fac05f8c985a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:53.155987 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bddef9-0525-44c7-a3c2-fac05f8c985a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:53.156271 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bddef9-0525-44c7-a3c2-fac05f8c985a admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:53.156542 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bddef9-0525-44c7-a3c2-fac05f8c985a admin admin] PATH_INFO: `/v3/projects/4fe53ef28a9a4415b146b3a1709286f4` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:53.158128 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bddef9-0525-44c7-a3c2-fac05f8c985a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fe53ef28a9a4415b146b3a1709286f4)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:53.159984 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bddef9-0525-44c7-a3c2-fac05f8c985a admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:53.207195 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-84bddef9-0525-44c7-a3c2-fac05f8c985a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fe53ef28a9a4415b146b3a1709286f4', 'request_id': 'req-84bddef9-0525-44c7-a3c2-fac05f8c985a'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:53.213387 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-84bddef9-0525-44c7-a3c2-fac05f8c985a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fe53ef28a9a4415b146b3a1709286f4', 'request_id': 'req-84bddef9-0525-44c7-a3c2-fac05f8c985a'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:53.220910 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-84bddef9-0525-44c7-a3c2-fac05f8c985a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fe53ef28a9a4415b146b3a1709286f4', 'request_id': 'req-84bddef9-0525-44c7-a3c2-fac05f8c985a'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:53.232165 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-84bddef9-0525-44c7-a3c2-fac05f8c985a admin admin] The token cache is being invalidate because project 4fe53ef28a9a4415b146b3a1709286f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 11:59:53.232457 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-84bddef9-0525-44c7-a3c2-fac05f8c985a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:53.233086 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-84bddef9-0525-44c7-a3c2-fac05f8c985a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:53.234630 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1084/2168] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 11:59:53 2022] DELETE /identity/v3/projects/4fe53ef28a9a4415b146b3a1709286f4 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:53.238579 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aac54d-e6fa-42cc-9571-9cc73b685fb7 service neutron] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:53.250200 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aac54d-e6fa-42cc-9571-9cc73b685fb7 service neutron] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:53.307222 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151d8e1-4ed6-4662-95b0-75321b8e2a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:53.308041 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151d8e1-4ed6-4662-95b0-75321b8e2a89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:53.308326 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151d8e1-4ed6-4662-95b0-75321b8e2a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:53.308603 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151d8e1-4ed6-4662-95b0-75321b8e2a89 admin admin] PATH_INFO: `/v3/users/48b55e72111a42edbe4330f732092e62` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:53.309783 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d151d8e1-4ed6-4662-95b0-75321b8e2a89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48b55e72111a42edbe4330f732092e62)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:53.311728 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d151d8e1-4ed6-4662-95b0-75321b8e2a89 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:53.361514 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-d151d8e1-4ed6-4662-95b0-75321b8e2a89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48b55e72111a42edbe4330f732092e62'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:53.362168 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-d151d8e1-4ed6-4662-95b0-75321b8e2a89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48b55e72111a42edbe4330f732092e62'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:53.374059 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-d151d8e1-4ed6-4662-95b0-75321b8e2a89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48b55e72111a42edbe4330f732092e62'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:53.378477 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:53.383060 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-d151d8e1-4ed6-4662-95b0-75321b8e2a89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48b55e72111a42edbe4330f732092e62'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:53.390587 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-d151d8e1-4ed6-4662-95b0-75321b8e2a89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48b55e72111a42edbe4330f732092e62'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:53.396615 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1085/2169] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 11:59:53 2022] DELETE /identity/v3/users/48b55e72111a42edbe4330f732092e62 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:53.766670 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bddef9-0525-44c7-a3c2-fac05f8c985a admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:53.766670 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-84bddef9-0525-44c7-a3c2-fac05f8c985a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:53.794533 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bddef9-0525-44c7-a3c2-fac05f8c985a admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:53.826384 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:53.884003 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b8c839-6d81-48d8-9b67-cb5830a4f442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:53.884897 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8c839-6d81-48d8-9b67-cb5830a4f442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:53.885333 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8c839-6d81-48d8-9b67-cb5830a4f442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:53.885616 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8c839-6d81-48d8-9b67-cb5830a4f442 admin admin] PATH_INFO: `/v3/projects/7b0923e975924c339e6fc2b7970e9ed6` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:53.886939 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b8c839-6d81-48d8-9b67-cb5830a4f442 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b0923e975924c339e6fc2b7970e9ed6)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:53.888892 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b8c839-6d81-48d8-9b67-cb5830a4f442 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:53.940447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-c0b8c839-6d81-48d8-9b67-cb5830a4f442 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b0923e975924c339e6fc2b7970e9ed6', 'request_id': 'req-c0b8c839-6d81-48d8-9b67-cb5830a4f442'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:53.946922 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-c0b8c839-6d81-48d8-9b67-cb5830a4f442 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b0923e975924c339e6fc2b7970e9ed6', 'request_id': 'req-c0b8c839-6d81-48d8-9b67-cb5830a4f442'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:53.955616 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-c0b8c839-6d81-48d8-9b67-cb5830a4f442 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b0923e975924c339e6fc2b7970e9ed6', 'request_id': 'req-c0b8c839-6d81-48d8-9b67-cb5830a4f442'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:53.967705 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-c0b8c839-6d81-48d8-9b67-cb5830a4f442 admin admin] The token cache is being invalidate because project 7b0923e975924c339e6fc2b7970e9ed6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 11:59:53.967999 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-c0b8c839-6d81-48d8-9b67-cb5830a4f442 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:53.968628 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-c0b8c839-6d81-48d8-9b67-cb5830a4f442 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 11:59:53.970197 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1085/2170] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 11:59:53 2022] DELETE /identity/v3/projects/7b0923e975924c339e6fc2b7970e9ed6 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:53.975091 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a3d70-c0ef-4d94-84db-6a3ac070e1a8 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:53.975579 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a3d70-c0ef-4d94-84db-6a3ac070e1a8 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:53.975677 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a3d70-c0ef-4d94-84db-6a3ac070e1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:53.992998 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-f52a3d70-c0ef-4d94-84db-6a3ac070e1a8 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:53.994189 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-f52a3d70-c0ef-4d94-84db-6a3ac070e1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:54.054691 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1086/2171] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:54.062561 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad2060-f593-4789-9a5f-531b525fc9af None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:54.062850 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad2060-f593-4789-9a5f-531b525fc9af None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:54.063126 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad2060-f593-4789-9a5f-531b525fc9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:54.081688 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-7cad2060-f593-4789-9a5f-531b525fc9af None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:54.082887 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-7cad2060-f593-4789-9a5f-531b525fc9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:54.091522 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1086/2172] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:54.095350 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a3d70-c0ef-4d94-84db-6a3ac070e1a8 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:54.104915 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a3d70-c0ef-4d94-84db-6a3ac070e1a8 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:54.109657 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaab1e0-7c2e-46f2-8911-747e0ccf88bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:54.110169 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaab1e0-7c2e-46f2-8911-747e0ccf88bc admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:54.110452 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaab1e0-7c2e-46f2-8911-747e0ccf88bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:54.110728 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaab1e0-7c2e-46f2-8911-747e0ccf88bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:54.111457 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaab1e0-7c2e-46f2-8911-747e0ccf88bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 11:59:54.111797 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaab1e0-7c2e-46f2-8911-747e0ccf88bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:54.113414 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaab1e0-7c2e-46f2-8911-747e0ccf88bc admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:54.125234 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1087/2173] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 11:59:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 11:59:54.135733 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad2060-f593-4789-9a5f-531b525fc9af None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:54.140200 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad2060-f593-4789-9a5f-531b525fc9af None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:54.145035 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39472965-c80b-44da-a6ca-c197043904ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:54.145689 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39472965-c80b-44da-a6ca-c197043904ac admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:54.145994 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39472965-c80b-44da-a6ca-c197043904ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:54.146276 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39472965-c80b-44da-a6ca-c197043904ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:54.146963 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39472965-c80b-44da-a6ca-c197043904ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:54.149810 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39472965-c80b-44da-a6ca-c197043904ac admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:54.174473 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1087/2174] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:59:54 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:59:54.178712 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaab1e0-7c2e-46f2-8911-747e0ccf88bc admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:54.188621 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaab1e0-7c2e-46f2-8911-747e0ccf88bc admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:54.243998 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2dd2cc-fa4a-4b25-b5a7-1452ccccf7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:54.244639 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2dd2cc-fa4a-4b25-b5a7-1452ccccf7df admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:54.244922 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2dd2cc-fa4a-4b25-b5a7-1452ccccf7df admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:54.245196 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2dd2cc-fa4a-4b25-b5a7-1452ccccf7df admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:54.245874 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2dd2cc-fa4a-4b25-b5a7-1452ccccf7df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:54.247823 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2dd2cc-fa4a-4b25-b5a7-1452ccccf7df admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:54.268018 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1088/2175] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:59:54 2022] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:59:54.271600 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39472965-c80b-44da-a6ca-c197043904ac admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:54.282192 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39472965-c80b-44da-a6ca-c197043904ac admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:54.286776 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a75c4-bc11-4fdd-a664-5a3b89bf8b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:54.287421 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a75c4-bc11-4fdd-a664-5a3b89bf8b45 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:54.287736 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a75c4-bc11-4fdd-a664-5a3b89bf8b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:54.288011 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a75c4-bc11-4fdd-a664-5a3b89bf8b45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:54.288727 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a75c4-bc11-4fdd-a664-5a3b89bf8b45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:54.290303 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a75c4-bc11-4fdd-a664-5a3b89bf8b45 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:54.300773 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1088/2176] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:59:54.305548 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2dd2cc-fa4a-4b25-b5a7-1452ccccf7df admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:54.316266 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2dd2cc-fa4a-4b25-b5a7-1452ccccf7df admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:54.321653 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7047893-a1c2-4261-b691-b5c31428956e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:54.322320 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7047893-a1c2-4261-b691-b5c31428956e admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:54.322606 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7047893-a1c2-4261-b691-b5c31428956e admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:54.322886 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7047893-a1c2-4261-b691-b5c31428956e admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:54.323656 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7047893-a1c2-4261-b691-b5c31428956e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:54.325266 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7047893-a1c2-4261-b691-b5c31428956e admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:54.335280 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1089/2177] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:59:54.339493 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a75c4-bc11-4fdd-a664-5a3b89bf8b45 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:54.349560 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a75c4-bc11-4fdd-a664-5a3b89bf8b45 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:54.359915 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac79db-51f9-4bee-8db6-44ef623c25c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:54.360779 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac79db-51f9-4bee-8db6-44ef623c25c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:54.361057 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac79db-51f9-4bee-8db6-44ef623c25c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:54.361326 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac79db-51f9-4bee-8db6-44ef623c25c5 admin admin] PATH_INFO: `/v3/projects/ba76c4d46fa84731b82fd285d39e3cc4/users/2659202e79504aa9843168a29acdb0a0/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:54.378804 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ac79db-51f9-4bee-8db6-44ef623c25c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba76c4d46fa84731b82fd285d39e3cc4, user_id=2659202e79504aa9843168a29acdb0a0, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:54.381694 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ac79db-51f9-4bee-8db6-44ef623c25c5 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:54.395661 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1089/2178] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:59:54 2022] PUT /identity/v3/projects/ba76c4d46fa84731b82fd285d39e3cc4/users/2659202e79504aa9843168a29acdb0a0/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:54.405790 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65f505-b8ff-472c-87e2-2d9e083d3665 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:54.406087 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65f505-b8ff-472c-87e2-2d9e083d3665 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:54.406400 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65f505-b8ff-472c-87e2-2d9e083d3665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:54.432938 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-2c65f505-b8ff-472c-87e2-2d9e083d3665 None None] MFA Rules not processed for user `2659202e79504aa9843168a29acdb0a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:54.434183 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-2c65f505-b8ff-472c-87e2-2d9e083d3665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:54.475383 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:54.500345 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1090/2179] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:54.504945 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac79db-51f9-4bee-8db6-44ef623c25c5 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:54.553168 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:54.572905 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac79db-51f9-4bee-8db6-44ef623c25c5 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:54.577877 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b8254-2656-4b66-8505-59f016bbc638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:54.578530 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b8254-2656-4b66-8505-59f016bbc638 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:54.578997 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b8254-2656-4b66-8505-59f016bbc638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:54.579411 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b8254-2656-4b66-8505-59f016bbc638 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:54.580137 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b8254-2656-4b66-8505-59f016bbc638 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:54.582391 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b8254-2656-4b66-8505-59f016bbc638 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:54.614216 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1090/2180] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 11:59:54 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 11:59:54.615334 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65f505-b8ff-472c-87e2-2d9e083d3665 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:54.629507 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65f505-b8ff-472c-87e2-2d9e083d3665 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:54.695256 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8660580-588a-4851-a35d-a32f510d1c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:54.695968 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8660580-588a-4851-a35d-a32f510d1c48 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:54.696250 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8660580-588a-4851-a35d-a32f510d1c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:54.696527 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8660580-588a-4851-a35d-a32f510d1c48 admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:54.697213 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8660580-588a-4851-a35d-a32f510d1c48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:54.699161 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8660580-588a-4851-a35d-a32f510d1c48 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:54.723220 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1091/2181] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 11:59:54 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 11:59:54.724880 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b8254-2656-4b66-8505-59f016bbc638 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:54.735828 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b8254-2656-4b66-8505-59f016bbc638 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:54.740541 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b620c0-3868-4784-9b16-923efee40374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:54.741201 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b620c0-3868-4784-9b16-923efee40374 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:54.741484 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b620c0-3868-4784-9b16-923efee40374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:54.741763 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b620c0-3868-4784-9b16-923efee40374 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:54.743060 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b620c0-3868-4784-9b16-923efee40374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:54.744725 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b620c0-3868-4784-9b16-923efee40374 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:54.759535 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1091/2182] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:59:54.762931 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8660580-588a-4851-a35d-a32f510d1c48 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:54.773828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8660580-588a-4851-a35d-a32f510d1c48 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:54.778838 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdcac0e-5da4-4e94-85cc-82678e15e30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:54.779765 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdcac0e-5da4-4e94-85cc-82678e15e30e admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:54.780051 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdcac0e-5da4-4e94-85cc-82678e15e30e admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:54.780328 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdcac0e-5da4-4e94-85cc-82678e15e30e admin admin] PATH_INFO: `/v3/projects/8e932686bfe94ef6976a7df2cdd0bed6/users/a07d9a317a614b29a0d040e6866cff12/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:54.796450 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdcac0e-5da4-4e94-85cc-82678e15e30e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e932686bfe94ef6976a7df2cdd0bed6, user_id=a07d9a317a614b29a0d040e6866cff12, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:54.799548 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdcac0e-5da4-4e94-85cc-82678e15e30e admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:54.814606 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1092/2183] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:59:54 2022] PUT /identity/v3/projects/8e932686bfe94ef6976a7df2cdd0bed6/users/a07d9a317a614b29a0d040e6866cff12/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:54.818604 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b620c0-3868-4784-9b16-923efee40374 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:54.830586 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b620c0-3868-4784-9b16-923efee40374 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:54.925992 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c1e6d-c4e6-4e6d-858e-f08d9497f7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:54.926662 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c1e6d-c4e6-4e6d-858e-f08d9497f7c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:54.926977 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c1e6d-c4e6-4e6d-858e-f08d9497f7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:54.927255 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c1e6d-c4e6-4e6d-858e-f08d9497f7c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:54.928009 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c1e6d-c4e6-4e6d-858e-f08d9497f7c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:54.930178 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c1e6d-c4e6-4e6d-858e-f08d9497f7c4 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:54.940831 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1092/2184] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 11:59:54 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 11:59:54.945291 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdcac0e-5da4-4e94-85cc-82678e15e30e admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:54.958198 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdcac0e-5da4-4e94-85cc-82678e15e30e admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:54.963214 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8cc062-f44c-420d-ab9c-26f131eadfad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:54.968072 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8cc062-f44c-420d-ab9c-26f131eadfad admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:54.968453 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8cc062-f44c-420d-ab9c-26f131eadfad admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:54.969070 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8cc062-f44c-420d-ab9c-26f131eadfad admin admin] PATH_INFO: `/v3/projects/8e932686bfe94ef6976a7df2cdd0bed6/users/a07d9a317a614b29a0d040e6866cff12/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:54.971250 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8cc062-f44c-420d-ab9c-26f131eadfad admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e932686bfe94ef6976a7df2cdd0bed6, user_id=a07d9a317a614b29a0d040e6866cff12, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:54.974114 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8cc062-f44c-420d-ab9c-26f131eadfad admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:54.986660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1093/2185] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 11:59:54 2022] PUT /identity/v3/projects/8e932686bfe94ef6976a7df2cdd0bed6/users/a07d9a317a614b29a0d040e6866cff12/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 11:59:55.056739 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3400b53-d63b-4db4-b328-6b8d2ea59f83 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:55.063534 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3400b53-d63b-4db4-b328-6b8d2ea59f83 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:55.063534 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3400b53-d63b-4db4-b328-6b8d2ea59f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:55.086223 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-e3400b53-d63b-4db4-b328-6b8d2ea59f83 None None] MFA Rules not processed for user `a07d9a317a614b29a0d040e6866cff12`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 11:59:55.087429 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-e3400b53-d63b-4db4-b328-6b8d2ea59f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:55.157372 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1093/2186] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 11:59:55 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 11:59:55.182355 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8cc062-f44c-420d-ab9c-26f131eadfad admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 11:59:55.184189 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-0e8cc062-f44c-420d-ab9c-26f131eadfad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 11:59:55.239440 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8cc062-f44c-420d-ab9c-26f131eadfad admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 11:59:55.243678 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a29d41-f2de-47e9-97ea-1af8cfb55a8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 11:59:55.244319 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a29d41-f2de-47e9-97ea-1af8cfb55a8f service cinder] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 11:59:55.244605 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a29d41-f2de-47e9-97ea-1af8cfb55a8f service cinder] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 11:59:55.244887 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a29d41-f2de-47e9-97ea-1af8cfb55a8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 11:59:55.290245 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 11:59:55.300804 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a29d41-f2de-47e9-97ea-1af8cfb55a8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 11:59:55.302237 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a29d41-f2de-47e9-97ea-1af8cfb55a8f service cinder] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 11:59:55.311548 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1094/2187] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 11:59:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:00:05.154453 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=82,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:05.246549 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3400b53-d63b-4db4-b328-6b8d2ea59f83 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:05.307790 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=5 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:05.319953 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3400b53-d63b-4db4-b328-6b8d2ea59f83 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:05.325920 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b82c1-68b0-427b-b02a-3763dc98827b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:05.326802 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b82c1-68b0-427b-b02a-3763dc98827b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:05.327095 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b82c1-68b0-427b-b02a-3763dc98827b admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:05.327401 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b82c1-68b0-427b-b02a-3763dc98827b admin admin] PATH_INFO: `/v3/users/2659202e79504aa9843168a29acdb0a0` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:05.328688 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b82c1-68b0-427b-b02a-3763dc98827b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2659202e79504aa9843168a29acdb0a0)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:05.330608 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b82c1-68b0-427b-b02a-3763dc98827b admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:05.393694 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-ed3b82c1-68b0-427b-b02a-3763dc98827b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2659202e79504aa9843168a29acdb0a0'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:05.401652 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-ed3b82c1-68b0-427b-b02a-3763dc98827b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2659202e79504aa9843168a29acdb0a0'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:05.402323 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-ed3b82c1-68b0-427b-b02a-3763dc98827b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2659202e79504aa9843168a29acdb0a0'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:05.414406 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-ed3b82c1-68b0-427b-b02a-3763dc98827b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2659202e79504aa9843168a29acdb0a0'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:05.422395 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-ed3b82c1-68b0-427b-b02a-3763dc98827b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2659202e79504aa9843168a29acdb0a0'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:05.429157 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1094/2188] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:00:05 2022] DELETE /identity/v3/users/2659202e79504aa9843168a29acdb0a0 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:05.433653 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1e32e-acc6-4973-80e3-7616aa0c5f98 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:05.433948 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1e32e-acc6-4973-80e3-7616aa0c5f98 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:05.434231 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1e32e-acc6-4973-80e3-7616aa0c5f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:05.453450 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-14e1e32e-acc6-4973-80e3-7616aa0c5f98 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:05.454722 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-14e1e32e-acc6-4973-80e3-7616aa0c5f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:05.537224 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1095/2189] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:05.561191 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b82c1-68b0-427b-b02a-3763dc98827b admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:05.562708 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-ed3b82c1-68b0-427b-b02a-3763dc98827b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:05.593555 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a806e4-d282-48bf-acdc-0bbdcf70ad62 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:05.593893 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a806e4-d282-48bf-acdc-0bbdcf70ad62 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:05.594175 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a806e4-d282-48bf-acdc-0bbdcf70ad62 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:05.596261 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1096/2190] 10.222.0.15 () {54 vars in 921 bytes} [Fri Jun 3 12:00:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 03 12:00:05.610433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953eda7-1637-4240-8e2d-df6b071768e3 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:05.610732 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953eda7-1637-4240-8e2d-df6b071768e3 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:05.611258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953eda7-1637-4240-8e2d-df6b071768e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:05.640635 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-d953eda7-1637-4240-8e2d-df6b071768e3 None None] MFA Rules not processed for user `eb5a91437dd64e2491ce41b4d12d4835`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:05.642710 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-d953eda7-1637-4240-8e2d-df6b071768e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:05.670652 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b82c1-68b0-427b-b02a-3763dc98827b admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:05.678620 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fadcb-d73b-49d5-9529-ad1594c11e49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:05.680534 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fadcb-d73b-49d5-9529-ad1594c11e49 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:05.680928 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fadcb-d73b-49d5-9529-ad1594c11e49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:05.682137 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fadcb-d73b-49d5-9529-ad1594c11e49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:05.699376 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3fadcb-d73b-49d5-9529-ad1594c11e49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:05.701336 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3fadcb-d73b-49d5-9529-ad1594c11e49 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:05.715695 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1095/2191] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:00:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:00:05.746526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1097/2192] 10.222.0.15 () {58 vars in 1018 bytes} [Fri Jun 3 12:00:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 12:00:05.886965 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fadcb-d73b-49d5-9529-ad1594c11e49 service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:05.888572 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-de3fadcb-d73b-49d5-9529-ad1594c11e49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:05.917227 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fadcb-d73b-49d5-9529-ad1594c11e49 service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:05.923288 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84da2dc-2d6b-40c4-a5a2-87786d597346 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5a91437dd64e2491ce41b4d12d4835', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:05.924090 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84da2dc-2d6b-40c4-a5a2-87786d597346 service placement] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:05.924486 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84da2dc-2d6b-40c4-a5a2-87786d597346 service placement] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:05.924862 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84da2dc-2d6b-40c4-a5a2-87786d597346 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:05.935057 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84da2dc-2d6b-40c4-a5a2-87786d597346 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:05.936836 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84da2dc-2d6b-40c4-a5a2-87786d597346 service placement] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:05.964677 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1096/2193] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:00:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:00:05.971471 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953eda7-1637-4240-8e2d-df6b071768e3 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:05.973012 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-d953eda7-1637-4240-8e2d-df6b071768e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:05.993767 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953eda7-1637-4240-8e2d-df6b071768e3 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:05.999419 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989f3e2-7b5e-4b45-a7de-4cc31beecff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:06.000421 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989f3e2-7b5e-4b45-a7de-4cc31beecff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:06.000696 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989f3e2-7b5e-4b45-a7de-4cc31beecff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:06.001046 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989f3e2-7b5e-4b45-a7de-4cc31beecff8 admin admin] PATH_INFO: `/v3/users/8e1d264439b340c3af56cad54b7bc4a4` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:06.003346 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989f3e2-7b5e-4b45-a7de-4cc31beecff8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e1d264439b340c3af56cad54b7bc4a4)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:06.004451 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989f3e2-7b5e-4b45-a7de-4cc31beecff8 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:06.057027 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-e989f3e2-7b5e-4b45-a7de-4cc31beecff8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e1d264439b340c3af56cad54b7bc4a4'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:06.057798 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-e989f3e2-7b5e-4b45-a7de-4cc31beecff8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e1d264439b340c3af56cad54b7bc4a4'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:06.073000 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-e989f3e2-7b5e-4b45-a7de-4cc31beecff8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e1d264439b340c3af56cad54b7bc4a4'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:06.082519 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-e989f3e2-7b5e-4b45-a7de-4cc31beecff8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e1d264439b340c3af56cad54b7bc4a4'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:06.094748 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-e989f3e2-7b5e-4b45-a7de-4cc31beecff8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e1d264439b340c3af56cad54b7bc4a4'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:06.101951 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1098/2194] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:00:05 2022] DELETE /identity/v3/users/8e1d264439b340c3af56cad54b7bc4a4 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:06.306230 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84da2dc-2d6b-40c4-a5a2-87786d597346 service placement] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:06.307709 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-c84da2dc-2d6b-40c4-a5a2-87786d597346 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:06.333316 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84da2dc-2d6b-40c4-a5a2-87786d597346 service placement] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:06.347365 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989f3e2-7b5e-4b45-a7de-4cc31beecff8 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:06.350926 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-e989f3e2-7b5e-4b45-a7de-4cc31beecff8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:06.360216 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:06.363723 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:06.448056 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff814ba3-2451-4bfb-b3b2-4f9334103d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:06.449327 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff814ba3-2451-4bfb-b3b2-4f9334103d07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:06.449762 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff814ba3-2451-4bfb-b3b2-4f9334103d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:06.450173 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff814ba3-2451-4bfb-b3b2-4f9334103d07 admin admin] PATH_INFO: `/v3/projects/ba76c4d46fa84731b82fd285d39e3cc4` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:06.451544 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff814ba3-2451-4bfb-b3b2-4f9334103d07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba76c4d46fa84731b82fd285d39e3cc4)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:06.454193 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff814ba3-2451-4bfb-b3b2-4f9334103d07 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:06.475630 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989f3e2-7b5e-4b45-a7de-4cc31beecff8 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:06.485183 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f5a9a-3f47-40d6-a6c1-ed42a570597e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:06.486387 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f5a9a-3f47-40d6-a6c1-ed42a570597e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:06.486960 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f5a9a-3f47-40d6-a6c1-ed42a570597e admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:06.487390 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f5a9a-3f47-40d6-a6c1-ed42a570597e admin admin] PATH_INFO: `/v3/projects/d10936ccaf444728a01afc3f374e2285` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:06.492435 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628f5a9a-3f47-40d6-a6c1-ed42a570597e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d10936ccaf444728a01afc3f374e2285)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:06.494881 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628f5a9a-3f47-40d6-a6c1-ed42a570597e admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:06.536120 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-ff814ba3-2451-4bfb-b3b2-4f9334103d07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba76c4d46fa84731b82fd285d39e3cc4', 'request_id': 'req-ff814ba3-2451-4bfb-b3b2-4f9334103d07'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:06.546828 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-ff814ba3-2451-4bfb-b3b2-4f9334103d07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba76c4d46fa84731b82fd285d39e3cc4', 'request_id': 'req-ff814ba3-2451-4bfb-b3b2-4f9334103d07'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:06.556469 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-ff814ba3-2451-4bfb-b3b2-4f9334103d07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba76c4d46fa84731b82fd285d39e3cc4', 'request_id': 'req-ff814ba3-2451-4bfb-b3b2-4f9334103d07'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:06.570940 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-ff814ba3-2451-4bfb-b3b2-4f9334103d07 admin admin] The token cache is being invalidate because project ba76c4d46fa84731b82fd285d39e3cc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:00:06.571242 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-ff814ba3-2451-4bfb-b3b2-4f9334103d07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:06.572385 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-ff814ba3-2451-4bfb-b3b2-4f9334103d07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:06.577958 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1097/2195] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:00:06 2022] DELETE /identity/v3/projects/ba76c4d46fa84731b82fd285d39e3cc4 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:06.583334 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff814ba3-2451-4bfb-b3b2-4f9334103d07 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:06.592404 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-ff814ba3-2451-4bfb-b3b2-4f9334103d07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:06.611763 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-628f5a9a-3f47-40d6-a6c1-ed42a570597e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd10936ccaf444728a01afc3f374e2285', 'request_id': 'req-628f5a9a-3f47-40d6-a6c1-ed42a570597e'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:06.618557 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-628f5a9a-3f47-40d6-a6c1-ed42a570597e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd10936ccaf444728a01afc3f374e2285', 'request_id': 'req-628f5a9a-3f47-40d6-a6c1-ed42a570597e'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:06.632889 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-628f5a9a-3f47-40d6-a6c1-ed42a570597e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd10936ccaf444728a01afc3f374e2285', 'request_id': 'req-628f5a9a-3f47-40d6-a6c1-ed42a570597e'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:06.657433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-628f5a9a-3f47-40d6-a6c1-ed42a570597e admin admin] The token cache is being invalidate because project d10936ccaf444728a01afc3f374e2285 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:00:06.657786 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-628f5a9a-3f47-40d6-a6c1-ed42a570597e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:06.658636 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-628f5a9a-3f47-40d6-a6c1-ed42a570597e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:06.660734 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1099/2196] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:00:06 2022] DELETE /identity/v3/projects/d10936ccaf444728a01afc3f374e2285 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:06.669953 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d279c67-1361-4d18-a224-c8757880358b None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:06.670410 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d279c67-1361-4d18-a224-c8757880358b None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:06.671138 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d279c67-1361-4d18-a224-c8757880358b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:06.697605 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-2d279c67-1361-4d18-a224-c8757880358b None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:06.702226 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-2d279c67-1361-4d18-a224-c8757880358b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:06.746322 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff814ba3-2451-4bfb-b3b2-4f9334103d07 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:06.785237 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1100/2197] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:06.786253 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d279c67-1361-4d18-a224-c8757880358b None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:06.793208 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-2d279c67-1361-4d18-a224-c8757880358b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:06.806965 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d279c67-1361-4d18-a224-c8757880358b None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:06.820622 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae89cf-b619-4122-ae84-d5ee5042a6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:06.821508 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae89cf-b619-4122-ae84-d5ee5042a6d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:06.821790 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae89cf-b619-4122-ae84-d5ee5042a6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:06.822065 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae89cf-b619-4122-ae84-d5ee5042a6d9 admin admin] PATH_INFO: `/v3/users/0da34c8683a64189a0fc2958957de2b7` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:06.824015 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ae89cf-b619-4122-ae84-d5ee5042a6d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0da34c8683a64189a0fc2958957de2b7)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:06.825963 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ae89cf-b619-4122-ae84-d5ee5042a6d9 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:06.829204 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:06.853088 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1ab85-2f02-4935-a596-075aa1efcf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:06.854948 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1ab85-2f02-4935-a596-075aa1efcf77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:06.855881 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1ab85-2f02-4935-a596-075aa1efcf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:06.856309 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1ab85-2f02-4935-a596-075aa1efcf77 admin admin] PATH_INFO: `/v3/users/a07d9a317a614b29a0d040e6866cff12` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:06.857873 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1ab85-2f02-4935-a596-075aa1efcf77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a07d9a317a614b29a0d040e6866cff12)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:06.859879 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1ab85-2f02-4935-a596-075aa1efcf77 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:06.886078 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:06.911127 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-75ae89cf-b619-4122-ae84-d5ee5042a6d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0da34c8683a64189a0fc2958957de2b7'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:06.911873 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-75ae89cf-b619-4122-ae84-d5ee5042a6d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0da34c8683a64189a0fc2958957de2b7'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:06.929738 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-75ae89cf-b619-4122-ae84-d5ee5042a6d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0da34c8683a64189a0fc2958957de2b7'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:06.941248 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-75ae89cf-b619-4122-ae84-d5ee5042a6d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0da34c8683a64189a0fc2958957de2b7'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:06.941593 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-71e1ab85-2f02-4935-a596-075aa1efcf77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a07d9a317a614b29a0d040e6866cff12'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:06.948077 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-75ae89cf-b619-4122-ae84-d5ee5042a6d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0da34c8683a64189a0fc2958957de2b7'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:06.948909 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-71e1ab85-2f02-4935-a596-075aa1efcf77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a07d9a317a614b29a0d040e6866cff12'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:06.949679 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-71e1ab85-2f02-4935-a596-075aa1efcf77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a07d9a317a614b29a0d040e6866cff12'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:06.957079 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1101/2198] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:00:06 2022] DELETE /identity/v3/users/0da34c8683a64189a0fc2958957de2b7 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:06.958160 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287fc04-375f-40da-9b1f-77dc50ffa896 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:06.958452 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287fc04-375f-40da-9b1f-77dc50ffa896 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:06.958737 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287fc04-375f-40da-9b1f-77dc50ffa896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:06.968465 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-71e1ab85-2f02-4935-a596-075aa1efcf77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a07d9a317a614b29a0d040e6866cff12'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:06.977983 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-9287fc04-375f-40da-9b1f-77dc50ffa896 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:06.978379 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-71e1ab85-2f02-4935-a596-075aa1efcf77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a07d9a317a614b29a0d040e6866cff12'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:06.979126 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-9287fc04-375f-40da-9b1f-77dc50ffa896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:06.987834 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1098/2199] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:00:06 2022] DELETE /identity/v3/users/a07d9a317a614b29a0d040e6866cff12 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:06.990006 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e48765-d3aa-4ff3-a20e-226c1af3b591 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:06.995481 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e48765-d3aa-4ff3-a20e-226c1af3b591 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:06.996234 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e48765-d3aa-4ff3-a20e-226c1af3b591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:07.027016 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-d6e48765-d3aa-4ff3-a20e-226c1af3b591 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:07.028402 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-d6e48765-d3aa-4ff3-a20e-226c1af3b591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:07.084490 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1102/2200] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:07.084490 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287fc04-375f-40da-9b1f-77dc50ffa896 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:07.092337 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287fc04-375f-40da-9b1f-77dc50ffa896 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:07.096471 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1099/2201] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:07.101531 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cbddfb-8c7f-454c-b1b6-3bc986d19d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:07.102317 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbddfb-8c7f-454c-b1b6-3bc986d19d02 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:07.102613 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbddfb-8c7f-454c-b1b6-3bc986d19d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:07.103020 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbddfb-8c7f-454c-b1b6-3bc986d19d02 admin admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:07.104723 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cbddfb-8c7f-454c-b1b6-3bc986d19d02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:00:07.105129 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cbddfb-8c7f-454c-b1b6-3bc986d19d02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:07.107103 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cbddfb-8c7f-454c-b1b6-3bc986d19d02 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:07.108550 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e48765-d3aa-4ff3-a20e-226c1af3b591 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:07.110419 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-d6e48765-d3aa-4ff3-a20e-226c1af3b591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:07.123338 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1103/2202] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 12:00:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:00:07.128447 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cbddfb-8c7f-454c-b1b6-3bc986d19d02 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:07.160867 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cbddfb-8c7f-454c-b1b6-3bc986d19d02 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:07.178838 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07585d9-7cc0-4912-a3d9-511c25013d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:07.180938 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07585d9-7cc0-4912-a3d9-511c25013d62 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:07.182745 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07585d9-7cc0-4912-a3d9-511c25013d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:07.183539 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07585d9-7cc0-4912-a3d9-511c25013d62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:07.186350 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07585d9-7cc0-4912-a3d9-511c25013d62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:07.188479 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07585d9-7cc0-4912-a3d9-511c25013d62 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:07.201254 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e48765-d3aa-4ff3-a20e-226c1af3b591 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:07.208838 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb72e47-53ac-4e61-a3df-528cb676f9bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:07.210619 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb72e47-53ac-4e61-a3df-528cb676f9bc service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:07.211008 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb72e47-53ac-4e61-a3df-528cb676f9bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:07.211294 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb72e47-53ac-4e61-a3df-528cb676f9bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:07.223970 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb72e47-53ac-4e61-a3df-528cb676f9bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:07.225797 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb72e47-53ac-4e61-a3df-528cb676f9bc service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:07.226553 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1104/2203] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 12:00:07 2022] POST /identity/v3/projects => generated 405 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:00:07.230674 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07585d9-7cc0-4912-a3d9-511c25013d62 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:07.240601 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1100/2204] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:00:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:00:07.310224 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07585d9-7cc0-4912-a3d9-511c25013d62 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:07.320539 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524bee5-43ea-48d6-b986-44109b679935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:07.321241 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524bee5-43ea-48d6-b986-44109b679935 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:07.321530 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524bee5-43ea-48d6-b986-44109b679935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:07.321975 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524bee5-43ea-48d6-b986-44109b679935 admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:07.322847 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5524bee5-43ea-48d6-b986-44109b679935 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:07.326044 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5524bee5-43ea-48d6-b986-44109b679935 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:07.379000 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1105/2205] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 12:00:07 2022] POST /identity/v3/users => generated 303 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:00:07.384058 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb72e47-53ac-4e61-a3df-528cb676f9bc service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:07.399230 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb72e47-53ac-4e61-a3df-528cb676f9bc service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:07.406541 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8629a9-5a5a-4d27-b9ee-e5ba3c1c2514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:07.407451 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8629a9-5a5a-4d27-b9ee-e5ba3c1c2514 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:07.408422 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8629a9-5a5a-4d27-b9ee-e5ba3c1c2514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:07.408422 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8629a9-5a5a-4d27-b9ee-e5ba3c1c2514 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:07.409795 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8629a9-5a5a-4d27-b9ee-e5ba3c1c2514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:07.415828 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8629a9-5a5a-4d27-b9ee-e5ba3c1c2514 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:07.434576 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:07.445983 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1101/2206] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 12:00:07.450338 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524bee5-43ea-48d6-b986-44109b679935 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:07.471358 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524bee5-43ea-48d6-b986-44109b679935 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:07.477081 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5d6a2-8b7d-4913-be2e-cab7e12ce908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:07.477864 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5d6a2-8b7d-4913-be2e-cab7e12ce908 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:07.478603 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5d6a2-8b7d-4913-be2e-cab7e12ce908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:07.478962 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5d6a2-8b7d-4913-be2e-cab7e12ce908 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:07.479846 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5d6a2-8b7d-4913-be2e-cab7e12ce908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:07.481759 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5d6a2-8b7d-4913-be2e-cab7e12ce908 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:07.483338 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:07.498233 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1106/2207] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:00:07.503041 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8629a9-5a5a-4d27-b9ee-e5ba3c1c2514 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:07.509444 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5d6a2-8b7d-4913-be2e-cab7e12ce908 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:07.511319 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-4ae5d6a2-8b7d-4913-be2e-cab7e12ce908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:07.514666 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8629a9-5a5a-4d27-b9ee-e5ba3c1c2514 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:07.522653 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d252b34-14f3-410c-8a2d-98d352c00351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:07.524790 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d252b34-14f3-410c-8a2d-98d352c00351 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:07.525082 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d252b34-14f3-410c-8a2d-98d352c00351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:07.525362 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d252b34-14f3-410c-8a2d-98d352c00351 admin admin] PATH_INFO: `/v3/projects/d497828bf0394aa4a100a01b0a0d061a/users/b7ca439b8c284bff9872e5774bed6ce0/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:07.525805 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5d6a2-8b7d-4913-be2e-cab7e12ce908 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:07.530934 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4fcd92-38be-433f-b38d-6367390d27ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:07.532246 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fcd92-38be-433f-b38d-6367390d27ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:07.532615 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fcd92-38be-433f-b38d-6367390d27ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:07.532964 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fcd92-38be-433f-b38d-6367390d27ca admin admin] PATH_INFO: `/v3/projects/8e932686bfe94ef6976a7df2cdd0bed6` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:07.534421 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4fcd92-38be-433f-b38d-6367390d27ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e932686bfe94ef6976a7df2cdd0bed6)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:07.536751 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4fcd92-38be-433f-b38d-6367390d27ca admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:07.546776 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d252b34-14f3-410c-8a2d-98d352c00351 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d497828bf0394aa4a100a01b0a0d061a, user_id=b7ca439b8c284bff9872e5774bed6ce0, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:07.550246 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d252b34-14f3-410c-8a2d-98d352c00351 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:07.587217 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1102/2208] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:00:07 2022] PUT /identity/v3/projects/d497828bf0394aa4a100a01b0a0d061a/users/b7ca439b8c284bff9872e5774bed6ce0/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:07.592554 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c7469-b588-4f07-b526-0e63e8b3bd83 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:07.593220 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c7469-b588-4f07-b526-0e63e8b3bd83 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:07.593608 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c7469-b588-4f07-b526-0e63e8b3bd83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:07.634570 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-219c7469-b588-4f07-b526-0e63e8b3bd83 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:07.635931 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-219c7469-b588-4f07-b526-0e63e8b3bd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:07.645629 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-0b4fcd92-38be-433f-b38d-6367390d27ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e932686bfe94ef6976a7df2cdd0bed6', 'request_id': 'req-0b4fcd92-38be-433f-b38d-6367390d27ca'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:07.659118 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-0b4fcd92-38be-433f-b38d-6367390d27ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e932686bfe94ef6976a7df2cdd0bed6', 'request_id': 'req-0b4fcd92-38be-433f-b38d-6367390d27ca'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:07.678730 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-0b4fcd92-38be-433f-b38d-6367390d27ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e932686bfe94ef6976a7df2cdd0bed6', 'request_id': 'req-0b4fcd92-38be-433f-b38d-6367390d27ca'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:07.699563 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-0b4fcd92-38be-433f-b38d-6367390d27ca admin admin] The token cache is being invalidate because project 8e932686bfe94ef6976a7df2cdd0bed6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:00:07.699563 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-0b4fcd92-38be-433f-b38d-6367390d27ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:07.699563 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-0b4fcd92-38be-433f-b38d-6367390d27ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:07.700392 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1107/2209] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:00:07 2022] DELETE /identity/v3/projects/8e932686bfe94ef6976a7df2cdd0bed6 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:07.701247 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4fcd92-38be-433f-b38d-6367390d27ca admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:07.707782 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-0b4fcd92-38be-433f-b38d-6367390d27ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:07.726012 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1103/2210] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:07.727367 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cdde05-6aca-4db3-819f-13b222c12b14 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:07.727698 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cdde05-6aca-4db3-819f-13b222c12b14 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:07.728041 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cdde05-6aca-4db3-819f-13b222c12b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:07.756159 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-31cdde05-6aca-4db3-819f-13b222c12b14 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:07.758395 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-31cdde05-6aca-4db3-819f-13b222c12b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:07.771677 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1104/2211] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:07.771677 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cdde05-6aca-4db3-819f-13b222c12b14 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:07.774385 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-31cdde05-6aca-4db3-819f-13b222c12b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:07.790063 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4fcd92-38be-433f-b38d-6367390d27ca admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:07.795602 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a8eb9-78a5-4fa6-b516-fbeb70393abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:07.797765 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a8eb9-78a5-4fa6-b516-fbeb70393abe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:07.798134 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a8eb9-78a5-4fa6-b516-fbeb70393abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:07.798869 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a8eb9-78a5-4fa6-b516-fbeb70393abe admin admin] PATH_INFO: `/v3/projects/80a8b8c000fa49e2be57b1a0e5e7cc45` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:07.801534 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a8eb9-78a5-4fa6-b516-fbeb70393abe admin admin] RBAC: Authorizing `identity:delete_project(project_id=80a8b8c000fa49e2be57b1a0e5e7cc45)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:07.804539 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a8eb9-78a5-4fa6-b516-fbeb70393abe admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:07.853003 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cdde05-6aca-4db3-819f-13b222c12b14 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:07.869809 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-452a8eb9-78a5-4fa6-b516-fbeb70393abe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80a8b8c000fa49e2be57b1a0e5e7cc45', 'request_id': 'req-452a8eb9-78a5-4fa6-b516-fbeb70393abe'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:07.877558 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-452a8eb9-78a5-4fa6-b516-fbeb70393abe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80a8b8c000fa49e2be57b1a0e5e7cc45', 'request_id': 'req-452a8eb9-78a5-4fa6-b516-fbeb70393abe'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:07.895398 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-452a8eb9-78a5-4fa6-b516-fbeb70393abe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80a8b8c000fa49e2be57b1a0e5e7cc45', 'request_id': 'req-452a8eb9-78a5-4fa6-b516-fbeb70393abe'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:07.914557 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-452a8eb9-78a5-4fa6-b516-fbeb70393abe admin admin] The token cache is being invalidate because project 80a8b8c000fa49e2be57b1a0e5e7cc45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:00:07.914924 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-452a8eb9-78a5-4fa6-b516-fbeb70393abe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:07.915699 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-452a8eb9-78a5-4fa6-b516-fbeb70393abe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:07.917614 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1108/2212] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:00:07 2022] DELETE /identity/v3/projects/80a8b8c000fa49e2be57b1a0e5e7cc45 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:07.921441 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042347d-77f3-4024-b05e-27b12aa2efc0 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:07.921778 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042347d-77f3-4024-b05e-27b12aa2efc0 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:07.922061 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042347d-77f3-4024-b05e-27b12aa2efc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:07.924417 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f9cff-36d5-44f4-808b-20431a4e62e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:07.925147 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f9cff-36d5-44f4-808b-20431a4e62e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:07.925500 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f9cff-36d5-44f4-808b-20431a4e62e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:07.925954 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f9cff-36d5-44f4-808b-20431a4e62e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:07.927962 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-5b6f9cff-36d5-44f4-808b-20431a4e62e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:07.943097 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-6042347d-77f3-4024-b05e-27b12aa2efc0 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:07.944711 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-6042347d-77f3-4024-b05e-27b12aa2efc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:07.954670 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:07.987927 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:08.032085 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1109/2213] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:08.035180 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042347d-77f3-4024-b05e-27b12aa2efc0 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:08.035674 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-6042347d-77f3-4024-b05e-27b12aa2efc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:08.040087 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6f9cff-36d5-44f4-808b-20431a4e62e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:08.041752 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6f9cff-36d5-44f4-808b-20431a4e62e0 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:08.051838 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042347d-77f3-4024-b05e-27b12aa2efc0 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:08.057221 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1105/2214] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:00:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:00:08.058132 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f9cff-36d5-44f4-808b-20431a4e62e0 service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:08.058978 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4232f-9d44-4289-ab5e-116619b614e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:08.060165 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4232f-9d44-4289-ab5e-116619b614e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:08.060570 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4232f-9d44-4289-ab5e-116619b614e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:08.060891 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4232f-9d44-4289-ab5e-116619b614e7 admin admin] PATH_INFO: `/v3/users/872bb87752df4c22996d123ce0febf9d` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:08.062405 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4232f-9d44-4289-ab5e-116619b614e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=872bb87752df4c22996d123ce0febf9d)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:08.065426 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4232f-9d44-4289-ab5e-116619b614e7 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:08.069218 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f9cff-36d5-44f4-808b-20431a4e62e0 service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:08.078014 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2408e16-0e2b-409b-ba44-f05aa86edec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:08.081601 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2408e16-0e2b-409b-ba44-f05aa86edec7 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:08.081891 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2408e16-0e2b-409b-ba44-f05aa86edec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:08.082173 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2408e16-0e2b-409b-ba44-f05aa86edec7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:08.082922 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2408e16-0e2b-409b-ba44-f05aa86edec7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:00:08.083234 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2408e16-0e2b-409b-ba44-f05aa86edec7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:08.084972 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2408e16-0e2b-409b-ba44-f05aa86edec7 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:08.123865 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1106/2215] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 12:00:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:00:08.125733 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2408e16-0e2b-409b-ba44-f05aa86edec7 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:08.144391 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2408e16-0e2b-409b-ba44-f05aa86edec7 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:08.152954 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b6bdc-3bb1-489e-a396-e409d6b917b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:08.153761 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b6bdc-3bb1-489e-a396-e409d6b917b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:08.154048 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b6bdc-3bb1-489e-a396-e409d6b917b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:08.154527 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b6bdc-3bb1-489e-a396-e409d6b917b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:08.155006 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b6bdc-3bb1-489e-a396-e409d6b917b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:08.156977 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b6bdc-3bb1-489e-a396-e409d6b917b3 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:08.163238 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-01d4232f-9d44-4289-ab5e-116619b614e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '872bb87752df4c22996d123ce0febf9d'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:08.164159 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-01d4232f-9d44-4289-ab5e-116619b614e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '872bb87752df4c22996d123ce0febf9d'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:08.179136 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-01d4232f-9d44-4289-ab5e-116619b614e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '872bb87752df4c22996d123ce0febf9d'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:08.186633 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-01d4232f-9d44-4289-ab5e-116619b614e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '872bb87752df4c22996d123ce0febf9d'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:08.187541 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1107/2216] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 12:00:08 2022] POST /identity/v3/projects => generated 371 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:00:08.191536 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b6bdc-3bb1-489e-a396-e409d6b917b3 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:08.193603 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-456b6bdc-3bb1-489e-a396-e409d6b917b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:08.204731 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-01d4232f-9d44-4289-ab5e-116619b614e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '872bb87752df4c22996d123ce0febf9d'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:08.213794 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1110/2217] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:00:08 2022] DELETE /identity/v3/users/872bb87752df4c22996d123ce0febf9d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:08.286716 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b6bdc-3bb1-489e-a396-e409d6b917b3 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:08.383795 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81460ac1-14dd-48c7-ad98-0d57f12a5465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:08.384528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81460ac1-14dd-48c7-ad98-0d57f12a5465 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:08.385106 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81460ac1-14dd-48c7-ad98-0d57f12a5465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:08.385309 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81460ac1-14dd-48c7-ad98-0d57f12a5465 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:08.386110 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81460ac1-14dd-48c7-ad98-0d57f12a5465 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:08.388340 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81460ac1-14dd-48c7-ad98-0d57f12a5465 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:08.417223 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1108/2218] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 12:00:08 2022] POST /identity/v3/users => generated 286 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 12:00:08.421364 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4232f-9d44-4289-ab5e-116619b614e7 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:08.433914 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4232f-9d44-4289-ab5e-116619b614e7 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:08.440083 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddefde0-6ded-4f7f-9ecc-555f3b7c93e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:08.440945 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddefde0-6ded-4f7f-9ecc-555f3b7c93e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:08.441304 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddefde0-6ded-4f7f-9ecc-555f3b7c93e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:08.441662 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddefde0-6ded-4f7f-9ecc-555f3b7c93e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:08.442505 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddefde0-6ded-4f7f-9ecc-555f3b7c93e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:08.447809 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddefde0-6ded-4f7f-9ecc-555f3b7c93e9 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:08.461205 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1111/2219] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:00:08.465559 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81460ac1-14dd-48c7-ad98-0d57f12a5465 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:08.481215 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81460ac1-14dd-48c7-ad98-0d57f12a5465 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:08.487661 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fea6cb-7ae2-41dd-a0a2-dbc2e0b39bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:08.488339 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fea6cb-7ae2-41dd-a0a2-dbc2e0b39bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:08.489011 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fea6cb-7ae2-41dd-a0a2-dbc2e0b39bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:08.489294 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fea6cb-7ae2-41dd-a0a2-dbc2e0b39bb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:08.490034 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fea6cb-7ae2-41dd-a0a2-dbc2e0b39bb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:08.492238 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fea6cb-7ae2-41dd-a0a2-dbc2e0b39bb8 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:08.514773 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1109/2220] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 12:00:08.515798 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddefde0-6ded-4f7f-9ecc-555f3b7c93e9 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:08.527782 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddefde0-6ded-4f7f-9ecc-555f3b7c93e9 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:08.536477 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55dade5-9790-405e-ba04-551637a1f857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:08.537450 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55dade5-9790-405e-ba04-551637a1f857 admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:08.537735 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55dade5-9790-405e-ba04-551637a1f857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:08.538008 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55dade5-9790-405e-ba04-551637a1f857 admin admin] PATH_INFO: `/v3/projects/a7c800014a3349c5aeac57178984e4c8/users/7d2bcfc5842e4faaa5369a19fce82d26/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:08.571711 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55dade5-9790-405e-ba04-551637a1f857 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7c800014a3349c5aeac57178984e4c8, user_id=7d2bcfc5842e4faaa5369a19fce82d26, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:08.572986 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fea6cb-7ae2-41dd-a0a2-dbc2e0b39bb8 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:08.574001 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55dade5-9790-405e-ba04-551637a1f857 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:08.575767 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-62fea6cb-7ae2-41dd-a0a2-dbc2e0b39bb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:08.593906 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fea6cb-7ae2-41dd-a0a2-dbc2e0b39bb8 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:08.600229 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1112/2221] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:00:08 2022] PUT /identity/v3/projects/a7c800014a3349c5aeac57178984e4c8/users/7d2bcfc5842e4faaa5369a19fce82d26/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:08.605756 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6bc886-1409-4eef-b632-e44ff247940a None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:08.606169 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6bc886-1409-4eef-b632-e44ff247940a None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:08.606546 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6bc886-1409-4eef-b632-e44ff247940a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:08.623676 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:08.636027 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-7f6bc886-1409-4eef-b632-e44ff247940a None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:08.637295 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-7f6bc886-1409-4eef-b632-e44ff247940a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:08.686631 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f7ef7-8a82-4ed8-8c42-a084d0f9bf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:08.687773 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f7ef7-8a82-4ed8-8c42-a084d0f9bf30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:08.688059 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f7ef7-8a82-4ed8-8c42-a084d0f9bf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:08.688337 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f7ef7-8a82-4ed8-8c42-a084d0f9bf30 admin admin] PATH_INFO: `/v3/projects/a394617910734c32a751c17495e11137` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:08.689542 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681f7ef7-8a82-4ed8-8c42-a084d0f9bf30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a394617910734c32a751c17495e11137)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:08.691440 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681f7ef7-8a82-4ed8-8c42-a084d0f9bf30 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:08.708889 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:08.741524 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1113/2222] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 12:00:08.752388 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6bc886-1409-4eef-b632-e44ff247940a None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:08.754324 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-7f6bc886-1409-4eef-b632-e44ff247940a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:08.762759 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-681f7ef7-8a82-4ed8-8c42-a084d0f9bf30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a394617910734c32a751c17495e11137', 'request_id': 'req-681f7ef7-8a82-4ed8-8c42-a084d0f9bf30'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:08.770778 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-681f7ef7-8a82-4ed8-8c42-a084d0f9bf30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a394617910734c32a751c17495e11137', 'request_id': 'req-681f7ef7-8a82-4ed8-8c42-a084d0f9bf30'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:08.786990 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-681f7ef7-8a82-4ed8-8c42-a084d0f9bf30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a394617910734c32a751c17495e11137', 'request_id': 'req-681f7ef7-8a82-4ed8-8c42-a084d0f9bf30'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:08.803600 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-681f7ef7-8a82-4ed8-8c42-a084d0f9bf30 admin admin] The token cache is being invalidate because project a394617910734c32a751c17495e11137 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:00:08.803927 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-681f7ef7-8a82-4ed8-8c42-a084d0f9bf30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:08.804599 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-681f7ef7-8a82-4ed8-8c42-a084d0f9bf30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:08.806488 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1110/2223] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:00:08 2022] DELETE /identity/v3/projects/a394617910734c32a751c17495e11137 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:08.811927 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee419f-d9b9-4243-93ab-b22e3a0fbc39 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:08.812218 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee419f-d9b9-4243-93ab-b22e3a0fbc39 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:08.812496 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee419f-d9b9-4243-93ab-b22e3a0fbc39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:08.833513 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-85ee419f-d9b9-4243-93ab-b22e3a0fbc39 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:08.834712 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-85ee419f-d9b9-4243-93ab-b22e3a0fbc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:08.836890 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6bc886-1409-4eef-b632-e44ff247940a None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:08.919770 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1111/2224] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:08.926190 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633965b-1b23-4f15-ad4a-e3bf953bc534 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:08.926877 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633965b-1b23-4f15-ad4a-e3bf953bc534 service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:08.927162 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633965b-1b23-4f15-ad4a-e3bf953bc534 service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:08.927439 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633965b-1b23-4f15-ad4a-e3bf953bc534 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:08.929307 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c1ee8-077f-4441-88ea-4ac2700603f7 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:08.929456 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-2633965b-1b23-4f15-ad4a-e3bf953bc534 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:08.929596 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c1ee8-077f-4441-88ea-4ac2700603f7 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:08.929871 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c1ee8-077f-4441-88ea-4ac2700603f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:08.951471 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-590c1ee8-077f-4441-88ea-4ac2700603f7 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:08.952766 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-590c1ee8-077f-4441-88ea-4ac2700603f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:08.957523 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2633965b-1b23-4f15-ad4a-e3bf953bc534 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:08.959803 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2633965b-1b23-4f15-ad4a-e3bf953bc534 service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:08.969051 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1112/2225] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:08.970530 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c1ee8-077f-4441-88ea-4ac2700603f7 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:08.977904 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1114/2226] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:00:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 12:00:08.981090 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c1ee8-077f-4441-88ea-4ac2700603f7 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:08.986022 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9857b-5030-4f40-b0c5-805ae7556a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:08.986796 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9857b-5030-4f40-b0c5-805ae7556a5b admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:08.987133 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9857b-5030-4f40-b0c5-805ae7556a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:08.987490 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9857b-5030-4f40-b0c5-805ae7556a5b admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:08.988332 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a9857b-5030-4f40-b0c5-805ae7556a5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:00:08.988715 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a9857b-5030-4f40-b0c5-805ae7556a5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:08.991114 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a9857b-5030-4f40-b0c5-805ae7556a5b admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:09.004661 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1113/2227] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 12:00:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:00:09.009973 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633965b-1b23-4f15-ad4a-e3bf953bc534 service neutron] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:09.022485 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633965b-1b23-4f15-ad4a-e3bf953bc534 service neutron] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:09.039027 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f138d-6d34-48eb-81a5-c19dc624cf97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:09.039754 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f138d-6d34-48eb-81a5-c19dc624cf97 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:09.040500 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f138d-6d34-48eb-81a5-c19dc624cf97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:09.040794 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f138d-6d34-48eb-81a5-c19dc624cf97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:09.041503 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f138d-6d34-48eb-81a5-c19dc624cf97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:09.043446 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f138d-6d34-48eb-81a5-c19dc624cf97 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:09.110759 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1115/2228] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 12:00:09 2022] POST /identity/v3/projects => generated 401 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:00:09.116504 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9857b-5030-4f40-b0c5-805ae7556a5b admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:09.144499 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9857b-5030-4f40-b0c5-805ae7556a5b admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:09.149150 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b7a44-40e4-496e-8f66-c7f9f954466c None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:09.149401 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b7a44-40e4-496e-8f66-c7f9f954466c None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:09.149666 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b7a44-40e4-496e-8f66-c7f9f954466c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:09.190754 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-456b7a44-40e4-496e-8f66-c7f9f954466c None None] MFA Rules not processed for user `b7ca439b8c284bff9872e5774bed6ce0`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:09.191886 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-456b7a44-40e4-496e-8f66-c7f9f954466c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:09.252809 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:09.288797 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1116/2229] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:09 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 12:00:09.294698 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b7a44-40e4-496e-8f66-c7f9f954466c None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:09.299072 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-456b7a44-40e4-496e-8f66-c7f9f954466c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:09.313879 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d04f3-3d51-45a2-bf7c-59910f3cc032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:09.314589 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d04f3-3d51-45a2-bf7c-59910f3cc032 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:09.314871 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d04f3-3d51-45a2-bf7c-59910f3cc032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:09.315145 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d04f3-3d51-45a2-bf7c-59910f3cc032 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:09.315862 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d04f3-3d51-45a2-bf7c-59910f3cc032 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:09.317971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d04f3-3d51-45a2-bf7c-59910f3cc032 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:09.351893 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b7a44-40e4-496e-8f66-c7f9f954466c None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:09.359528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1114/2230] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 12:00:09 2022] POST /identity/v3/users => generated 301 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:00:09.367833 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d04f3-3d51-45a2-bf7c-59910f3cc032 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:09.370054 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75b0fa-eb93-4ea8-93d3-3a6c2407d758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:09.371362 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75b0fa-eb93-4ea8-93d3-3a6c2407d758 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:09.371362 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75b0fa-eb93-4ea8-93d3-3a6c2407d758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:09.371362 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75b0fa-eb93-4ea8-93d3-3a6c2407d758 admin admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:09.372123 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a75b0fa-eb93-4ea8-93d3-3a6c2407d758 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:09.374462 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a75b0fa-eb93-4ea8-93d3-3a6c2407d758 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:09.384459 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d04f3-3d51-45a2-bf7c-59910f3cc032 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:09.387013 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:09.393166 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d2b56-c97b-4a9d-bca6-68be712faccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:09.395333 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d2b56-c97b-4a9d-bca6-68be712faccc admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:09.395864 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d2b56-c97b-4a9d-bca6-68be712faccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:09.396539 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d2b56-c97b-4a9d-bca6-68be712faccc admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:09.398459 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d2b56-c97b-4a9d-bca6-68be712faccc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:09.400808 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d2b56-c97b-4a9d-bca6-68be712faccc admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:09.412313 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1117/2231] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 12:00:09 2022] POST /identity/v3/projects => generated 405 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:00:09.418481 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1115/2232] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 12:00:09.429385 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75b0fa-eb93-4ea8-93d3-3a6c2407d758 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:09.430331 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d2b56-c97b-4a9d-bca6-68be712faccc admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:09.443872 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d2b56-c97b-4a9d-bca6-68be712faccc admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:09.532981 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75b0fa-eb93-4ea8-93d3-3a6c2407d758 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:09.539383 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d2340-7e37-4acc-888a-73e85f2f48ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:09.540275 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d2340-7e37-4acc-888a-73e85f2f48ca admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:09.540648 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d2340-7e37-4acc-888a-73e85f2f48ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:09.540967 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d2340-7e37-4acc-888a-73e85f2f48ca admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:09.541741 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d2340-7e37-4acc-888a-73e85f2f48ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:09.542467 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601cfd35-7779-4920-8389-1c726dea4b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:09.544326 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cfd35-7779-4920-8389-1c726dea4b49 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:09.544536 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cfd35-7779-4920-8389-1c726dea4b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:09.545653 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d2340-7e37-4acc-888a-73e85f2f48ca admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:09.546708 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601cfd35-7779-4920-8389-1c726dea4b49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:09.549779 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601cfd35-7779-4920-8389-1c726dea4b49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:09.554845 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601cfd35-7779-4920-8389-1c726dea4b49 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:09.586356 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1118/2233] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 12:00:09 2022] POST /identity/v3/users => generated 309 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:00:09.588026 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d2340-7e37-4acc-888a-73e85f2f48ca admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:09.590706 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1116/2234] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:00:09.595399 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601cfd35-7779-4920-8389-1c726dea4b49 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:09.605457 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d2340-7e37-4acc-888a-73e85f2f48ca admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:09.608241 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601cfd35-7779-4920-8389-1c726dea4b49 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:09.610794 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11e1f9-0348-47fb-b910-982d3ad8ac1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:09.611555 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11e1f9-0348-47fb-b910-982d3ad8ac1b admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:09.615731 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3467ddc-9beb-47ac-a959-e550e9597a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:09.617760 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3467ddc-9beb-47ac-a959-e550e9597a8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:09.617760 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3467ddc-9beb-47ac-a959-e550e9597a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:09.618109 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3467ddc-9beb-47ac-a959-e550e9597a8f admin admin] PATH_INFO: `/v3/projects/26d9c9f05acf47988f1a6e12fce8e168/users/f357c3c4a115462ba62a9de130601f23/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:09.619539 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11e1f9-0348-47fb-b910-982d3ad8ac1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:09.619925 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11e1f9-0348-47fb-b910-982d3ad8ac1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:09.620722 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb11e1f9-0348-47fb-b910-982d3ad8ac1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:09.623017 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb11e1f9-0348-47fb-b910-982d3ad8ac1b admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:09.636094 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1119/2235] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 12:00:09.639746 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11e1f9-0348-47fb-b910-982d3ad8ac1b admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:09.648858 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3467ddc-9beb-47ac-a959-e550e9597a8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=26d9c9f05acf47988f1a6e12fce8e168, user_id=f357c3c4a115462ba62a9de130601f23, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:09.655535 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3467ddc-9beb-47ac-a959-e550e9597a8f admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:09.666301 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11e1f9-0348-47fb-b910-982d3ad8ac1b admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:09.675084 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1117/2236] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:00:09 2022] PUT /identity/v3/projects/26d9c9f05acf47988f1a6e12fce8e168/users/f357c3c4a115462ba62a9de130601f23/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:09.687875 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2316895-dbf2-41cc-b5cd-a13ed739e318 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:09.688169 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2316895-dbf2-41cc-b5cd-a13ed739e318 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:09.688455 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2316895-dbf2-41cc-b5cd-a13ed739e318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:09.731051 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-c2316895-dbf2-41cc-b5cd-a13ed739e318 None None] MFA Rules not processed for user `f357c3c4a115462ba62a9de130601f23`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:09.732992 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-c2316895-dbf2-41cc-b5cd-a13ed739e318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:09.755670 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae07e42f-f040-4dfa-a972-2dbf56293acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:09.764387 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07e42f-f040-4dfa-a972-2dbf56293acd admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:09.765504 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07e42f-f040-4dfa-a972-2dbf56293acd admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:09.766083 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07e42f-f040-4dfa-a972-2dbf56293acd admin admin] PATH_INFO: `/v3/projects/454b737657f74089b38cb8e190004d8e/users/6e369fd7f5764f6ea47fcba2e0fcf34c/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:09.802959 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae07e42f-f040-4dfa-a972-2dbf56293acd admin admin] RBAC: Authorizing `identity:create_grant(project_id=454b737657f74089b38cb8e190004d8e, user_id=6e369fd7f5764f6ea47fcba2e0fcf34c, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:09.806564 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae07e42f-f040-4dfa-a972-2dbf56293acd admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:09.824156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1120/2237] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:00:09 2022] PUT /identity/v3/projects/454b737657f74089b38cb8e190004d8e/users/6e369fd7f5764f6ea47fcba2e0fcf34c/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 12:00:09.828023 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae07e42f-f040-4dfa-a972-2dbf56293acd admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:09.838208 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1118/2238] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:09 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:09.840344 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2316895-dbf2-41cc-b5cd-a13ed739e318 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:09.863352 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2316895-dbf2-41cc-b5cd-a13ed739e318 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:09.892543 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:09.894741 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:09.918006 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae07e42f-f040-4dfa-a972-2dbf56293acd admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:09.925484 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd54ad91-3014-4a2f-bd75-6432db6dfd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:09.926345 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54ad91-3014-4a2f-bd75-6432db6dfd34 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:09.926470 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54ad91-3014-4a2f-bd75-6432db6dfd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:09.926719 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54ad91-3014-4a2f-bd75-6432db6dfd34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:09.927963 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd54ad91-3014-4a2f-bd75-6432db6dfd34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:09.930452 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd54ad91-3014-4a2f-bd75-6432db6dfd34 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:09.947032 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1121/2239] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:00:09.951289 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd54ad91-3014-4a2f-bd75-6432db6dfd34 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:09.965748 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd54ad91-3014-4a2f-bd75-6432db6dfd34 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:09.969905 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873bdba-f609-484f-abb7-6862469d631e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:09.970913 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873bdba-f609-484f-abb7-6862469d631e admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:09.971535 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873bdba-f609-484f-abb7-6862469d631e admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:09.971922 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5278295b-f02c-4d07-82eb-787457dd05a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:09.972088 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873bdba-f609-484f-abb7-6862469d631e admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:09.972447 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278295b-f02c-4d07-82eb-787457dd05a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:09.972782 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7873bdba-f609-484f-abb7-6862469d631e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:09.972901 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278295b-f02c-4d07-82eb-787457dd05a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:09.973059 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278295b-f02c-4d07-82eb-787457dd05a1 admin admin] PATH_INFO: `/v3/projects/454b737657f74089b38cb8e190004d8e/users/6e369fd7f5764f6ea47fcba2e0fcf34c/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:09.974749 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7873bdba-f609-484f-abb7-6862469d631e admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:09.976394 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5278295b-f02c-4d07-82eb-787457dd05a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=454b737657f74089b38cb8e190004d8e, user_id=6e369fd7f5764f6ea47fcba2e0fcf34c, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:09.980011 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5278295b-f02c-4d07-82eb-787457dd05a1 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:09.993634 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1122/2240] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:00:09 2022] PUT /identity/v3/projects/454b737657f74089b38cb8e190004d8e/users/6e369fd7f5764f6ea47fcba2e0fcf34c/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:10.006567 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1119/2241] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 12:00:09 2022] POST /identity/v3/projects => generated 399 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:00:10.011198 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5278295b-f02c-4d07-82eb-787457dd05a1 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:10.109002 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5278295b-f02c-4d07-82eb-787457dd05a1 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:10.205150 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4184d9d-99dd-47fa-b789-df6b3da85481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:10.206025 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4184d9d-99dd-47fa-b789-df6b3da85481 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:10.206279 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4184d9d-99dd-47fa-b789-df6b3da85481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:10.206571 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4184d9d-99dd-47fa-b789-df6b3da85481 admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:10.207294 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4184d9d-99dd-47fa-b789-df6b3da85481 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:10.224105 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4184d9d-99dd-47fa-b789-df6b3da85481 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:10.271379 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1123/2242] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 12:00:10 2022] POST /identity/v3/users => generated 306 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:00:10.276995 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873bdba-f609-484f-abb7-6862469d631e admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:10.291986 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873bdba-f609-484f-abb7-6862469d631e admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:10.308942 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97799749-d4a5-4a3d-96d4-9c07a7d41f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:10.310024 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97799749-d4a5-4a3d-96d4-9c07a7d41f57 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:10.310466 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97799749-d4a5-4a3d-96d4-9c07a7d41f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:10.311203 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97799749-d4a5-4a3d-96d4-9c07a7d41f57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:10.312197 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97799749-d4a5-4a3d-96d4-9c07a7d41f57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:10.317668 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97799749-d4a5-4a3d-96d4-9c07a7d41f57 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:10.364397 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1120/2243] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:00:10.364719 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4184d9d-99dd-47fa-b789-df6b3da85481 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:10.379015 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4184d9d-99dd-47fa-b789-df6b3da85481 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:10.412749 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d7998-ac95-4a13-8de7-c47925711c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:10.414228 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d7998-ac95-4a13-8de7-c47925711c7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:10.414228 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d7998-ac95-4a13-8de7-c47925711c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:10.415132 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d7998-ac95-4a13-8de7-c47925711c7b admin admin] PATH_INFO: `/v3/projects/40381afca6ce4e99abb56b494bd0110a/users/b6f6a7e14c8a436198b8718c36efd575/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:10.456533 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d7998-ac95-4a13-8de7-c47925711c7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=40381afca6ce4e99abb56b494bd0110a, user_id=b6f6a7e14c8a436198b8718c36efd575, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:10.461635 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d7998-ac95-4a13-8de7-c47925711c7b admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:10.513482 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97799749-d4a5-4a3d-96d4-9c07a7d41f57 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:10.515740 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1124/2244] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:00:10 2022] PUT /identity/v3/projects/40381afca6ce4e99abb56b494bd0110a/users/b6f6a7e14c8a436198b8718c36efd575/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 12:00:10.533617 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97799749-d4a5-4a3d-96d4-9c07a7d41f57 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:10.678962 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1312226-fc9e-4310-ba19-e46a8af2321b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:10.679702 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1312226-fc9e-4310-ba19-e46a8af2321b admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:10.681412 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1312226-fc9e-4310-ba19-e46a8af2321b admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:10.681830 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1312226-fc9e-4310-ba19-e46a8af2321b admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:10.683729 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1312226-fc9e-4310-ba19-e46a8af2321b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:10.688536 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1312226-fc9e-4310-ba19-e46a8af2321b admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:10.719730 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d7998-ac95-4a13-8de7-c47925711c7b admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:10.730903 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d7998-ac95-4a13-8de7-c47925711c7b admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:10.731555 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1121/2245] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:00:10.738017 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f22ae7-6b83-4539-83ea-d68c8a0bd166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:10.738248 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f22ae7-6b83-4539-83ea-d68c8a0bd166 admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:10.738616 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f22ae7-6b83-4539-83ea-d68c8a0bd166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:10.739350 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f22ae7-6b83-4539-83ea-d68c8a0bd166 admin admin] PATH_INFO: `/v3/projects/40381afca6ce4e99abb56b494bd0110a/users/b6f6a7e14c8a436198b8718c36efd575/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:10.742033 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f22ae7-6b83-4539-83ea-d68c8a0bd166 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40381afca6ce4e99abb56b494bd0110a, user_id=b6f6a7e14c8a436198b8718c36efd575, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:10.744859 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f22ae7-6b83-4539-83ea-d68c8a0bd166 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:10.770218 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae876ec4-3490-45a7-bdfc-d38361b736b7 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:10.770218 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae876ec4-3490-45a7-bdfc-d38361b736b7 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:10.770218 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae876ec4-3490-45a7-bdfc-d38361b736b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:10.771789 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1125/2246] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:00:10 2022] PUT /identity/v3/projects/40381afca6ce4e99abb56b494bd0110a/users/b6f6a7e14c8a436198b8718c36efd575/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:10.801732 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-ae876ec4-3490-45a7-bdfc-d38361b736b7 None None] MFA Rules not processed for user `b6f6a7e14c8a436198b8718c36efd575`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:10.803111 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-ae876ec4-3490-45a7-bdfc-d38361b736b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:10.911185 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1122/2247] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:10 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:10.927188 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f22ae7-6b83-4539-83ea-d68c8a0bd166 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:10.931027 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-05f22ae7-6b83-4539-83ea-d68c8a0bd166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:10.994338 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:11.034301 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f22ae7-6b83-4539-83ea-d68c8a0bd166 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:11.038329 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc4b004-d0ea-4d68-b312-825c6debf125 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:11.039609 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4b004-d0ea-4d68-b312-825c6debf125 service cinder] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:11.039912 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4b004-d0ea-4d68-b312-825c6debf125 service cinder] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:11.040190 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4b004-d0ea-4d68-b312-825c6debf125 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:11.052732 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc4b004-d0ea-4d68-b312-825c6debf125 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:11.055587 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc4b004-d0ea-4d68-b312-825c6debf125 service cinder] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:11.074069 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1126/2248] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:00:10 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:00:11.160121 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c59b1f-2576-4389-8bab-059cd2073312 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:11.160470 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c59b1f-2576-4389-8bab-059cd2073312 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:11.160768 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c59b1f-2576-4389-8bab-059cd2073312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:11.193504 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:11.208241 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-b5c59b1f-2576-4389-8bab-059cd2073312 None None] MFA Rules not processed for user `6e369fd7f5764f6ea47fcba2e0fcf34c`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:11.211080 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc4b004-d0ea-4d68-b312-825c6debf125 service cinder] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:11.211412 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-b5c59b1f-2576-4389-8bab-059cd2073312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:11.221422 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc4b004-d0ea-4d68-b312-825c6debf125 service cinder] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:11.226288 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a93ac-0c35-4691-9b5a-fcc1c7b95e47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:11.226922 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a93ac-0c35-4691-9b5a-fcc1c7b95e47 service cinder] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:11.227203 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a93ac-0c35-4691-9b5a-fcc1c7b95e47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:11.227476 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a93ac-0c35-4691-9b5a-fcc1c7b95e47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:11.290518 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03a93ac-0c35-4691-9b5a-fcc1c7b95e47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:11.292140 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03a93ac-0c35-4691-9b5a-fcc1c7b95e47 service cinder] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:11.296734 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1123/2249] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:11 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:11.303237 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1127/2250] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:00:11 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 12:00:12.036861 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35947b6-1865-4996-9c5c-8de0fc334ba2 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:12.037361 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35947b6-1865-4996-9c5c-8de0fc334ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:12.037495 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35947b6-1865-4996-9c5c-8de0fc334ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:12.057595 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-e35947b6-1865-4996-9c5c-8de0fc334ba2 None None] MFA Rules not processed for user `c82999dd117a4335ae779cd92d45db4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:12.058842 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-e35947b6-1865-4996-9c5c-8de0fc334ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:12.171616 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1124/2251] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:12 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:13.428389 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c3a3c-0884-4422-8af7-ef320caf9117 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:13.430075 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c3a3c-0884-4422-8af7-ef320caf9117 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:13.430802 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c3a3c-0884-4422-8af7-ef320caf9117 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:13.432971 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1128/2252] 10.222.0.15 () {54 vars in 921 bytes} [Fri Jun 3 12:00:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:00:13.471196 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee19bc5-9995-4b91-a537-01d9e2bde0dc None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:13.472180 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee19bc5-9995-4b91-a537-01d9e2bde0dc None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:13.472465 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee19bc5-9995-4b91-a537-01d9e2bde0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:13.496544 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-9ee19bc5-9995-4b91-a537-01d9e2bde0dc None None] MFA Rules not processed for user `eb5a91437dd64e2491ce41b4d12d4835`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:13.497784 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-9ee19bc5-9995-4b91-a537-01d9e2bde0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:13.563621 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c3a3c-0884-4422-8af7-ef320caf9117 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:13.727741 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1125/2253] 10.222.0.15 () {58 vars in 1018 bytes} [Fri Jun 3 12:00:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:13.729847 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c3a3c-0884-4422-8af7-ef320caf9117 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:13.738164 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80131ac-c4f5-4ef3-986e-91ba7b7fdf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:13.740743 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80131ac-c4f5-4ef3-986e-91ba7b7fdf31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:13.741024 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80131ac-c4f5-4ef3-986e-91ba7b7fdf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:13.741847 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80131ac-c4f5-4ef3-986e-91ba7b7fdf31 admin admin] PATH_INFO: `/v3/users/b7ca439b8c284bff9872e5774bed6ce0` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:13.743270 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80131ac-c4f5-4ef3-986e-91ba7b7fdf31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7ca439b8c284bff9872e5774bed6ce0)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:13.745344 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee19bc5-9995-4b91-a537-01d9e2bde0dc None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:13.745483 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80131ac-c4f5-4ef3-986e-91ba7b7fdf31 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:13.747112 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-9ee19bc5-9995-4b91-a537-01d9e2bde0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:13.791595 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee19bc5-9995-4b91-a537-01d9e2bde0dc None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:13.801639 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3530b0f8-6a6e-44a7-8c0a-65acaff85145 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5a91437dd64e2491ce41b4d12d4835', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:13.801998 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3530b0f8-6a6e-44a7-8c0a-65acaff85145 service placement] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:13.802293 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3530b0f8-6a6e-44a7-8c0a-65acaff85145 service placement] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:13.802574 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3530b0f8-6a6e-44a7-8c0a-65acaff85145 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:13.825692 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3530b0f8-6a6e-44a7-8c0a-65acaff85145 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:13.829239 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3530b0f8-6a6e-44a7-8c0a-65acaff85145 service placement] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:13.840812 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-b80131ac-c4f5-4ef3-986e-91ba7b7fdf31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7ca439b8c284bff9872e5774bed6ce0'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:13.840812 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-b80131ac-c4f5-4ef3-986e-91ba7b7fdf31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7ca439b8c284bff9872e5774bed6ce0'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:13.850726 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-b80131ac-c4f5-4ef3-986e-91ba7b7fdf31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7ca439b8c284bff9872e5774bed6ce0'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:13.856609 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1126/2254] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:00:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 12:00:13.869499 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-b80131ac-c4f5-4ef3-986e-91ba7b7fdf31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7ca439b8c284bff9872e5774bed6ce0'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:13.874076 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:13.886645 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-b80131ac-c4f5-4ef3-986e-91ba7b7fdf31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7ca439b8c284bff9872e5774bed6ce0'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:13.905556 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1129/2255] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:00:13 2022] DELETE /identity/v3/users/b7ca439b8c284bff9872e5774bed6ce0 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 12:00:14.311326 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3530b0f8-6a6e-44a7-8c0a-65acaff85145 service placement] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:14.334642 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3530b0f8-6a6e-44a7-8c0a-65acaff85145 service placement] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:14.382438 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:14.438470 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71e579-8aec-4dc4-b600-d0422c496ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:14.439706 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71e579-8aec-4dc4-b600-d0422c496ed1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:14.440192 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71e579-8aec-4dc4-b600-d0422c496ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:14.440629 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71e579-8aec-4dc4-b600-d0422c496ed1 admin admin] PATH_INFO: `/v3/projects/d497828bf0394aa4a100a01b0a0d061a` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:14.443737 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71e579-8aec-4dc4-b600-d0422c496ed1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d497828bf0394aa4a100a01b0a0d061a)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:14.448567 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71e579-8aec-4dc4-b600-d0422c496ed1 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:14.570507 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-ce71e579-8aec-4dc4-b600-d0422c496ed1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd497828bf0394aa4a100a01b0a0d061a', 'request_id': 'req-ce71e579-8aec-4dc4-b600-d0422c496ed1'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:14.582167 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-ce71e579-8aec-4dc4-b600-d0422c496ed1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd497828bf0394aa4a100a01b0a0d061a', 'request_id': 'req-ce71e579-8aec-4dc4-b600-d0422c496ed1'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:14.602160 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-ce71e579-8aec-4dc4-b600-d0422c496ed1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd497828bf0394aa4a100a01b0a0d061a', 'request_id': 'req-ce71e579-8aec-4dc4-b600-d0422c496ed1'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:14.634546 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-ce71e579-8aec-4dc4-b600-d0422c496ed1 admin admin] The token cache is being invalidate because project d497828bf0394aa4a100a01b0a0d061a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:00:14.634896 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-ce71e579-8aec-4dc4-b600-d0422c496ed1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:14.635759 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-ce71e579-8aec-4dc4-b600-d0422c496ed1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:14.639404 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1127/2256] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:00:14 2022] DELETE /identity/v3/projects/d497828bf0394aa4a100a01b0a0d061a => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:14.643393 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80131ac-c4f5-4ef3-986e-91ba7b7fdf31 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:14.645240 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-b80131ac-c4f5-4ef3-986e-91ba7b7fdf31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:14.689775 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80131ac-c4f5-4ef3-986e-91ba7b7fdf31 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:14.851763 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56638d-7385-4825-9ed0-c049dbe45da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:14.852944 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56638d-7385-4825-9ed0-c049dbe45da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:14.853913 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56638d-7385-4825-9ed0-c049dbe45da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:14.853913 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56638d-7385-4825-9ed0-c049dbe45da5 admin admin] PATH_INFO: `/v3/users/6e369fd7f5764f6ea47fcba2e0fcf34c` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:14.855773 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d56638d-7385-4825-9ed0-c049dbe45da5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e369fd7f5764f6ea47fcba2e0fcf34c)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:14.858246 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d56638d-7385-4825-9ed0-c049dbe45da5 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:14.952380 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-1d56638d-7385-4825-9ed0-c049dbe45da5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e369fd7f5764f6ea47fcba2e0fcf34c'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:14.953076 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-1d56638d-7385-4825-9ed0-c049dbe45da5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e369fd7f5764f6ea47fcba2e0fcf34c'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:14.970237 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-1d56638d-7385-4825-9ed0-c049dbe45da5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e369fd7f5764f6ea47fcba2e0fcf34c'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:14.981554 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-1d56638d-7385-4825-9ed0-c049dbe45da5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e369fd7f5764f6ea47fcba2e0fcf34c'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:15.000120 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-1d56638d-7385-4825-9ed0-c049dbe45da5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e369fd7f5764f6ea47fcba2e0fcf34c'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:15.016498 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1130/2257] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:00:14 2022] DELETE /identity/v3/users/6e369fd7f5764f6ea47fcba2e0fcf34c => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:15.355307 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71e579-8aec-4dc4-b600-d0422c496ed1 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:15.357787 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-ce71e579-8aec-4dc4-b600-d0422c496ed1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:15.387583 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71e579-8aec-4dc4-b600-d0422c496ed1 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:15.524285 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9060b0-c7cd-4e07-830d-07bd1a13da55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:15.525163 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9060b0-c7cd-4e07-830d-07bd1a13da55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:15.525444 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9060b0-c7cd-4e07-830d-07bd1a13da55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:15.525713 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9060b0-c7cd-4e07-830d-07bd1a13da55 admin admin] PATH_INFO: `/v3/projects/454b737657f74089b38cb8e190004d8e` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:15.528254 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9060b0-c7cd-4e07-830d-07bd1a13da55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=454b737657f74089b38cb8e190004d8e)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:15.530184 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9060b0-c7cd-4e07-830d-07bd1a13da55 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:15.640535 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56638d-7385-4825-9ed0-c049dbe45da5 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:15.642398 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-1d56638d-7385-4825-9ed0-c049dbe45da5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:15.653949 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-2c9060b0-c7cd-4e07-830d-07bd1a13da55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '454b737657f74089b38cb8e190004d8e', 'request_id': 'req-2c9060b0-c7cd-4e07-830d-07bd1a13da55'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:15.666053 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56638d-7385-4825-9ed0-c049dbe45da5 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:15.668864 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:15.670385 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-2c9060b0-c7cd-4e07-830d-07bd1a13da55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '454b737657f74089b38cb8e190004d8e', 'request_id': 'req-2c9060b0-c7cd-4e07-830d-07bd1a13da55'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:15.684303 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-2c9060b0-c7cd-4e07-830d-07bd1a13da55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '454b737657f74089b38cb8e190004d8e', 'request_id': 'req-2c9060b0-c7cd-4e07-830d-07bd1a13da55'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:15.706173 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-2c9060b0-c7cd-4e07-830d-07bd1a13da55 admin admin] The token cache is being invalidate because project 454b737657f74089b38cb8e190004d8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:00:15.706534 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-2c9060b0-c7cd-4e07-830d-07bd1a13da55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:15.708086 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-2c9060b0-c7cd-4e07-830d-07bd1a13da55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:15.714559 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1128/2258] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:00:15 2022] DELETE /identity/v3/projects/454b737657f74089b38cb8e190004d8e => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:15.716995 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae01410-89bf-4208-8008-26e5503ef6ef None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:15.717479 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae01410-89bf-4208-8008-26e5503ef6ef None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:15.717907 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae01410-89bf-4208-8008-26e5503ef6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:15.758720 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-6ae01410-89bf-4208-8008-26e5503ef6ef None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:15.761691 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-6ae01410-89bf-4208-8008-26e5503ef6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:15.889274 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591915c7-d36e-4d72-bcb8-03349975eca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:15.890284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591915c7-d36e-4d72-bcb8-03349975eca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:15.890816 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591915c7-d36e-4d72-bcb8-03349975eca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:15.891249 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591915c7-d36e-4d72-bcb8-03349975eca8 admin admin] PATH_INFO: `/v3/users/d34e7e7bb1694956854491e4ace3ee18` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:15.900607 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591915c7-d36e-4d72-bcb8-03349975eca8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d34e7e7bb1694956854491e4ace3ee18)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:15.902644 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591915c7-d36e-4d72-bcb8-03349975eca8 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:15.939228 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1129/2259] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:15.939397 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:15.948013 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38534180-3b72-4ee8-ae8c-99c5c467f98d None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:15.948422 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38534180-3b72-4ee8-ae8c-99c5c467f98d None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:15.956378 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38534180-3b72-4ee8-ae8c-99c5c467f98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:16.031820 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-38534180-3b72-4ee8-ae8c-99c5c467f98d None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:16.039631 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-591915c7-d36e-4d72-bcb8-03349975eca8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd34e7e7bb1694956854491e4ace3ee18'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:16.040321 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-591915c7-d36e-4d72-bcb8-03349975eca8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd34e7e7bb1694956854491e4ace3ee18'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:16.042672 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-38534180-3b72-4ee8-ae8c-99c5c467f98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:16.076453 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-591915c7-d36e-4d72-bcb8-03349975eca8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd34e7e7bb1694956854491e4ace3ee18'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:16.077296 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1130/2260] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:16.078167 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38534180-3b72-4ee8-ae8c-99c5c467f98d None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:16.083246 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-38534180-3b72-4ee8-ae8c-99c5c467f98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:16.102070 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-591915c7-d36e-4d72-bcb8-03349975eca8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd34e7e7bb1694956854491e4ace3ee18'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:16.114445 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38534180-3b72-4ee8-ae8c-99c5c467f98d None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:16.120653 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-591915c7-d36e-4d72-bcb8-03349975eca8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd34e7e7bb1694956854491e4ace3ee18'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:16.122556 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d2f32-2cd7-4ccd-adf1-8a45fef842be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:16.123515 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d2f32-2cd7-4ccd-adf1-8a45fef842be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:16.123826 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d2f32-2cd7-4ccd-adf1-8a45fef842be admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:16.124112 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d2f32-2cd7-4ccd-adf1-8a45fef842be admin admin] PATH_INFO: `/v3/users/f357c3c4a115462ba62a9de130601f23` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:16.125515 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60d2f32-2cd7-4ccd-adf1-8a45fef842be admin admin] RBAC: Authorizing `identity:delete_user(user_id=f357c3c4a115462ba62a9de130601f23)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:16.127552 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60d2f32-2cd7-4ccd-adf1-8a45fef842be admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:16.138208 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1131/2261] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:00:15 2022] DELETE /identity/v3/users/d34e7e7bb1694956854491e4ace3ee18 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 12:00:16.138923 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591915c7-d36e-4d72-bcb8-03349975eca8 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:16.214271 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-c60d2f32-2cd7-4ccd-adf1-8a45fef842be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f357c3c4a115462ba62a9de130601f23'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:16.228213 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-c60d2f32-2cd7-4ccd-adf1-8a45fef842be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f357c3c4a115462ba62a9de130601f23'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:16.228432 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-c60d2f32-2cd7-4ccd-adf1-8a45fef842be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f357c3c4a115462ba62a9de130601f23'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:16.258342 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-c60d2f32-2cd7-4ccd-adf1-8a45fef842be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f357c3c4a115462ba62a9de130601f23'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:16.273641 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-c60d2f32-2cd7-4ccd-adf1-8a45fef842be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f357c3c4a115462ba62a9de130601f23'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:16.285093 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1131/2262] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:00:16 2022] DELETE /identity/v3/users/f357c3c4a115462ba62a9de130601f23 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:16.286742 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46a01e-4cc1-48ba-bad6-db667d416574 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:16.287356 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46a01e-4cc1-48ba-bad6-db667d416574 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:16.287843 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46a01e-4cc1-48ba-bad6-db667d416574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:16.296599 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591915c7-d36e-4d72-bcb8-03349975eca8 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:16.311946 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-8e46a01e-4cc1-48ba-bad6-db667d416574 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:16.313543 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-8e46a01e-4cc1-48ba-bad6-db667d416574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:16.388040 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:16.416695 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1132/2263] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:16.420186 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb74d65-79b6-4c5e-9e9b-48b585025cf0 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:16.420644 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb74d65-79b6-4c5e-9e9b-48b585025cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:16.421132 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb74d65-79b6-4c5e-9e9b-48b585025cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:16.423146 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b51e0-af49-4634-a666-83f2d482983a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:16.423868 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b51e0-af49-4634-a666-83f2d482983a admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:16.424158 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b51e0-af49-4634-a666-83f2d482983a admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:16.424439 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b51e0-af49-4634-a666-83f2d482983a admin admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:16.425189 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b51e0-af49-4634-a666-83f2d482983a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:00:16.425498 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b51e0-af49-4634-a666-83f2d482983a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:16.427198 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b51e0-af49-4634-a666-83f2d482983a admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:16.451053 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-fbb74d65-79b6-4c5e-9e9b-48b585025cf0 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:16.453335 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-fbb74d65-79b6-4c5e-9e9b-48b585025cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:16.459132 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1132/2264] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 12:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:00:16.460676 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b51e0-af49-4634-a666-83f2d482983a admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:16.466784 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-710b51e0-af49-4634-a666-83f2d482983a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:16.471559 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1133/2265] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:16.472706 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb74d65-79b6-4c5e-9e9b-48b585025cf0 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:16.484159 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-fbb74d65-79b6-4c5e-9e9b-48b585025cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:16.503443 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb74d65-79b6-4c5e-9e9b-48b585025cf0 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:16.511992 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa87e6-e139-4c35-8fc9-5a898b675f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:16.513315 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa87e6-e139-4c35-8fc9-5a898b675f30 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:16.513315 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa87e6-e139-4c35-8fc9-5a898b675f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:16.513515 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa87e6-e139-4c35-8fc9-5a898b675f30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:16.514491 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa87e6-e139-4c35-8fc9-5a898b675f30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:16.519122 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa87e6-e139-4c35-8fc9-5a898b675f30 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:16.579636 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1134/2266] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 12:00:16 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:00:16.581370 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa87e6-e139-4c35-8fc9-5a898b675f30 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:16.586426 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-41aa87e6-e139-4c35-8fc9-5a898b675f30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:16.590605 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:16.655336 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b51e0-af49-4634-a666-83f2d482983a admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:16.759375 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60ddeb-9794-4213-9321-f7a3f1edbaab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:16.761364 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60ddeb-9794-4213-9321-f7a3f1edbaab service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:16.762862 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60ddeb-9794-4213-9321-f7a3f1edbaab service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:16.763410 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60ddeb-9794-4213-9321-f7a3f1edbaab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:16.764435 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa87e6-e139-4c35-8fc9-5a898b675f30 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:16.774906 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f872c7ec-1c49-4824-8f66-2e20cb81ec61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:16.775924 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872c7ec-1c49-4824-8f66-2e20cb81ec61 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:16.776385 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872c7ec-1c49-4824-8f66-2e20cb81ec61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:16.776857 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872c7ec-1c49-4824-8f66-2e20cb81ec61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:16.885049 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f872c7ec-1c49-4824-8f66-2e20cb81ec61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:16.887291 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f872c7ec-1c49-4824-8f66-2e20cb81ec61 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:16.902777 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e60ddeb-9794-4213-9321-f7a3f1edbaab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:16.903188 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1135/2267] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:00:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:00:16.904046 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f872c7ec-1c49-4824-8f66-2e20cb81ec61 service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:16.904672 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e60ddeb-9794-4213-9321-f7a3f1edbaab service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:16.940119 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f872c7ec-1c49-4824-8f66-2e20cb81ec61 service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:16.940240 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1133/2268] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:00:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:00:16.944009 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf230dc-2730-44a8-afda-6b2ad7d41556 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:16.944273 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a4751-bb8a-4a8e-b4df-b91eda3c40d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:16.944763 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf230dc-2730-44a8-afda-6b2ad7d41556 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:16.944958 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a4751-bb8a-4a8e-b4df-b91eda3c40d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:16.945242 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a4751-bb8a-4a8e-b4df-b91eda3c40d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:16.945517 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a4751-bb8a-4a8e-b4df-b91eda3c40d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:16.945785 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf230dc-2730-44a8-afda-6b2ad7d41556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:16.946215 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55a4751-bb8a-4a8e-b4df-b91eda3c40d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:16.948224 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55a4751-bb8a-4a8e-b4df-b91eda3c40d8 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:16.983074 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1136/2269] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 12:00:16 2022] POST /identity/v3/users => generated 291 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:00:16.983174 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-5cf230dc-2730-44a8-afda-6b2ad7d41556 None None] MFA Rules not processed for user `7d2bcfc5842e4faaa5369a19fce82d26`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:16.984191 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a4751-bb8a-4a8e-b4df-b91eda3c40d8 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:16.984541 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-5cf230dc-2730-44a8-afda-6b2ad7d41556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:16.997094 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a4751-bb8a-4a8e-b4df-b91eda3c40d8 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:17.002119 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c71d25-3a76-4b33-932e-ff6c847477e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:17.002740 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c71d25-3a76-4b33-932e-ff6c847477e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:17.003027 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c71d25-3a76-4b33-932e-ff6c847477e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:17.003301 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c71d25-3a76-4b33-932e-ff6c847477e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:17.004216 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c71d25-3a76-4b33-932e-ff6c847477e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:17.005829 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c71d25-3a76-4b33-932e-ff6c847477e5 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:17.032808 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1137/2270] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 12:00:17.035200 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c71d25-3a76-4b33-932e-ff6c847477e5 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:17.052052 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c71d25-3a76-4b33-932e-ff6c847477e5 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:17.064278 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db1412-907a-4c21-9679-5dfff8be6b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:17.066736 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db1412-907a-4c21-9679-5dfff8be6b40 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:17.066936 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db1412-907a-4c21-9679-5dfff8be6b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:17.067462 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db1412-907a-4c21-9679-5dfff8be6b40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:17.071849 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db1412-907a-4c21-9679-5dfff8be6b40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:17.073741 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db1412-907a-4c21-9679-5dfff8be6b40 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:17.092001 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1134/2271] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 12:00:17.096398 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf230dc-2730-44a8-afda-6b2ad7d41556 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:17.101210 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1138/2272] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 12:00:17.102393 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-5cf230dc-2730-44a8-afda-6b2ad7d41556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:17.102715 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db1412-907a-4c21-9679-5dfff8be6b40 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:17.114236 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db1412-907a-4c21-9679-5dfff8be6b40 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:17.118675 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf230dc-2730-44a8-afda-6b2ad7d41556 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:17.119459 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd96fd86-ec8a-4c9f-b247-b1a9c0415ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:17.120640 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96fd86-ec8a-4c9f-b247-b1a9c0415ad8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:17.121062 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96fd86-ec8a-4c9f-b247-b1a9c0415ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:17.121424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96fd86-ec8a-4c9f-b247-b1a9c0415ad8 admin admin] PATH_INFO: `/v3/projects/0d4fa4f45d8d47cc901899530ea70588/users/b05308cf1e974f54a5c368eacb090f70/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:17.125166 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7103b6-1f3b-463c-8255-8e594f7871b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:17.126561 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7103b6-1f3b-463c-8255-8e594f7871b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:17.128876 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7103b6-1f3b-463c-8255-8e594f7871b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:17.129406 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7103b6-1f3b-463c-8255-8e594f7871b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:17.130778 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7103b6-1f3b-463c-8255-8e594f7871b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:17.133720 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7103b6-1f3b-463c-8255-8e594f7871b8 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:17.144688 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd96fd86-ec8a-4c9f-b247-b1a9c0415ad8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d4fa4f45d8d47cc901899530ea70588, user_id=b05308cf1e974f54a5c368eacb090f70, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:17.149343 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd96fd86-ec8a-4c9f-b247-b1a9c0415ad8 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:17.172163 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1139/2273] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:00:17 2022] PUT /identity/v3/projects/0d4fa4f45d8d47cc901899530ea70588/users/b05308cf1e974f54a5c368eacb090f70/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:17.188011 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edead1b6-d794-402d-99c4-5f0cdc149a0a None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:17.188627 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edead1b6-d794-402d-99c4-5f0cdc149a0a None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:17.188990 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edead1b6-d794-402d-99c4-5f0cdc149a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:17.191487 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1135/2274] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 12:00:17 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 12:00:17.197075 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7103b6-1f3b-463c-8255-8e594f7871b8 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:17.212053 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:17.234503 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:17.266580 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-edead1b6-d794-402d-99c4-5f0cdc149a0a None None] MFA Rules not processed for user `b05308cf1e974f54a5c368eacb090f70`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:17.268271 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-edead1b6-d794-402d-99c4-5f0cdc149a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:17.321789 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7103b6-1f3b-463c-8255-8e594f7871b8 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:17.329720 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c242a-85a3-49b3-a4f6-6bb6d830af88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:17.331090 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c242a-85a3-49b3-a4f6-6bb6d830af88 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:17.362922 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c242a-85a3-49b3-a4f6-6bb6d830af88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:17.363744 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c242a-85a3-49b3-a4f6-6bb6d830af88 admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:17.366977 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c242a-85a3-49b3-a4f6-6bb6d830af88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:17.369859 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c242a-85a3-49b3-a4f6-6bb6d830af88 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:17.418437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1136/2275] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 12:00:17 2022] POST /identity/v3/users => generated 293 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:00:17.423043 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c242a-85a3-49b3-a4f6-6bb6d830af88 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:17.442791 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1140/2276] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:17.448591 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edead1b6-d794-402d-99c4-5f0cdc149a0a None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:17.453514 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c242a-85a3-49b3-a4f6-6bb6d830af88 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:17.467433 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edead1b6-d794-402d-99c4-5f0cdc149a0a None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:17.470579 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ffc5b-c018-43ca-8a23-fb1976dd9340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:17.471563 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ffc5b-c018-43ca-8a23-fb1976dd9340 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:17.471682 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ffc5b-c018-43ca-8a23-fb1976dd9340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:17.471937 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ffc5b-c018-43ca-8a23-fb1976dd9340 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:17.474147 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ffc5b-c018-43ca-8a23-fb1976dd9340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:17.475012 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ffc5b-c018-43ca-8a23-fb1976dd9340 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:17.480751 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c83e2-752e-471c-a3e1-18ad1f44d6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:17.481427 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c83e2-752e-471c-a3e1-18ad1f44d6b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:17.481711 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c83e2-752e-471c-a3e1-18ad1f44d6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:17.481987 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c83e2-752e-471c-a3e1-18ad1f44d6b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:17.482691 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c83e2-752e-471c-a3e1-18ad1f44d6b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:17.484833 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c83e2-752e-471c-a3e1-18ad1f44d6b2 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:17.501090 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1137/2277] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:00:17.510284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ffc5b-c018-43ca-8a23-fb1976dd9340 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:17.522791 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ffc5b-c018-43ca-8a23-fb1976dd9340 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:17.533641 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1141/2278] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 12:00:17 2022] POST /identity/v3/projects => generated 379 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:00:17.537818 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c83e2-752e-471c-a3e1-18ad1f44d6b2 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:17.538378 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600b6ab-96a1-4234-b275-1d45da80746a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:17.539301 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600b6ab-96a1-4234-b275-1d45da80746a admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:17.539626 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600b6ab-96a1-4234-b275-1d45da80746a admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:17.539907 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600b6ab-96a1-4234-b275-1d45da80746a admin admin] PATH_INFO: `/v3/projects/4c0418da93e7465c82e4d1733e1d9871/users/f7f121785c4848b4a049e709f9402b01/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:17.566219 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c600b6ab-96a1-4234-b275-1d45da80746a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c0418da93e7465c82e4d1733e1d9871, user_id=f7f121785c4848b4a049e709f9402b01, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:17.569886 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c600b6ab-96a1-4234-b275-1d45da80746a admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:17.597602 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1138/2279] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:00:17 2022] PUT /identity/v3/projects/4c0418da93e7465c82e4d1733e1d9871/users/f7f121785c4848b4a049e709f9402b01/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:17.601719 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600b6ab-96a1-4234-b275-1d45da80746a admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:17.646863 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c83e2-752e-471c-a3e1-18ad1f44d6b2 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:17.731176 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600b6ab-96a1-4234-b275-1d45da80746a admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:17.744186 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1ab80-2e27-410f-ac26-ba6c18f1cad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:17.745428 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1ab80-2e27-410f-ac26-ba6c18f1cad9 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:17.745874 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1ab80-2e27-410f-ac26-ba6c18f1cad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:17.746519 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1ab80-2e27-410f-ac26-ba6c18f1cad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:17.747604 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d1ab80-2e27-410f-ac26-ba6c18f1cad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:17.749884 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d1ab80-2e27-410f-ac26-ba6c18f1cad9 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:17.764957 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0a677-0bf4-4273-b464-a349d284e852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:17.768864 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1139/2280] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 12:00:17.769684 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0a677-0bf4-4273-b464-a349d284e852 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:17.769684 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0a677-0bf4-4273-b464-a349d284e852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:17.769684 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0a677-0bf4-4273-b464-a349d284e852 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:17.769684 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0a677-0bf4-4273-b464-a349d284e852 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:17.769684 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0a677-0bf4-4273-b464-a349d284e852 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:17.771490 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1ab80-2e27-410f-ac26-ba6c18f1cad9 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:17.786292 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1ab80-2e27-410f-ac26-ba6c18f1cad9 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:17.796702 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6912f3e-b132-41b6-a2d7-c0da559b9e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:17.798690 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6912f3e-b132-41b6-a2d7-c0da559b9e36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:17.799159 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6912f3e-b132-41b6-a2d7-c0da559b9e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:17.799653 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6912f3e-b132-41b6-a2d7-c0da559b9e36 admin admin] PATH_INFO: `/v3/projects/4c0418da93e7465c82e4d1733e1d9871/users/f7f121785c4848b4a049e709f9402b01/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:17.803216 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1142/2281] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 12:00:17 2022] POST /identity/v3/users => generated 296 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 12:00:17.804035 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6912f3e-b132-41b6-a2d7-c0da559b9e36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c0418da93e7465c82e4d1733e1d9871, user_id=f7f121785c4848b4a049e709f9402b01, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:17.804856 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0a677-0bf4-4273-b464-a349d284e852 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:17.807079 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6912f3e-b132-41b6-a2d7-c0da559b9e36 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:17.817685 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0a677-0bf4-4273-b464-a349d284e852 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:17.827826 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1140/2282] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:00:17 2022] PUT /identity/v3/projects/4c0418da93e7465c82e4d1733e1d9871/users/f7f121785c4848b4a049e709f9402b01/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:17.837519 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:17.930198 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f2a96-82b0-40a7-a1dd-0cac1a84e573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:17.931011 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f2a96-82b0-40a7-a1dd-0cac1a84e573 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:17.931305 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f2a96-82b0-40a7-a1dd-0cac1a84e573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:17.932150 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f2a96-82b0-40a7-a1dd-0cac1a84e573 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:17.933221 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9f2a96-82b0-40a7-a1dd-0cac1a84e573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:17.936415 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9f2a96-82b0-40a7-a1dd-0cac1a84e573 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:17.960470 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6912f3e-b132-41b6-a2d7-c0da559b9e36 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:17.974986 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1143/2283] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:00:17.978952 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6912f3e-b132-41b6-a2d7-c0da559b9e36 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:17.985205 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53905489-4f98-4b31-b9d6-c34ddcf10af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:17.986628 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53905489-4f98-4b31-b9d6-c34ddcf10af3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:17.986979 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53905489-4f98-4b31-b9d6-c34ddcf10af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:17.987433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53905489-4f98-4b31-b9d6-c34ddcf10af3 admin admin] PATH_INFO: `/v3/projects/9c68b420926b4ea0a6acec5bb06762bd/users/bbafcb21360346a9930c83e0d61b0354/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:18.027546 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53905489-4f98-4b31-b9d6-c34ddcf10af3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c68b420926b4ea0a6acec5bb06762bd, user_id=bbafcb21360346a9930c83e0d61b0354, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:18.032430 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53905489-4f98-4b31-b9d6-c34ddcf10af3 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:18.054459 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1141/2284] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:00:17 2022] PUT /identity/v3/projects/9c68b420926b4ea0a6acec5bb06762bd/users/bbafcb21360346a9930c83e0d61b0354/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:18.055459 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f2a96-82b0-40a7-a1dd-0cac1a84e573 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:18.072752 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f2a96-82b0-40a7-a1dd-0cac1a84e573 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:18.174343 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db73240-bc88-4273-ac86-4d2b1f946454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:18.175024 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db73240-bc88-4273-ac86-4d2b1f946454 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:18.175341 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db73240-bc88-4273-ac86-4d2b1f946454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:18.175610 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db73240-bc88-4273-ac86-4d2b1f946454 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:18.176334 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db73240-bc88-4273-ac86-4d2b1f946454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:18.180598 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db73240-bc88-4273-ac86-4d2b1f946454 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:18.183786 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53905489-4f98-4b31-b9d6-c34ddcf10af3 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:18.186218 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-53905489-4f98-4b31-b9d6-c34ddcf10af3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:18.202137 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1144/2285] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 12:00:18.208539 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db73240-bc88-4273-ac86-4d2b1f946454 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:18.222392 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53905489-4f98-4b31-b9d6-c34ddcf10af3 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:18.242812 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bfa4ba-aaa3-474b-b628-f20d5bab125d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:18.245984 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfa4ba-aaa3-474b-b628-f20d5bab125d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:18.245984 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfa4ba-aaa3-474b-b628-f20d5bab125d admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:18.246335 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfa4ba-aaa3-474b-b628-f20d5bab125d admin admin] PATH_INFO: `/v3/projects/c914b119f38748f1886da5773a956c8f` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:18.249229 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db73240-bc88-4273-ac86-4d2b1f946454 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:18.253776 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bfa4ba-aaa3-474b-b628-f20d5bab125d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c914b119f38748f1886da5773a956c8f)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:18.254300 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bfa4ba-aaa3-474b-b628-f20d5bab125d admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:18.274350 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1821ff-e196-48be-92f4-54caa9363a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:18.275828 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1821ff-e196-48be-92f4-54caa9363a08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:18.276124 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1821ff-e196-48be-92f4-54caa9363a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:18.276404 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1821ff-e196-48be-92f4-54caa9363a08 admin admin] PATH_INFO: `/v3/projects/9c68b420926b4ea0a6acec5bb06762bd/users/bbafcb21360346a9930c83e0d61b0354/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:18.276877 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:18.280032 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1821ff-e196-48be-92f4-54caa9363a08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c68b420926b4ea0a6acec5bb06762bd, user_id=bbafcb21360346a9930c83e0d61b0354, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:18.283896 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1821ff-e196-48be-92f4-54caa9363a08 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:18.315552 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1145/2286] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:00:18 2022] PUT /identity/v3/projects/9c68b420926b4ea0a6acec5bb06762bd/users/bbafcb21360346a9930c83e0d61b0354/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:18.323239 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1821ff-e196-48be-92f4-54caa9363a08 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:18.326903 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-8c1821ff-e196-48be-92f4-54caa9363a08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:18.335638 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-31bfa4ba-aaa3-474b-b628-f20d5bab125d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c914b119f38748f1886da5773a956c8f', 'request_id': 'req-31bfa4ba-aaa3-474b-b628-f20d5bab125d'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:18.343955 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-31bfa4ba-aaa3-474b-b628-f20d5bab125d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c914b119f38748f1886da5773a956c8f', 'request_id': 'req-31bfa4ba-aaa3-474b-b628-f20d5bab125d'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:18.357835 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-31bfa4ba-aaa3-474b-b628-f20d5bab125d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c914b119f38748f1886da5773a956c8f', 'request_id': 'req-31bfa4ba-aaa3-474b-b628-f20d5bab125d'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:18.374288 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-31bfa4ba-aaa3-474b-b628-f20d5bab125d admin admin] The token cache is being invalidate because project c914b119f38748f1886da5773a956c8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:00:18.375738 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-31bfa4ba-aaa3-474b-b628-f20d5bab125d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:18.376603 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-31bfa4ba-aaa3-474b-b628-f20d5bab125d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:18.379114 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1142/2287] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:00:18 2022] DELETE /identity/v3/projects/c914b119f38748f1886da5773a956c8f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:18.380759 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd68931-b325-4f1a-865a-60767bcc4809 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:18.381501 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd68931-b325-4f1a-865a-60767bcc4809 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:18.381501 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd68931-b325-4f1a-865a-60767bcc4809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:18.430409 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-6cd68931-b325-4f1a-865a-60767bcc4809 None None] MFA Rules not processed for user `bbafcb21360346a9930c83e0d61b0354`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:18.432118 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-6cd68931-b325-4f1a-865a-60767bcc4809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:18.443083 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1821ff-e196-48be-92f4-54caa9363a08 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:18.512803 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:18.555119 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddfcc0e-62f8-4afd-b35f-5edfc1b1c132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:18.556228 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfcc0e-62f8-4afd-b35f-5edfc1b1c132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:18.556469 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfcc0e-62f8-4afd-b35f-5edfc1b1c132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:18.556754 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfcc0e-62f8-4afd-b35f-5edfc1b1c132 admin admin] PATH_INFO: `/v3/projects/26d9c9f05acf47988f1a6e12fce8e168` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:18.558050 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddfcc0e-62f8-4afd-b35f-5edfc1b1c132 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26d9c9f05acf47988f1a6e12fce8e168)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:18.560290 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddfcc0e-62f8-4afd-b35f-5edfc1b1c132 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:18.594304 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1143/2288] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:18 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:18.600250 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198aafd-34c4-4433-94c9-d38c56792ad7 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:18.601339 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198aafd-34c4-4433-94c9-d38c56792ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:18.601556 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198aafd-34c4-4433-94c9-d38c56792ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:18.624408 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-e198aafd-34c4-4433-94c9-d38c56792ad7 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:18.625655 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-e198aafd-34c4-4433-94c9-d38c56792ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:18.658655 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1144/2289] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:18.659694 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e198aafd-34c4-4433-94c9-d38c56792ad7 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:18.662915 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-e198aafd-34c4-4433-94c9-d38c56792ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:18.693148 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-fddfcc0e-62f8-4afd-b35f-5edfc1b1c132 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26d9c9f05acf47988f1a6e12fce8e168', 'request_id': 'req-fddfcc0e-62f8-4afd-b35f-5edfc1b1c132'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:18.709056 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-fddfcc0e-62f8-4afd-b35f-5edfc1b1c132 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26d9c9f05acf47988f1a6e12fce8e168', 'request_id': 'req-fddfcc0e-62f8-4afd-b35f-5edfc1b1c132'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:18.727194 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-fddfcc0e-62f8-4afd-b35f-5edfc1b1c132 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26d9c9f05acf47988f1a6e12fce8e168', 'request_id': 'req-fddfcc0e-62f8-4afd-b35f-5edfc1b1c132'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:18.750201 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-fddfcc0e-62f8-4afd-b35f-5edfc1b1c132 admin admin] The token cache is being invalidate because project 26d9c9f05acf47988f1a6e12fce8e168 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:00:18.750674 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-fddfcc0e-62f8-4afd-b35f-5edfc1b1c132 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:18.752481 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-fddfcc0e-62f8-4afd-b35f-5edfc1b1c132 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:18.754483 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e198aafd-34c4-4433-94c9-d38c56792ad7 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:18.756455 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1146/2290] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:00:18 2022] DELETE /identity/v3/projects/26d9c9f05acf47988f1a6e12fce8e168 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:18.758613 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236dde6-92a2-49f4-b59a-90b9285fb2c4 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:18.758894 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236dde6-92a2-49f4-b59a-90b9285fb2c4 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:18.759174 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236dde6-92a2-49f4-b59a-90b9285fb2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:18.790956 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-9236dde6-92a2-49f4-b59a-90b9285fb2c4 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:18.794427 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-9236dde6-92a2-49f4-b59a-90b9285fb2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:18.852758 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:18.880783 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f19ad9-eae2-4675-b2f0-e7c6f30950e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:18.882077 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f19ad9-eae2-4675-b2f0-e7c6f30950e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:18.882438 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f19ad9-eae2-4675-b2f0-e7c6f30950e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:18.882791 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f19ad9-eae2-4675-b2f0-e7c6f30950e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:18.885131 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-71f19ad9-eae2-4675-b2f0-e7c6f30950e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:18.966339 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1147/2291] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:18.967462 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9236dde6-92a2-49f4-b59a-90b9285fb2c4 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:18.970691 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-9236dde6-92a2-49f4-b59a-90b9285fb2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:18.985409 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9236dde6-92a2-49f4-b59a-90b9285fb2c4 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:18.993085 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32299556-4f7a-41c9-ab01-db44b729b8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:18.994055 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32299556-4f7a-41c9-ab01-db44b729b8f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:18.994566 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32299556-4f7a-41c9-ab01-db44b729b8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:18.996024 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32299556-4f7a-41c9-ab01-db44b729b8f4 admin admin] PATH_INFO: `/v3/users/b6f6a7e14c8a436198b8718c36efd575` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:18.998561 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32299556-4f7a-41c9-ab01-db44b729b8f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6f6a7e14c8a436198b8718c36efd575)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:19.000737 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32299556-4f7a-41c9-ab01-db44b729b8f4 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:19.084618 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-32299556-4f7a-41c9-ab01-db44b729b8f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6f6a7e14c8a436198b8718c36efd575'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:19.109684 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-32299556-4f7a-41c9-ab01-db44b729b8f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6f6a7e14c8a436198b8718c36efd575'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:19.110550 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-32299556-4f7a-41c9-ab01-db44b729b8f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6f6a7e14c8a436198b8718c36efd575'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:19.119672 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:19.121080 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f19ad9-eae2-4675-b2f0-e7c6f30950e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:19.122179 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f19ad9-eae2-4675-b2f0-e7c6f30950e9 service cinder] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:19.137275 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-32299556-4f7a-41c9-ab01-db44b729b8f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6f6a7e14c8a436198b8718c36efd575'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:19.153330 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1145/2292] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:00:18 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:00:19.155059 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f19ad9-eae2-4675-b2f0-e7c6f30950e9 service cinder] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:19.162563 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-32299556-4f7a-41c9-ab01-db44b729b8f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6f6a7e14c8a436198b8718c36efd575'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:19.177609 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1148/2293] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:00:18 2022] DELETE /identity/v3/users/b6f6a7e14c8a436198b8718c36efd575 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:19.193115 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f19ad9-eae2-4675-b2f0-e7c6f30950e9 service cinder] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:19.270059 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32299556-4f7a-41c9-ab01-db44b729b8f4 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:19.277625 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-32299556-4f7a-41c9-ab01-db44b729b8f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:19.314029 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2aea8f-0c8e-40f7-b8ff-2bbb2ae238cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:19.314836 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2aea8f-0c8e-40f7-b8ff-2bbb2ae238cb admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:19.315194 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2aea8f-0c8e-40f7-b8ff-2bbb2ae238cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:19.315573 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2aea8f-0c8e-40f7-b8ff-2bbb2ae238cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:19.316418 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2aea8f-0c8e-40f7-b8ff-2bbb2ae238cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:00:19.316802 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2aea8f-0c8e-40f7-b8ff-2bbb2ae238cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:19.322068 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2aea8f-0c8e-40f7-b8ff-2bbb2ae238cb admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:19.350362 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1146/2294] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 12:00:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:00:19.356480 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2aea8f-0c8e-40f7-b8ff-2bbb2ae238cb admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:19.362223 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-1f2aea8f-0c8e-40f7-b8ff-2bbb2ae238cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:19.362699 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32299556-4f7a-41c9-ab01-db44b729b8f4 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:19.366693 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88d778-ae6f-437a-acd3-2bb4648fd9b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:19.367347 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88d778-ae6f-437a-acd3-2bb4648fd9b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:19.367682 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88d778-ae6f-437a-acd3-2bb4648fd9b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:19.367958 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88d778-ae6f-437a-acd3-2bb4648fd9b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:19.369955 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-3d88d778-ae6f-437a-acd3-2bb4648fd9b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:19.378121 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2aea8f-0c8e-40f7-b8ff-2bbb2ae238cb admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:19.384366 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18065b-e472-499c-acc5-47c19c109809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:19.385504 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18065b-e472-499c-acc5-47c19c109809 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:19.386218 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18065b-e472-499c-acc5-47c19c109809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:19.386756 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18065b-e472-499c-acc5-47c19c109809 admin admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:19.387717 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad18065b-e472-499c-acc5-47c19c109809 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:19.389904 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad18065b-e472-499c-acc5-47c19c109809 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:19.430306 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1147/2295] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 12:00:19 2022] POST /identity/v3/projects => generated 397 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 12:00:19.435878 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18065b-e472-499c-acc5-47c19c109809 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:19.443560 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d88d778-ae6f-437a-acd3-2bb4648fd9b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:19.445512 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d88d778-ae6f-437a-acd3-2bb4648fd9b4 service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:19.465839 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1149/2296] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:00:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:00:19.539804 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18065b-e472-499c-acc5-47c19c109809 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:19.545712 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ba17f-f23c-492f-8b8e-66c28facdfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:19.546679 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ba17f-f23c-492f-8b8e-66c28facdfb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:19.546971 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ba17f-f23c-492f-8b8e-66c28facdfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:19.547251 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ba17f-f23c-492f-8b8e-66c28facdfb8 admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:19.548540 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493ba17f-f23c-492f-8b8e-66c28facdfb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:19.550909 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493ba17f-f23c-492f-8b8e-66c28facdfb8 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:19.561183 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:19.586884 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1148/2297] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 12:00:19 2022] POST /identity/v3/users => generated 299 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:00:19.588432 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88d778-ae6f-437a-acd3-2bb4648fd9b4 service cinder] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:19.603918 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88d778-ae6f-437a-acd3-2bb4648fd9b4 service cinder] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:19.612457 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6614ff-0c0f-4ede-ba82-f7a1b7d2b754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:19.613153 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6614ff-0c0f-4ede-ba82-f7a1b7d2b754 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:19.613442 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6614ff-0c0f-4ede-ba82-f7a1b7d2b754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:19.613870 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6614ff-0c0f-4ede-ba82-f7a1b7d2b754 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:19.614941 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6614ff-0c0f-4ede-ba82-f7a1b7d2b754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:19.616552 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6614ff-0c0f-4ede-ba82-f7a1b7d2b754 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:19.628250 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1150/2298] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 12:00:19.632695 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ba17f-f23c-492f-8b8e-66c28facdfb8 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:19.643890 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ba17f-f23c-492f-8b8e-66c28facdfb8 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:19.650382 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4080c63d-ef64-4ae7-a338-7a96a8b02585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:19.663077 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080c63d-ef64-4ae7-a338-7a96a8b02585 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:19.663484 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080c63d-ef64-4ae7-a338-7a96a8b02585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:19.663795 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080c63d-ef64-4ae7-a338-7a96a8b02585 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:19.664591 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4080c63d-ef64-4ae7-a338-7a96a8b02585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:19.671527 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4080c63d-ef64-4ae7-a338-7a96a8b02585 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:19.695166 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1149/2299] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:00:19.697612 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6614ff-0c0f-4ede-ba82-f7a1b7d2b754 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:19.713328 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6614ff-0c0f-4ede-ba82-f7a1b7d2b754 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:19.723262 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abdf073-f6d6-47be-b9f6-0ae53a73c3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:19.724628 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abdf073-f6d6-47be-b9f6-0ae53a73c3a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:19.724840 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abdf073-f6d6-47be-b9f6-0ae53a73c3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:19.725298 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abdf073-f6d6-47be-b9f6-0ae53a73c3a1 admin admin] PATH_INFO: `/v3/projects/a3cea7f9689849fbacbe5973449aaedc/users/74ea7f6f16e949658be792a13bddd289/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:19.745385 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abdf073-f6d6-47be-b9f6-0ae53a73c3a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3cea7f9689849fbacbe5973449aaedc, user_id=74ea7f6f16e949658be792a13bddd289, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:19.748373 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abdf073-f6d6-47be-b9f6-0ae53a73c3a1 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:19.770677 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1151/2300] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:00:19 2022] PUT /identity/v3/projects/a3cea7f9689849fbacbe5973449aaedc/users/74ea7f6f16e949658be792a13bddd289/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:19.782844 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711cb991-b1ea-453e-af9b-d3bcf95d6b2f None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:19.784807 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711cb991-b1ea-453e-af9b-d3bcf95d6b2f None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:19.785391 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711cb991-b1ea-453e-af9b-d3bcf95d6b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:19.845922 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-711cb991-b1ea-453e-af9b-d3bcf95d6b2f None None] MFA Rules not processed for user `74ea7f6f16e949658be792a13bddd289`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:19.851288 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-711cb991-b1ea-453e-af9b-d3bcf95d6b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:19.853947 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abdf073-f6d6-47be-b9f6-0ae53a73c3a1 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:19.855900 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-1abdf073-f6d6-47be-b9f6-0ae53a73c3a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:19.978540 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1150/2301] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:19 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:19.981783 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abdf073-f6d6-47be-b9f6-0ae53a73c3a1 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:19.987654 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb01a27-fe4e-400f-8537-8eb103bd8269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:19.988526 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb01a27-fe4e-400f-8537-8eb103bd8269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:19.988806 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb01a27-fe4e-400f-8537-8eb103bd8269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:19.989081 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb01a27-fe4e-400f-8537-8eb103bd8269 admin admin] PATH_INFO: `/v3/projects/40381afca6ce4e99abb56b494bd0110a` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:19.991076 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb01a27-fe4e-400f-8537-8eb103bd8269 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40381afca6ce4e99abb56b494bd0110a)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:19.991547 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711cb991-b1ea-453e-af9b-d3bcf95d6b2f None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:19.993193 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb01a27-fe4e-400f-8537-8eb103bd8269 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:19.996340 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:20.061014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711cb991-b1ea-453e-af9b-d3bcf95d6b2f None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:20.062498 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-5fb01a27-fe4e-400f-8537-8eb103bd8269 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40381afca6ce4e99abb56b494bd0110a', 'request_id': 'req-5fb01a27-fe4e-400f-8537-8eb103bd8269'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:20.070131 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-5fb01a27-fe4e-400f-8537-8eb103bd8269 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40381afca6ce4e99abb56b494bd0110a', 'request_id': 'req-5fb01a27-fe4e-400f-8537-8eb103bd8269'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:20.084029 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-5fb01a27-fe4e-400f-8537-8eb103bd8269 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40381afca6ce4e99abb56b494bd0110a', 'request_id': 'req-5fb01a27-fe4e-400f-8537-8eb103bd8269'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:20.109133 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-5fb01a27-fe4e-400f-8537-8eb103bd8269 admin admin] The token cache is being invalidate because project 40381afca6ce4e99abb56b494bd0110a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:00:20.109504 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-5fb01a27-fe4e-400f-8537-8eb103bd8269 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:20.110302 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-5fb01a27-fe4e-400f-8537-8eb103bd8269 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:20.112166 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1152/2302] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:00:19 2022] DELETE /identity/v3/projects/40381afca6ce4e99abb56b494bd0110a => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:20.117401 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df883959-d96d-4836-87c1-87a32de596e5 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:20.117401 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df883959-d96d-4836-87c1-87a32de596e5 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:20.117685 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df883959-d96d-4836-87c1-87a32de596e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:20.137750 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-df883959-d96d-4836-87c1-87a32de596e5 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:20.139003 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-df883959-d96d-4836-87c1-87a32de596e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:20.152482 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b9f90-c37d-43b1-8017-1b423743702a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:20.153751 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b9f90-c37d-43b1-8017-1b423743702a service cinder] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:20.154245 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b9f90-c37d-43b1-8017-1b423743702a service cinder] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:20.155676 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b9f90-c37d-43b1-8017-1b423743702a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:20.162020 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-ff2b9f90-c37d-43b1-8017-1b423743702a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:20.232902 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:20.263446 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2b9f90-c37d-43b1-8017-1b423743702a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:20.265615 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2b9f90-c37d-43b1-8017-1b423743702a service cinder] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:20.274237 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1153/2303] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 12:00:20.275925 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780dda7d-9073-4d97-8f4a-4647ee77cf22 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:20.276362 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780dda7d-9073-4d97-8f4a-4647ee77cf22 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:20.276552 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780dda7d-9073-4d97-8f4a-4647ee77cf22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:20.281823 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1151/2304] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:00:19 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 12:00:20.305398 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-780dda7d-9073-4d97-8f4a-4647ee77cf22 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:20.306682 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-780dda7d-9073-4d97-8f4a-4647ee77cf22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:20.328049 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1154/2305] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:20.329214 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b9f90-c37d-43b1-8017-1b423743702a service cinder] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:20.343807 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b9f90-c37d-43b1-8017-1b423743702a service cinder] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:20.349592 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe2089f-093d-4564-ba1a-2cc450cb65c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:20.350825 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2089f-093d-4564-ba1a-2cc450cb65c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:20.351316 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2089f-093d-4564-ba1a-2cc450cb65c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:20.351644 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2089f-093d-4564-ba1a-2cc450cb65c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:20.352383 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe2089f-093d-4564-ba1a-2cc450cb65c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:00:20.353040 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe2089f-093d-4564-ba1a-2cc450cb65c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:20.354833 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe2089f-093d-4564-ba1a-2cc450cb65c1 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:20.376464 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1152/2306] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 12:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:00:20.378046 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780dda7d-9073-4d97-8f4a-4647ee77cf22 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:20.390497 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780dda7d-9073-4d97-8f4a-4647ee77cf22 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:20.398665 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722b444-63a6-43e7-8bcd-5b7ca0cb8a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:20.399420 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722b444-63a6-43e7-8bcd-5b7ca0cb8a63 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:20.399779 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722b444-63a6-43e7-8bcd-5b7ca0cb8a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:20.400094 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722b444-63a6-43e7-8bcd-5b7ca0cb8a63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:20.400937 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e722b444-63a6-43e7-8bcd-5b7ca0cb8a63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:20.403235 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e722b444-63a6-43e7-8bcd-5b7ca0cb8a63 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:20.442279 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1155/2307] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 12:00:20 2022] POST /identity/v3/projects => generated 387 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 12:00:20.444942 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe2089f-093d-4564-ba1a-2cc450cb65c1 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:20.457009 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe2089f-093d-4564-ba1a-2cc450cb65c1 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:20.626373 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b1792-01f0-48c1-8bbc-470a65503e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:20.627075 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b1792-01f0-48c1-8bbc-470a65503e22 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:20.627363 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b1792-01f0-48c1-8bbc-470a65503e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:20.627704 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b1792-01f0-48c1-8bbc-470a65503e22 admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:20.629470 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b1792-01f0-48c1-8bbc-470a65503e22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:20.634663 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b1792-01f0-48c1-8bbc-470a65503e22 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:20.683666 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1153/2308] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 12:00:20 2022] POST /identity/v3/users => generated 294 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:00:20.687843 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722b444-63a6-43e7-8bcd-5b7ca0cb8a63 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:20.699796 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722b444-63a6-43e7-8bcd-5b7ca0cb8a63 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:20.705348 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2278d6-a27c-4e77-a176-182f2860c3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:20.706013 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2278d6-a27c-4e77-a176-182f2860c3c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:20.706296 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2278d6-a27c-4e77-a176-182f2860c3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:20.706573 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2278d6-a27c-4e77-a176-182f2860c3c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:20.707303 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2278d6-a27c-4e77-a176-182f2860c3c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:20.708952 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2278d6-a27c-4e77-a176-182f2860c3c8 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:20.721817 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1156/2309] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:00:20.725590 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b1792-01f0-48c1-8bbc-470a65503e22 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:20.736990 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b1792-01f0-48c1-8bbc-470a65503e22 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:20.743863 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eca198-efcd-41cf-9dc8-11c29f094ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:20.744605 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eca198-efcd-41cf-9dc8-11c29f094ced admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:20.744890 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eca198-efcd-41cf-9dc8-11c29f094ced admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:20.745167 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eca198-efcd-41cf-9dc8-11c29f094ced admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:20.745958 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eca198-efcd-41cf-9dc8-11c29f094ced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:20.747726 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eca198-efcd-41cf-9dc8-11c29f094ced admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:20.762606 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1154/2310] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:00:20.768509 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2278d6-a27c-4e77-a176-182f2860c3c8 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:20.782538 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2278d6-a27c-4e77-a176-182f2860c3c8 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:20.794447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6f61e-d4b6-4f0d-a29b-a63630c3f061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:20.795425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6f61e-d4b6-4f0d-a29b-a63630c3f061 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:20.795827 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6f61e-d4b6-4f0d-a29b-a63630c3f061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:20.796001 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6f61e-d4b6-4f0d-a29b-a63630c3f061 admin admin] PATH_INFO: `/v3/projects/842774c1ecc240be9e0761ec4874c83d/users/1c995f101e9f411d9d4f244fdcf90d41/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:20.827801 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6f61e-d4b6-4f0d-a29b-a63630c3f061 admin admin] RBAC: Authorizing `identity:create_grant(project_id=842774c1ecc240be9e0761ec4874c83d, user_id=1c995f101e9f411d9d4f244fdcf90d41, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:20.836385 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6f61e-d4b6-4f0d-a29b-a63630c3f061 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:20.868230 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1157/2311] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:00:20 2022] PUT /identity/v3/projects/842774c1ecc240be9e0761ec4874c83d/users/1c995f101e9f411d9d4f244fdcf90d41/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:20.878260 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5b8bd-4a96-4690-ab17-55ff7c9c6ded None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:20.878660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5b8bd-4a96-4690-ab17-55ff7c9c6ded None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:20.879047 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5b8bd-4a96-4690-ab17-55ff7c9c6ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:20.929063 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-6dc5b8bd-4a96-4690-ab17-55ff7c9c6ded None None] MFA Rules not processed for user `1c995f101e9f411d9d4f244fdcf90d41`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:20.933216 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-6dc5b8bd-4a96-4690-ab17-55ff7c9c6ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:21.110655 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1155/2312] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:21.116425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6f61e-d4b6-4f0d-a29b-a63630c3f061 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:21.164931 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:21.214893 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6f61e-d4b6-4f0d-a29b-a63630c3f061 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:21.226770 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c07d7b-2344-4f70-82b6-ad284f0f6f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:21.228205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c07d7b-2344-4f70-82b6-ad284f0f6f71 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:21.228650 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c07d7b-2344-4f70-82b6-ad284f0f6f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:21.229394 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c07d7b-2344-4f70-82b6-ad284f0f6f71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:21.230874 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c07d7b-2344-4f70-82b6-ad284f0f6f71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:21.233569 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c07d7b-2344-4f70-82b6-ad284f0f6f71 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:21.330655 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1158/2313] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 12:00:21 2022] POST /identity/v3/projects => generated 385 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:00:21.331863 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5b8bd-4a96-4690-ab17-55ff7c9c6ded None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:21.358655 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5b8bd-4a96-4690-ab17-55ff7c9c6ded None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:21.422131 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:21.468052 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440cf75d-aec6-45c8-997e-171d3bc620ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:21.468912 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440cf75d-aec6-45c8-997e-171d3bc620ca admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:21.469388 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440cf75d-aec6-45c8-997e-171d3bc620ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:21.469862 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440cf75d-aec6-45c8-997e-171d3bc620ca admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:21.471242 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440cf75d-aec6-45c8-997e-171d3bc620ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:21.473814 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440cf75d-aec6-45c8-997e-171d3bc620ca admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:21.507323 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1156/2314] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 12:00:21 2022] POST /identity/v3/users => generated 299 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:00:21.508527 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c07d7b-2344-4f70-82b6-ad284f0f6f71 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:21.526281 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c07d7b-2344-4f70-82b6-ad284f0f6f71 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:21.531384 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd360bd-ef73-4690-a5e9-acfc01a0bc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:21.532423 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd360bd-ef73-4690-a5e9-acfc01a0bc43 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:21.532811 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd360bd-ef73-4690-a5e9-acfc01a0bc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:21.533212 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd360bd-ef73-4690-a5e9-acfc01a0bc43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:21.534081 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd360bd-ef73-4690-a5e9-acfc01a0bc43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:21.536059 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd360bd-ef73-4690-a5e9-acfc01a0bc43 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:21.557181 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1159/2315] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:00:21.559025 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440cf75d-aec6-45c8-997e-171d3bc620ca admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:21.569918 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440cf75d-aec6-45c8-997e-171d3bc620ca admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:21.595227 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e14bff-322a-4f4f-a615-24ac2f536d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:21.596177 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e14bff-322a-4f4f-a615-24ac2f536d16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:21.596458 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e14bff-322a-4f4f-a615-24ac2f536d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:21.596737 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e14bff-322a-4f4f-a615-24ac2f536d16 admin admin] PATH_INFO: `/v3/projects/a4dd4e08be0f44d2b9d2a0fde9db0dd5/users/c97d58b14b1b484fa45f8c2e735dc351/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:21.629546 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e14bff-322a-4f4f-a615-24ac2f536d16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4dd4e08be0f44d2b9d2a0fde9db0dd5, user_id=c97d58b14b1b484fa45f8c2e735dc351, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:21.632876 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e14bff-322a-4f4f-a615-24ac2f536d16 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:21.653506 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1157/2316] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:00:21 2022] PUT /identity/v3/projects/a4dd4e08be0f44d2b9d2a0fde9db0dd5/users/c97d58b14b1b484fa45f8c2e735dc351/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:21.657398 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd360bd-ef73-4690-a5e9-acfc01a0bc43 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:21.690557 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd360bd-ef73-4690-a5e9-acfc01a0bc43 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:21.806060 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9491d106-fad2-469d-a6db-a5ba5c025737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:21.806267 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491d106-fad2-469d-a6db-a5ba5c025737 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:21.806530 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491d106-fad2-469d-a6db-a5ba5c025737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:21.806808 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491d106-fad2-469d-a6db-a5ba5c025737 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:21.807583 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9491d106-fad2-469d-a6db-a5ba5c025737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:21.810628 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9491d106-fad2-469d-a6db-a5ba5c025737 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:21.833544 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1160/2317] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:00:21.834760 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e14bff-322a-4f4f-a615-24ac2f536d16 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:21.858424 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e14bff-322a-4f4f-a615-24ac2f536d16 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:21.864933 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de061317-2ad7-4406-8498-371d623f7d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:21.875413 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de061317-2ad7-4406-8498-371d623f7d07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:21.875935 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de061317-2ad7-4406-8498-371d623f7d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:21.876417 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de061317-2ad7-4406-8498-371d623f7d07 admin admin] PATH_INFO: `/v3/projects/a4dd4e08be0f44d2b9d2a0fde9db0dd5/users/c97d58b14b1b484fa45f8c2e735dc351/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:21.917741 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de061317-2ad7-4406-8498-371d623f7d07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4dd4e08be0f44d2b9d2a0fde9db0dd5, user_id=c97d58b14b1b484fa45f8c2e735dc351, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:21.924753 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de061317-2ad7-4406-8498-371d623f7d07 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:21.937910 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1158/2318] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:00:21 2022] PUT /identity/v3/projects/a4dd4e08be0f44d2b9d2a0fde9db0dd5/users/c97d58b14b1b484fa45f8c2e735dc351/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 12:00:21.952355 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc93ee1-0691-477b-8fce-ebc0ad2ca1e4 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:21.952355 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc93ee1-0691-477b-8fce-ebc0ad2ca1e4 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:21.952890 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc93ee1-0691-477b-8fce-ebc0ad2ca1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:21.990676 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-7fc93ee1-0691-477b-8fce-ebc0ad2ca1e4 None None] MFA Rules not processed for user `c97d58b14b1b484fa45f8c2e735dc351`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:21.993298 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-7fc93ee1-0691-477b-8fce-ebc0ad2ca1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:22.119447 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1161/2319] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:22.133504 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de061317-2ad7-4406-8498-371d623f7d07 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:22.135978 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-de061317-2ad7-4406-8498-371d623f7d07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:22.252429 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de061317-2ad7-4406-8498-371d623f7d07 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:22.260241 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857fa8f-b8b3-4e29-88b2-2c077450e94b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:22.261087 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857fa8f-b8b3-4e29-88b2-2c077450e94b service cinder] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:22.261376 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857fa8f-b8b3-4e29-88b2-2c077450e94b service cinder] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:22.261724 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857fa8f-b8b3-4e29-88b2-2c077450e94b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:22.273802 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d857fa8f-b8b3-4e29-88b2-2c077450e94b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:22.276271 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d857fa8f-b8b3-4e29-88b2-2c077450e94b service cinder] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:22.292705 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1159/2320] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:00:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:00:23.672785 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc93ee1-0691-477b-8fce-ebc0ad2ca1e4 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:23.737550 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:23.821143 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc93ee1-0691-477b-8fce-ebc0ad2ca1e4 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:23.837014 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc80fb-7714-45ec-9213-3053846ec144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:23.837932 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc80fb-7714-45ec-9213-3053846ec144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:23.838218 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc80fb-7714-45ec-9213-3053846ec144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:23.838497 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc80fb-7714-45ec-9213-3053846ec144 admin admin] PATH_INFO: `/v3/users/1c995f101e9f411d9d4f244fdcf90d41` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:23.843772 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc80fb-7714-45ec-9213-3053846ec144 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c995f101e9f411d9d4f244fdcf90d41)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:23.845898 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc80fb-7714-45ec-9213-3053846ec144 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:23.958593 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-4fcc80fb-7714-45ec-9213-3053846ec144 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c995f101e9f411d9d4f244fdcf90d41'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:23.975225 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-4fcc80fb-7714-45ec-9213-3053846ec144 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c995f101e9f411d9d4f244fdcf90d41'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:23.977779 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-4fcc80fb-7714-45ec-9213-3053846ec144 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c995f101e9f411d9d4f244fdcf90d41'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:24.003135 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-4fcc80fb-7714-45ec-9213-3053846ec144 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c995f101e9f411d9d4f244fdcf90d41'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:24.025144 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-4fcc80fb-7714-45ec-9213-3053846ec144 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c995f101e9f411d9d4f244fdcf90d41'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:24.034714 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1162/2321] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:00:23 2022] DELETE /identity/v3/users/1c995f101e9f411d9d4f244fdcf90d41 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:24.039663 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54bfee-fbf9-447d-8517-4d70f670e302 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:24.039663 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54bfee-fbf9-447d-8517-4d70f670e302 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:24.039663 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54bfee-fbf9-447d-8517-4d70f670e302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:24.082001 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-db54bfee-fbf9-447d-8517-4d70f670e302 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:24.084632 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-db54bfee-fbf9-447d-8517-4d70f670e302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:24.294476 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1160/2322] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:24.326339 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc80fb-7714-45ec-9213-3053846ec144 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:24.327876 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-4fcc80fb-7714-45ec-9213-3053846ec144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:24.474645 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc80fb-7714-45ec-9213-3053846ec144 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:24.480095 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077faee-8264-43c8-8b15-66412518e54f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:24.480649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077faee-8264-43c8-8b15-66412518e54f service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:24.480976 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077faee-8264-43c8-8b15-66412518e54f service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:24.481152 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077faee-8264-43c8-8b15-66412518e54f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:24.502263 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077faee-8264-43c8-8b15-66412518e54f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:24.504190 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077faee-8264-43c8-8b15-66412518e54f service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:24.529936 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1163/2323] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:00:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:00:25.386226 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54bfee-fbf9-447d-8517-4d70f670e302 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:25.388424 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-db54bfee-fbf9-447d-8517-4d70f670e302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:25.406451 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54bfee-fbf9-447d-8517-4d70f670e302 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:25.424403 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0072a-4ed3-445e-9407-1e889a99b74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:25.426255 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0072a-4ed3-445e-9407-1e889a99b74b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:25.427068 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0072a-4ed3-445e-9407-1e889a99b74b admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:25.427570 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0072a-4ed3-445e-9407-1e889a99b74b admin admin] PATH_INFO: `/v3/projects/842774c1ecc240be9e0761ec4874c83d` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:25.430752 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e0072a-4ed3-445e-9407-1e889a99b74b admin admin] RBAC: Authorizing `identity:delete_project(project_id=842774c1ecc240be9e0761ec4874c83d)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:25.436239 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e0072a-4ed3-445e-9407-1e889a99b74b admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:25.489560 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:25.559379 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-63e0072a-4ed3-445e-9407-1e889a99b74b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '842774c1ecc240be9e0761ec4874c83d', 'request_id': 'req-63e0072a-4ed3-445e-9407-1e889a99b74b'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:25.575359 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-63e0072a-4ed3-445e-9407-1e889a99b74b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '842774c1ecc240be9e0761ec4874c83d', 'request_id': 'req-63e0072a-4ed3-445e-9407-1e889a99b74b'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:25.576993 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfbfb2-1b17-4183-820d-4ef07149fb5a None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:25.577465 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfbfb2-1b17-4183-820d-4ef07149fb5a None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:25.577543 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfbfb2-1b17-4183-820d-4ef07149fb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:25.592593 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-63e0072a-4ed3-445e-9407-1e889a99b74b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '842774c1ecc240be9e0761ec4874c83d', 'request_id': 'req-63e0072a-4ed3-445e-9407-1e889a99b74b'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:25.618408 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-63e0072a-4ed3-445e-9407-1e889a99b74b admin admin] The token cache is being invalidate because project 842774c1ecc240be9e0761ec4874c83d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:00:25.618868 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-e2cfbfb2-1b17-4183-820d-4ef07149fb5a None None] MFA Rules not processed for user `f7f121785c4848b4a049e709f9402b01`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:25.619163 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-63e0072a-4ed3-445e-9407-1e889a99b74b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:25.620075 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-63e0072a-4ed3-445e-9407-1e889a99b74b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:25.620783 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-e2cfbfb2-1b17-4183-820d-4ef07149fb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:25.622052 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1161/2324] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:00:25 2022] DELETE /identity/v3/projects/842774c1ecc240be9e0761ec4874c83d => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:25.626090 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0072a-4ed3-445e-9407-1e889a99b74b admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:25.629922 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-63e0072a-4ed3-445e-9407-1e889a99b74b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:25.684685 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:25.728697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0072a-4ed3-445e-9407-1e889a99b74b admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:25.739972 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d105e1f-2e70-462a-bbb5-96bc3f517e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:25.742257 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d105e1f-2e70-462a-bbb5-96bc3f517e71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:25.742553 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d105e1f-2e70-462a-bbb5-96bc3f517e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:25.742839 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d105e1f-2e70-462a-bbb5-96bc3f517e71 admin admin] PATH_INFO: `/v3/users/c97d58b14b1b484fa45f8c2e735dc351` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:25.744120 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d105e1f-2e70-462a-bbb5-96bc3f517e71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c97d58b14b1b484fa45f8c2e735dc351)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:25.746533 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d105e1f-2e70-462a-bbb5-96bc3f517e71 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:25.753122 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1164/2325] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:25 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:25.773330 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cfbfb2-1b17-4183-820d-4ef07149fb5a None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:25.779851 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-e2cfbfb2-1b17-4183-820d-4ef07149fb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:25.830715 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-0d105e1f-2e70-462a-bbb5-96bc3f517e71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c97d58b14b1b484fa45f8c2e735dc351'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:25.831404 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-0d105e1f-2e70-462a-bbb5-96bc3f517e71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c97d58b14b1b484fa45f8c2e735dc351'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:25.857265 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-0d105e1f-2e70-462a-bbb5-96bc3f517e71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c97d58b14b1b484fa45f8c2e735dc351'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:25.867669 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-0d105e1f-2e70-462a-bbb5-96bc3f517e71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c97d58b14b1b484fa45f8c2e735dc351'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:25.879475 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-0d105e1f-2e70-462a-bbb5-96bc3f517e71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c97d58b14b1b484fa45f8c2e735dc351'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:25.893109 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1162/2326] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:00:25 2022] DELETE /identity/v3/users/c97d58b14b1b484fa45f8c2e735dc351 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:25.896114 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cfbfb2-1b17-4183-820d-4ef07149fb5a None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:25.975828 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a4c221-3f6a-40f7-b235-6f9e194e9200 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:25.976541 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4c221-3f6a-40f7-b235-6f9e194e9200 service nova] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:25.976830 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4c221-3f6a-40f7-b235-6f9e194e9200 service nova] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:25.977180 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4c221-3f6a-40f7-b235-6f9e194e9200 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:25.979048 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-68a4c221-3f6a-40f7-b235-6f9e194e9200 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:26.052480 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a4c221-3f6a-40f7-b235-6f9e194e9200 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:26.054213 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a4c221-3f6a-40f7-b235-6f9e194e9200 service nova] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:26.075743 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1165/2327] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:00:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:00:26.270908 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d105e1f-2e70-462a-bbb5-96bc3f517e71 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:26.273674 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-0d105e1f-2e70-462a-bbb5-96bc3f517e71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:26.314197 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:26.347668 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d105e1f-2e70-462a-bbb5-96bc3f517e71 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:26.352355 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44fba4-4100-47d8-aa48-53aea27336f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:26.353296 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44fba4-4100-47d8-aa48-53aea27336f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:26.353588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44fba4-4100-47d8-aa48-53aea27336f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:26.353861 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44fba4-4100-47d8-aa48-53aea27336f0 admin admin] PATH_INFO: `/v3/projects/a4dd4e08be0f44d2b9d2a0fde9db0dd5` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:26.355246 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44fba4-4100-47d8-aa48-53aea27336f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4dd4e08be0f44d2b9d2a0fde9db0dd5)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:26.357270 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44fba4-4100-47d8-aa48-53aea27336f0 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:26.409039 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-be44fba4-4100-47d8-aa48-53aea27336f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4dd4e08be0f44d2b9d2a0fde9db0dd5', 'request_id': 'req-be44fba4-4100-47d8-aa48-53aea27336f0'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:26.414999 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-be44fba4-4100-47d8-aa48-53aea27336f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4dd4e08be0f44d2b9d2a0fde9db0dd5', 'request_id': 'req-be44fba4-4100-47d8-aa48-53aea27336f0'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:26.422728 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-be44fba4-4100-47d8-aa48-53aea27336f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4dd4e08be0f44d2b9d2a0fde9db0dd5', 'request_id': 'req-be44fba4-4100-47d8-aa48-53aea27336f0'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:26.434594 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-be44fba4-4100-47d8-aa48-53aea27336f0 admin admin] The token cache is being invalidate because project a4dd4e08be0f44d2b9d2a0fde9db0dd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:00:26.434879 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-be44fba4-4100-47d8-aa48-53aea27336f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:26.435633 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-be44fba4-4100-47d8-aa48-53aea27336f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:26.437331 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1163/2328] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:00:26 2022] DELETE /identity/v3/projects/a4dd4e08be0f44d2b9d2a0fde9db0dd5 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:26.442348 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60ad74-6f0f-4782-a6d3-001f5451ff3e None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:26.443268 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60ad74-6f0f-4782-a6d3-001f5451ff3e None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:26.443268 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60ad74-6f0f-4782-a6d3-001f5451ff3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:26.457376 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:26.470186 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-3c60ad74-6f0f-4782-a6d3-001f5451ff3e None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:26.471467 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-3c60ad74-6f0f-4782-a6d3-001f5451ff3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:26.565413 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1166/2329] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:26.574202 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8725b-377a-4a12-8ad4-a9e4b1f6bf95 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:26.574490 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8725b-377a-4a12-8ad4-a9e4b1f6bf95 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:26.574762 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8725b-377a-4a12-8ad4-a9e4b1f6bf95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:26.606070 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-eca8725b-377a-4a12-8ad4-a9e4b1f6bf95 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:26.607633 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-eca8725b-377a-4a12-8ad4-a9e4b1f6bf95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:26.624366 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60ad74-6f0f-4782-a6d3-001f5451ff3e None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:26.625096 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1164/2330] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:26.636677 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60ad74-6f0f-4782-a6d3-001f5451ff3e None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:26.642560 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d7eee-f33d-4651-8f53-ea4e2b931ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:26.643141 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d7eee-f33d-4651-8f53-ea4e2b931ffa admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:26.643426 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d7eee-f33d-4651-8f53-ea4e2b931ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:26.643752 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d7eee-f33d-4651-8f53-ea4e2b931ffa admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:26.644469 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d7eee-f33d-4651-8f53-ea4e2b931ffa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:00:26.644776 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d7eee-f33d-4651-8f53-ea4e2b931ffa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:26.646537 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d7eee-f33d-4651-8f53-ea4e2b931ffa admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:26.662599 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1167/2331] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 12:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:00:26.666938 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8725b-377a-4a12-8ad4-a9e4b1f6bf95 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:26.678083 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8725b-377a-4a12-8ad4-a9e4b1f6bf95 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:26.684782 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0406a-2370-46c2-a1a9-0e874a20cced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:26.687991 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0406a-2370-46c2-a1a9-0e874a20cced admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:26.687991 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0406a-2370-46c2-a1a9-0e874a20cced admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:26.687991 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0406a-2370-46c2-a1a9-0e874a20cced admin admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:26.687991 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b0406a-2370-46c2-a1a9-0e874a20cced admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:26.688859 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b0406a-2370-46c2-a1a9-0e874a20cced admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:26.727573 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1165/2332] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 12:00:26 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:00:26.728929 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d7eee-f33d-4651-8f53-ea4e2b931ffa admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:26.739016 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d7eee-f33d-4651-8f53-ea4e2b931ffa admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:26.823604 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c32a8-c8e0-4183-8b61-fe6209d4c8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:26.825016 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c32a8-c8e0-4183-8b61-fe6209d4c8ca admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:26.825650 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c32a8-c8e0-4183-8b61-fe6209d4c8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:26.826623 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c32a8-c8e0-4183-8b61-fe6209d4c8ca admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:26.827752 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27c32a8-c8e0-4183-8b61-fe6209d4c8ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:26.832111 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27c32a8-c8e0-4183-8b61-fe6209d4c8ca admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:26.889463 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1168/2333] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 12:00:26 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:00:26.896978 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0406a-2370-46c2-a1a9-0e874a20cced admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:26.909520 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0406a-2370-46c2-a1a9-0e874a20cced admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:26.915097 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2305dc-480d-43d5-941d-6767f689934c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:26.915947 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2305dc-480d-43d5-941d-6767f689934c admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:26.916140 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2305dc-480d-43d5-941d-6767f689934c admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:26.916376 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2305dc-480d-43d5-941d-6767f689934c admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:26.917218 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2305dc-480d-43d5-941d-6767f689934c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:26.919070 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2305dc-480d-43d5-941d-6767f689934c admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:26.930441 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1166/2334] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:00:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:00:26.934351 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c32a8-c8e0-4183-8b61-fe6209d4c8ca admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:26.945838 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c32a8-c8e0-4183-8b61-fe6209d4c8ca admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:26.951643 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aebace7-2200-4c85-af7b-bbab1f031c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:26.952562 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebace7-2200-4c85-af7b-bbab1f031c35 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:26.952822 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebace7-2200-4c85-af7b-bbab1f031c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:26.953096 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebace7-2200-4c85-af7b-bbab1f031c35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:26.954034 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aebace7-2200-4c85-af7b-bbab1f031c35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:26.957518 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aebace7-2200-4c85-af7b-bbab1f031c35 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:26.969064 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1169/2335] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:00:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:00:26.973652 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2305dc-480d-43d5-941d-6767f689934c admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:26.995290 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2305dc-480d-43d5-941d-6767f689934c admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:27.001322 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943fb71e-398f-4886-b347-b2998ab5b2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:27.002959 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943fb71e-398f-4886-b347-b2998ab5b2d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:27.003307 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943fb71e-398f-4886-b347-b2998ab5b2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:27.003690 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943fb71e-398f-4886-b347-b2998ab5b2d5 admin admin] PATH_INFO: `/v3/projects/e3bd876021524610ba73974673562aeb/users/f0511d02697a44eb9ee77e3ece0ad68b/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:27.034816 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943fb71e-398f-4886-b347-b2998ab5b2d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3bd876021524610ba73974673562aeb, user_id=f0511d02697a44eb9ee77e3ece0ad68b, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:27.039778 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943fb71e-398f-4886-b347-b2998ab5b2d5 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:27.070342 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1167/2336] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:00:26 2022] PUT /identity/v3/projects/e3bd876021524610ba73974673562aeb/users/f0511d02697a44eb9ee77e3ece0ad68b/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 12:00:27.072651 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d1be0-d46e-4f32-9ded-e2aadcd6b744 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:27.072950 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d1be0-d46e-4f32-9ded-e2aadcd6b744 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:27.073881 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d1be0-d46e-4f32-9ded-e2aadcd6b744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:27.127736 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-567d1be0-d46e-4f32-9ded-e2aadcd6b744 None None] MFA Rules not processed for user `f0511d02697a44eb9ee77e3ece0ad68b`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:27.129097 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-567d1be0-d46e-4f32-9ded-e2aadcd6b744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:27.252887 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1170/2337] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 12:00:27.270657 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943fb71e-398f-4886-b347-b2998ab5b2d5 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:27.273294 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-943fb71e-398f-4886-b347-b2998ab5b2d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:27.354121 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943fb71e-398f-4886-b347-b2998ab5b2d5 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:27.358608 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9188aff-f2db-4e3b-9836-823f7a053098 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:27.359587 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9188aff-f2db-4e3b-9836-823f7a053098 service cinder] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:27.359753 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9188aff-f2db-4e3b-9836-823f7a053098 service cinder] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:27.360019 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9188aff-f2db-4e3b-9836-823f7a053098 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:27.372297 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9188aff-f2db-4e3b-9836-823f7a053098 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:27.373662 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9188aff-f2db-4e3b-9836-823f7a053098 service cinder] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:27.383680 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784b4c7-b28c-44ce-af98-2dca194c1775 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:27.384100 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784b4c7-b28c-44ce-af98-2dca194c1775 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:27.384477 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784b4c7-b28c-44ce-af98-2dca194c1775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:27.388058 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1168/2338] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:00:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 12:00:27.406077 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:27.417539 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9188aff-f2db-4e3b-9836-823f7a053098 service cinder] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:27.422362 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-e784b4c7-b28c-44ce-af98-2dca194c1775 None None] MFA Rules not processed for user `7d2bcfc5842e4faaa5369a19fce82d26`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:27.423787 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-e784b4c7-b28c-44ce-af98-2dca194c1775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:27.424172 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:27.485988 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1171/2339] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:27.495064 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9188aff-f2db-4e3b-9836-823f7a053098 service cinder] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:27.500063 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c296f0-3943-4993-aa4b-a132dc810292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:27.501059 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c296f0-3943-4993-aa4b-a132dc810292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:27.501441 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c296f0-3943-4993-aa4b-a132dc810292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:27.501814 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c296f0-3943-4993-aa4b-a132dc810292 admin admin] PATH_INFO: `/v3/users/f0511d02697a44eb9ee77e3ece0ad68b` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:27.503691 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c296f0-3943-4993-aa4b-a132dc810292 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0511d02697a44eb9ee77e3ece0ad68b)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:27.505784 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c296f0-3943-4993-aa4b-a132dc810292 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:27.559464 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-c6c296f0-3943-4993-aa4b-a132dc810292 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0511d02697a44eb9ee77e3ece0ad68b'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:27.560179 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-c6c296f0-3943-4993-aa4b-a132dc810292 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0511d02697a44eb9ee77e3ece0ad68b'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:27.574475 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-c6c296f0-3943-4993-aa4b-a132dc810292 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0511d02697a44eb9ee77e3ece0ad68b'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:27.586408 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-c6c296f0-3943-4993-aa4b-a132dc810292 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0511d02697a44eb9ee77e3ece0ad68b'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:27.596334 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-c6c296f0-3943-4993-aa4b-a132dc810292 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0511d02697a44eb9ee77e3ece0ad68b'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:27.604812 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1169/2340] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:00:27 2022] DELETE /identity/v3/users/f0511d02697a44eb9ee77e3ece0ad68b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:27.609098 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14410a-dc83-4fba-80b2-8cb0580fdb94 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:27.609396 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14410a-dc83-4fba-80b2-8cb0580fdb94 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:27.609676 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14410a-dc83-4fba-80b2-8cb0580fdb94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:27.630732 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-6e14410a-dc83-4fba-80b2-8cb0580fdb94 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:27.632993 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-6e14410a-dc83-4fba-80b2-8cb0580fdb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:27.708294 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1172/2341] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:27.718450 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c296f0-3943-4993-aa4b-a132dc810292 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:27.719964 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-c6c296f0-3943-4993-aa4b-a132dc810292 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:27.786053 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c296f0-3943-4993-aa4b-a132dc810292 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:27.790879 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e477642-4d2a-4e55-84bc-cb7a4a3a90c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:27.791762 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e477642-4d2a-4e55-84bc-cb7a4a3a90c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:27.792260 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e477642-4d2a-4e55-84bc-cb7a4a3a90c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:27.792611 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e477642-4d2a-4e55-84bc-cb7a4a3a90c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:27.804543 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e477642-4d2a-4e55-84bc-cb7a4a3a90c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:27.806143 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e477642-4d2a-4e55-84bc-cb7a4a3a90c2 service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:27.817101 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1170/2342] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:00:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 12:00:28.218134 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14410a-dc83-4fba-80b2-8cb0580fdb94 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:28.220023 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-6e14410a-dc83-4fba-80b2-8cb0580fdb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:28.237183 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14410a-dc83-4fba-80b2-8cb0580fdb94 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:28.250379 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f08b5-01c9-470a-84c2-5a2f90fa5419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:28.251870 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f08b5-01c9-470a-84c2-5a2f90fa5419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:28.252353 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f08b5-01c9-470a-84c2-5a2f90fa5419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:28.252645 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f08b5-01c9-470a-84c2-5a2f90fa5419 admin admin] PATH_INFO: `/v3/projects/e3bd876021524610ba73974673562aeb` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:28.253897 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f08b5-01c9-470a-84c2-5a2f90fa5419 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3bd876021524610ba73974673562aeb)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:28.256973 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f08b5-01c9-470a-84c2-5a2f90fa5419 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:28.331344 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1b1f08b5-01c9-470a-84c2-5a2f90fa5419 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3bd876021524610ba73974673562aeb', 'request_id': 'req-1b1f08b5-01c9-470a-84c2-5a2f90fa5419'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:28.339581 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1b1f08b5-01c9-470a-84c2-5a2f90fa5419 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3bd876021524610ba73974673562aeb', 'request_id': 'req-1b1f08b5-01c9-470a-84c2-5a2f90fa5419'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:28.349611 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1b1f08b5-01c9-470a-84c2-5a2f90fa5419 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3bd876021524610ba73974673562aeb', 'request_id': 'req-1b1f08b5-01c9-470a-84c2-5a2f90fa5419'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:28.377547 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1b1f08b5-01c9-470a-84c2-5a2f90fa5419 admin admin] The token cache is being invalidate because project e3bd876021524610ba73974673562aeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:00:28.377852 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1b1f08b5-01c9-470a-84c2-5a2f90fa5419 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:28.378995 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1b1f08b5-01c9-470a-84c2-5a2f90fa5419 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:28.380632 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1173/2343] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:00:28 2022] DELETE /identity/v3/projects/e3bd876021524610ba73974673562aeb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:28.385642 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da6f07-cf3c-4248-8b24-88aad59fdaf9 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:28.386242 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da6f07-cf3c-4248-8b24-88aad59fdaf9 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:28.386593 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da6f07-cf3c-4248-8b24-88aad59fdaf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:28.406019 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-e4da6f07-cf3c-4248-8b24-88aad59fdaf9 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:28.407679 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-e4da6f07-cf3c-4248-8b24-88aad59fdaf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:28.436697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:28.502771 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1171/2344] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:28.513138 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bb36e-64aa-453c-a9ff-5f268832648f None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:28.513583 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bb36e-64aa-453c-a9ff-5f268832648f None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:28.513869 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bb36e-64aa-453c-a9ff-5f268832648f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:28.544707 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-b66bb36e-64aa-453c-a9ff-5f268832648f None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:28.557140 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-b66bb36e-64aa-453c-a9ff-5f268832648f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:28.566650 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1174/2345] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 12:00:28.570540 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da6f07-cf3c-4248-8b24-88aad59fdaf9 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:28.589031 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da6f07-cf3c-4248-8b24-88aad59fdaf9 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:28.596194 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423c980-293d-499b-a1ae-b436b53980fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:28.597132 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423c980-293d-499b-a1ae-b436b53980fa admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:28.597629 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423c980-293d-499b-a1ae-b436b53980fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:28.598115 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423c980-293d-499b-a1ae-b436b53980fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:28.599269 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c423c980-293d-499b-a1ae-b436b53980fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:00:28.599827 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c423c980-293d-499b-a1ae-b436b53980fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:28.602765 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c423c980-293d-499b-a1ae-b436b53980fa admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:28.622051 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1172/2346] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 12:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:00:28.622340 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bb36e-64aa-453c-a9ff-5f268832648f None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:28.632466 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bb36e-64aa-453c-a9ff-5f268832648f None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:28.637394 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5a81d-fabc-4616-8d8a-48edd74fcb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:28.638040 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5a81d-fabc-4616-8d8a-48edd74fcb7c admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:28.638320 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5a81d-fabc-4616-8d8a-48edd74fcb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:28.638591 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5a81d-fabc-4616-8d8a-48edd74fcb7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:28.639282 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5a81d-fabc-4616-8d8a-48edd74fcb7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:28.641212 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5a81d-fabc-4616-8d8a-48edd74fcb7c admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:28.666800 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1175/2347] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 12:00:28 2022] POST /identity/v3/projects => generated 359 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 12:00:28.671004 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423c980-293d-499b-a1ae-b436b53980fa admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:28.681624 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423c980-293d-499b-a1ae-b436b53980fa admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:28.742700 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c3907b-00df-416d-a27b-5e7f1effe978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:28.743418 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3907b-00df-416d-a27b-5e7f1effe978 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:28.743746 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3907b-00df-416d-a27b-5e7f1effe978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:28.744025 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3907b-00df-416d-a27b-5e7f1effe978 admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:28.744717 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c3907b-00df-416d-a27b-5e7f1effe978 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:28.746737 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c3907b-00df-416d-a27b-5e7f1effe978 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:28.767867 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1173/2348] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 12:00:28 2022] POST /identity/v3/users => generated 280 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 12:00:28.772848 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5a81d-fabc-4616-8d8a-48edd74fcb7c admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:28.779417 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:28.785729 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5a81d-fabc-4616-8d8a-48edd74fcb7c admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:28.793589 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0714e-21b8-45bc-89e0-53ced48acaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:28.794248 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0714e-21b8-45bc-89e0-53ced48acaec admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:28.794528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0714e-21b8-45bc-89e0-53ced48acaec admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:28.794800 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0714e-21b8-45bc-89e0-53ced48acaec admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:28.795532 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb0714e-21b8-45bc-89e0-53ced48acaec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:28.797121 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb0714e-21b8-45bc-89e0-53ced48acaec admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:28.808607 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1176/2349] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:00:28.812604 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c3907b-00df-416d-a27b-5e7f1effe978 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:28.823346 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c3907b-00df-416d-a27b-5e7f1effe978 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:28.828095 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f369d2d-90ed-4b72-8874-44166084033c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:28.828759 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f369d2d-90ed-4b72-8874-44166084033c admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:28.829048 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f369d2d-90ed-4b72-8874-44166084033c admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:28.829329 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f369d2d-90ed-4b72-8874-44166084033c admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:28.830103 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f369d2d-90ed-4b72-8874-44166084033c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:28.831836 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f369d2d-90ed-4b72-8874-44166084033c admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:28.842064 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1174/2350] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:00:28.846421 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0714e-21b8-45bc-89e0-53ced48acaec admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:28.856822 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0714e-21b8-45bc-89e0-53ced48acaec admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:28.861389 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9b02c-48db-406b-ac81-6adf4492c43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:28.862255 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9b02c-48db-406b-ac81-6adf4492c43e admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:28.862533 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9b02c-48db-406b-ac81-6adf4492c43e admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:28.862807 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9b02c-48db-406b-ac81-6adf4492c43e admin admin] PATH_INFO: `/v3/projects/dfa0b4f5c75e4dd885632e682d5fe795/users/9f16887a64ef413c9f1abdec8077b421/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:28.884203 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9b02c-48db-406b-ac81-6adf4492c43e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfa0b4f5c75e4dd885632e682d5fe795, user_id=9f16887a64ef413c9f1abdec8077b421, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:28.886882 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9b02c-48db-406b-ac81-6adf4492c43e admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:28.944422 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1177/2351] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:00:28 2022] PUT /identity/v3/projects/dfa0b4f5c75e4dd885632e682d5fe795/users/9f16887a64ef413c9f1abdec8077b421/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:28.946104 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1c53a-807d-43fc-9493-0118ab78d2fb None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:28.946404 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1c53a-807d-43fc-9493-0118ab78d2fb None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:28.946680 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1c53a-807d-43fc-9493-0118ab78d2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:28.978709 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-f7d1c53a-807d-43fc-9493-0118ab78d2fb None None] MFA Rules not processed for user `9f16887a64ef413c9f1abdec8077b421`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:28.979962 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-f7d1c53a-807d-43fc-9493-0118ab78d2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:29.064233 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1175/2352] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:28 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:29.112992 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9b02c-48db-406b-ac81-6adf4492c43e admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:29.114766 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-46d9b02c-48db-406b-ac81-6adf4492c43e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:29.175927 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9b02c-48db-406b-ac81-6adf4492c43e admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:29.180166 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5073476d-f589-4601-b544-d01fccf7773b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:29.180848 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073476d-f589-4601-b544-d01fccf7773b service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:29.181130 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073476d-f589-4601-b544-d01fccf7773b service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:29.181404 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073476d-f589-4601-b544-d01fccf7773b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:29.190787 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5073476d-f589-4601-b544-d01fccf7773b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:29.192280 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5073476d-f589-4601-b544-d01fccf7773b service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:29.201854 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1178/2353] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:00:29 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:00:29.215592 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1c53a-807d-43fc-9493-0118ab78d2fb None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:29.237805 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:29.285003 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1c53a-807d-43fc-9493-0118ab78d2fb None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:29.290174 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f83d61-dca0-47ba-b9c7-df5c7a04a927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:29.291069 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f83d61-dca0-47ba-b9c7-df5c7a04a927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:29.291339 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f83d61-dca0-47ba-b9c7-df5c7a04a927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:29.291646 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f83d61-dca0-47ba-b9c7-df5c7a04a927 admin admin] PATH_INFO: `/v3/users/9f16887a64ef413c9f1abdec8077b421` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:29.292849 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f83d61-dca0-47ba-b9c7-df5c7a04a927 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f16887a64ef413c9f1abdec8077b421)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:29.294779 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f83d61-dca0-47ba-b9c7-df5c7a04a927 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:29.348685 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-30f83d61-dca0-47ba-b9c7-df5c7a04a927 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f16887a64ef413c9f1abdec8077b421'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:29.349505 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-30f83d61-dca0-47ba-b9c7-df5c7a04a927 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f16887a64ef413c9f1abdec8077b421'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:29.363301 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-30f83d61-dca0-47ba-b9c7-df5c7a04a927 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f16887a64ef413c9f1abdec8077b421'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:29.371349 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-30f83d61-dca0-47ba-b9c7-df5c7a04a927 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f16887a64ef413c9f1abdec8077b421'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:29.380323 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-30f83d61-dca0-47ba-b9c7-df5c7a04a927 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f16887a64ef413c9f1abdec8077b421'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:29.387966 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1176/2354] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:00:29 2022] DELETE /identity/v3/users/9f16887a64ef413c9f1abdec8077b421 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:29.392684 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0c1f2-9c36-4486-8d79-c100541579eb None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:29.392968 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0c1f2-9c36-4486-8d79-c100541579eb None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:29.393249 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0c1f2-9c36-4486-8d79-c100541579eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:29.412108 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-25f0c1f2-9c36-4486-8d79-c100541579eb None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:29.413345 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-25f0c1f2-9c36-4486-8d79-c100541579eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:29.476258 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1179/2355] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:29.487313 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f83d61-dca0-47ba-b9c7-df5c7a04a927 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:29.488943 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-30f83d61-dca0-47ba-b9c7-df5c7a04a927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:29.557292 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f83d61-dca0-47ba-b9c7-df5c7a04a927 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:29.561006 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a3b6d-fb52-4348-bc66-f4406e2e0070 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:29.561818 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a3b6d-fb52-4348-bc66-f4406e2e0070 service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:29.562109 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a3b6d-fb52-4348-bc66-f4406e2e0070 service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:29.563148 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a3b6d-fb52-4348-bc66-f4406e2e0070 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:29.573306 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a3b6d-fb52-4348-bc66-f4406e2e0070 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:29.574764 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a3b6d-fb52-4348-bc66-f4406e2e0070 service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:29.586666 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1177/2356] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:00:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:00:29.972952 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f0c1f2-9c36-4486-8d79-c100541579eb None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:29.975411 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-25f0c1f2-9c36-4486-8d79-c100541579eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:29.996562 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f0c1f2-9c36-4486-8d79-c100541579eb None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:30.001821 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddaa092-7b82-4c5b-a009-8a29c07f1e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:30.002849 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddaa092-7b82-4c5b-a009-8a29c07f1e7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:30.003139 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddaa092-7b82-4c5b-a009-8a29c07f1e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:30.003642 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddaa092-7b82-4c5b-a009-8a29c07f1e7e admin admin] PATH_INFO: `/v3/projects/dfa0b4f5c75e4dd885632e682d5fe795` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:30.005027 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddaa092-7b82-4c5b-a009-8a29c07f1e7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfa0b4f5c75e4dd885632e682d5fe795)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:30.007737 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddaa092-7b82-4c5b-a009-8a29c07f1e7e admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:30.057496 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-7ddaa092-7b82-4c5b-a009-8a29c07f1e7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfa0b4f5c75e4dd885632e682d5fe795', 'request_id': 'req-7ddaa092-7b82-4c5b-a009-8a29c07f1e7e'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:30.063296 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-7ddaa092-7b82-4c5b-a009-8a29c07f1e7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfa0b4f5c75e4dd885632e682d5fe795', 'request_id': 'req-7ddaa092-7b82-4c5b-a009-8a29c07f1e7e'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:30.071562 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-7ddaa092-7b82-4c5b-a009-8a29c07f1e7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfa0b4f5c75e4dd885632e682d5fe795', 'request_id': 'req-7ddaa092-7b82-4c5b-a009-8a29c07f1e7e'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:30.072863 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:30.089596 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-7ddaa092-7b82-4c5b-a009-8a29c07f1e7e admin admin] The token cache is being invalidate because project dfa0b4f5c75e4dd885632e682d5fe795 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:00:30.090163 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-7ddaa092-7b82-4c5b-a009-8a29c07f1e7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:30.091329 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-7ddaa092-7b82-4c5b-a009-8a29c07f1e7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:30.093832 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1180/2357] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:00:29 2022] DELETE /identity/v3/projects/dfa0b4f5c75e4dd885632e682d5fe795 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:30.099338 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cff3c1-f3b9-4f72-90ce-8268baaa83c1 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:30.099667 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cff3c1-f3b9-4f72-90ce-8268baaa83c1 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:30.099970 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cff3c1-f3b9-4f72-90ce-8268baaa83c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:30.120331 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-60cff3c1-f3b9-4f72-90ce-8268baaa83c1 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:30.122233 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-60cff3c1-f3b9-4f72-90ce-8268baaa83c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:30.169075 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:30.191369 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1178/2358] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 12:00:30.199622 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6354bf9-9144-4cd4-a23b-76f986ac1624 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:30.199909 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6354bf9-9144-4cd4-a23b-76f986ac1624 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:30.200188 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6354bf9-9144-4cd4-a23b-76f986ac1624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:30.218639 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-f6354bf9-9144-4cd4-a23b-76f986ac1624 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:30.219948 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-f6354bf9-9144-4cd4-a23b-76f986ac1624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:30.228862 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1181/2359] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:30.233085 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cff3c1-f3b9-4f72-90ce-8268baaa83c1 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:30.243537 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cff3c1-f3b9-4f72-90ce-8268baaa83c1 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:30.248152 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e539880-fe2c-45a4-b31a-2f739e2f0514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:30.248808 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e539880-fe2c-45a4-b31a-2f739e2f0514 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:30.249085 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e539880-fe2c-45a4-b31a-2f739e2f0514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:30.249360 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e539880-fe2c-45a4-b31a-2f739e2f0514 admin admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:30.250082 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e539880-fe2c-45a4-b31a-2f739e2f0514 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:00:30.250387 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e539880-fe2c-45a4-b31a-2f739e2f0514 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:30.252023 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e539880-fe2c-45a4-b31a-2f739e2f0514 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:30.267752 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1179/2360] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 12:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:00:30.269324 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6354bf9-9144-4cd4-a23b-76f986ac1624 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:30.279059 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6354bf9-9144-4cd4-a23b-76f986ac1624 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:30.283737 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2285c8f-9cdd-4b61-a2cd-289f64fe0105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:30.284383 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2285c8f-9cdd-4b61-a2cd-289f64fe0105 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:30.284662 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2285c8f-9cdd-4b61-a2cd-289f64fe0105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:30.284934 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2285c8f-9cdd-4b61-a2cd-289f64fe0105 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:30.285638 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2285c8f-9cdd-4b61-a2cd-289f64fe0105 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:30.287554 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2285c8f-9cdd-4b61-a2cd-289f64fe0105 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:30.314333 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1182/2361] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 12:00:30 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:00:30.318547 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e539880-fe2c-45a4-b31a-2f739e2f0514 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:30.329167 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e539880-fe2c-45a4-b31a-2f739e2f0514 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:30.385418 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af86fcfb-3510-41a6-af36-d66a578ecfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:30.386091 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af86fcfb-3510-41a6-af36-d66a578ecfbe admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:30.386379 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af86fcfb-3510-41a6-af36-d66a578ecfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:30.386660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af86fcfb-3510-41a6-af36-d66a578ecfbe admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:30.387364 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af86fcfb-3510-41a6-af36-d66a578ecfbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:30.389332 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af86fcfb-3510-41a6-af36-d66a578ecfbe admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:30.417141 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1180/2362] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 12:00:30 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:00:30.420845 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2285c8f-9cdd-4b61-a2cd-289f64fe0105 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:30.431615 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2285c8f-9cdd-4b61-a2cd-289f64fe0105 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:30.436276 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7afe162-7d23-444d-bd57-4eed2082b4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:30.436923 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afe162-7d23-444d-bd57-4eed2082b4a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:30.437204 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afe162-7d23-444d-bd57-4eed2082b4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:30.437475 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afe162-7d23-444d-bd57-4eed2082b4a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:30.438195 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7afe162-7d23-444d-bd57-4eed2082b4a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:30.439796 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7afe162-7d23-444d-bd57-4eed2082b4a2 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:30.451034 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1183/2363] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:00:30.454781 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af86fcfb-3510-41a6-af36-d66a578ecfbe admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:30.465280 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af86fcfb-3510-41a6-af36-d66a578ecfbe admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:30.469875 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07540408-c31e-48e3-9b3d-b36d36665fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:30.470787 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07540408-c31e-48e3-9b3d-b36d36665fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:30.471068 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07540408-c31e-48e3-9b3d-b36d36665fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:30.471342 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07540408-c31e-48e3-9b3d-b36d36665fe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:30.472109 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07540408-c31e-48e3-9b3d-b36d36665fe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:30.473696 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07540408-c31e-48e3-9b3d-b36d36665fe3 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:30.484560 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1181/2364] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:00:30.488834 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7afe162-7d23-444d-bd57-4eed2082b4a2 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:30.504783 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7afe162-7d23-444d-bd57-4eed2082b4a2 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:30.511730 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946ee61-0fc3-4ef7-8be7-4d601f407de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:30.513520 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946ee61-0fc3-4ef7-8be7-4d601f407de3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:30.513813 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946ee61-0fc3-4ef7-8be7-4d601f407de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:30.514095 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946ee61-0fc3-4ef7-8be7-4d601f407de3 admin admin] PATH_INFO: `/v3/projects/5756f3708b944e40befaf2286b1a368f/users/6c156445510140c49c8fa6f58cff849e/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:30.530512 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9946ee61-0fc3-4ef7-8be7-4d601f407de3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5756f3708b944e40befaf2286b1a368f, user_id=6c156445510140c49c8fa6f58cff849e, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:30.533275 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9946ee61-0fc3-4ef7-8be7-4d601f407de3 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:30.548301 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1184/2365] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:00:30 2022] PUT /identity/v3/projects/5756f3708b944e40befaf2286b1a368f/users/6c156445510140c49c8fa6f58cff849e/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:30.559284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efdb17a-c1b3-46b1-b7ad-e8c616c346a3 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:30.559802 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efdb17a-c1b3-46b1-b7ad-e8c616c346a3 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:30.559900 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efdb17a-c1b3-46b1-b7ad-e8c616c346a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:30.588845 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-6efdb17a-c1b3-46b1-b7ad-e8c616c346a3 None None] MFA Rules not processed for user `6c156445510140c49c8fa6f58cff849e`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:30.589762 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-6efdb17a-c1b3-46b1-b7ad-e8c616c346a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:30.657799 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1182/2366] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:30.669232 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946ee61-0fc3-4ef7-8be7-4d601f407de3 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:30.670989 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-9946ee61-0fc3-4ef7-8be7-4d601f407de3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:30.735139 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946ee61-0fc3-4ef7-8be7-4d601f407de3 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:30.738792 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23967357-23d5-47c9-82db-a2e1c0aaff83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:30.739432 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23967357-23d5-47c9-82db-a2e1c0aaff83 service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:30.739743 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23967357-23d5-47c9-82db-a2e1c0aaff83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:30.740019 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23967357-23d5-47c9-82db-a2e1c0aaff83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:30.748962 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23967357-23d5-47c9-82db-a2e1c0aaff83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:30.750657 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23967357-23d5-47c9-82db-a2e1c0aaff83 service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:30.760971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1185/2367] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:00:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:00:37.429887 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efdb17a-c1b3-46b1-b7ad-e8c616c346a3 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:37.431628 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-6efdb17a-c1b3-46b1-b7ad-e8c616c346a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:37.484113 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:37.510837 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efdb17a-c1b3-46b1-b7ad-e8c616c346a3 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:37.524493 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996385c-c891-4e13-8632-6dfc34ac3bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:37.525394 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996385c-c891-4e13-8632-6dfc34ac3bfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:37.525685 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996385c-c891-4e13-8632-6dfc34ac3bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:37.525973 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996385c-c891-4e13-8632-6dfc34ac3bfd admin admin] PATH_INFO: `/v3/users/74ea7f6f16e949658be792a13bddd289` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:37.527200 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996385c-c891-4e13-8632-6dfc34ac3bfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=74ea7f6f16e949658be792a13bddd289)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:37.529171 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996385c-c891-4e13-8632-6dfc34ac3bfd admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:37.587197 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-f996385c-c891-4e13-8632-6dfc34ac3bfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74ea7f6f16e949658be792a13bddd289'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:37.587902 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-f996385c-c891-4e13-8632-6dfc34ac3bfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74ea7f6f16e949658be792a13bddd289'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:37.601892 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-f996385c-c891-4e13-8632-6dfc34ac3bfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74ea7f6f16e949658be792a13bddd289'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:37.611156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-f996385c-c891-4e13-8632-6dfc34ac3bfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74ea7f6f16e949658be792a13bddd289'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:37.622281 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-f996385c-c891-4e13-8632-6dfc34ac3bfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74ea7f6f16e949658be792a13bddd289'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:37.629217 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1183/2368] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:00:37 2022] DELETE /identity/v3/users/74ea7f6f16e949658be792a13bddd289 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:37.633789 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bc139-6a5f-4c07-83a7-570d7bc7cf1b None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:37.634288 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bc139-6a5f-4c07-83a7-570d7bc7cf1b None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:37.634497 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bc139-6a5f-4c07-83a7-570d7bc7cf1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:37.654611 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-3d7bc139-6a5f-4c07-83a7-570d7bc7cf1b None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:37.655857 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-3d7bc139-6a5f-4c07-83a7-570d7bc7cf1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:37.730285 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1186/2369] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:37.743756 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996385c-c891-4e13-8632-6dfc34ac3bfd admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:37.745451 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-f996385c-c891-4e13-8632-6dfc34ac3bfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:37.813713 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996385c-c891-4e13-8632-6dfc34ac3bfd admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:37.817438 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bad8c4-8203-42b9-8709-ad54b5309535 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:37.818812 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bad8c4-8203-42b9-8709-ad54b5309535 service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:37.819097 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bad8c4-8203-42b9-8709-ad54b5309535 service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:37.819380 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bad8c4-8203-42b9-8709-ad54b5309535 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:37.828871 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bad8c4-8203-42b9-8709-ad54b5309535 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:37.830455 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bad8c4-8203-42b9-8709-ad54b5309535 service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:37.847561 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1184/2370] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:00:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:00:38.290915 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7bc139-6a5f-4c07-83a7-570d7bc7cf1b None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:38.292841 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-3d7bc139-6a5f-4c07-83a7-570d7bc7cf1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:38.330228 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7bc139-6a5f-4c07-83a7-570d7bc7cf1b None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:38.345094 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee643cb-c2cf-4133-9ff1-727547857874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:38.346628 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee643cb-c2cf-4133-9ff1-727547857874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:38.347293 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee643cb-c2cf-4133-9ff1-727547857874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:38.347552 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee643cb-c2cf-4133-9ff1-727547857874 admin admin] PATH_INFO: `/v3/projects/a3cea7f9689849fbacbe5973449aaedc` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:38.349227 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee643cb-c2cf-4133-9ff1-727547857874 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3cea7f9689849fbacbe5973449aaedc)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:38.352504 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee643cb-c2cf-4133-9ff1-727547857874 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:38.403867 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:38.433094 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-0ee643cb-c2cf-4133-9ff1-727547857874 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3cea7f9689849fbacbe5973449aaedc', 'request_id': 'req-0ee643cb-c2cf-4133-9ff1-727547857874'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:38.439695 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-0ee643cb-c2cf-4133-9ff1-727547857874 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3cea7f9689849fbacbe5973449aaedc', 'request_id': 'req-0ee643cb-c2cf-4133-9ff1-727547857874'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:38.451042 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-0ee643cb-c2cf-4133-9ff1-727547857874 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3cea7f9689849fbacbe5973449aaedc', 'request_id': 'req-0ee643cb-c2cf-4133-9ff1-727547857874'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:38.470373 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-0ee643cb-c2cf-4133-9ff1-727547857874 admin admin] The token cache is being invalidate because project a3cea7f9689849fbacbe5973449aaedc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:00:38.470672 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-0ee643cb-c2cf-4133-9ff1-727547857874 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:38.471377 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-0ee643cb-c2cf-4133-9ff1-727547857874 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:38.472989 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1187/2371] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:00:38 2022] DELETE /identity/v3/projects/a3cea7f9689849fbacbe5973449aaedc => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:39.101477 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bad8c4-8203-42b9-8709-ad54b5309535 service neutron] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:39.103000 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-96bad8c4-8203-42b9-8709-ad54b5309535 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:39.117746 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bad8c4-8203-42b9-8709-ad54b5309535 service neutron] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:39.183109 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17e23c-94b7-4f0d-8819-10d0be19e6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:39.184021 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17e23c-94b7-4f0d-8819-10d0be19e6d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:39.184303 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17e23c-94b7-4f0d-8819-10d0be19e6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:39.184576 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17e23c-94b7-4f0d-8819-10d0be19e6d8 admin admin] PATH_INFO: `/v3/users/6c156445510140c49c8fa6f58cff849e` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:39.185785 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c17e23c-94b7-4f0d-8819-10d0be19e6d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c156445510140c49c8fa6f58cff849e)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:39.187727 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c17e23c-94b7-4f0d-8819-10d0be19e6d8 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:39.189233 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:39.240169 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-2c17e23c-94b7-4f0d-8819-10d0be19e6d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c156445510140c49c8fa6f58cff849e'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:39.241425 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-2c17e23c-94b7-4f0d-8819-10d0be19e6d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c156445510140c49c8fa6f58cff849e'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:39.260668 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-2c17e23c-94b7-4f0d-8819-10d0be19e6d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c156445510140c49c8fa6f58cff849e'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:39.268265 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-2c17e23c-94b7-4f0d-8819-10d0be19e6d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c156445510140c49c8fa6f58cff849e'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:39.276652 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-2c17e23c-94b7-4f0d-8819-10d0be19e6d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c156445510140c49c8fa6f58cff849e'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:39.286000 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1185/2372] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:00:39 2022] DELETE /identity/v3/users/6c156445510140c49c8fa6f58cff849e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:39.288242 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672f15d-619f-4298-9706-21d90f48e9f0 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:39.288731 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672f15d-619f-4298-9706-21d90f48e9f0 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:39.288871 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672f15d-619f-4298-9706-21d90f48e9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:39.307179 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-e672f15d-619f-4298-9706-21d90f48e9f0 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:39.308421 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-e672f15d-619f-4298-9706-21d90f48e9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:39.426166 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1188/2373] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:39.437249 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17e23c-94b7-4f0d-8819-10d0be19e6d8 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:39.440420 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-2c17e23c-94b7-4f0d-8819-10d0be19e6d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:39.541830 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17e23c-94b7-4f0d-8819-10d0be19e6d8 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:39.548284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33881ab4-2e56-410a-8008-941865613001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:39.549161 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33881ab4-2e56-410a-8008-941865613001 service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:39.549758 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33881ab4-2e56-410a-8008-941865613001 service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:39.551699 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33881ab4-2e56-410a-8008-941865613001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:39.587390 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33881ab4-2e56-410a-8008-941865613001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:39.589227 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33881ab4-2e56-410a-8008-941865613001 service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:39.603578 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1186/2374] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:00:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:00:39.780427 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672f15d-619f-4298-9706-21d90f48e9f0 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:39.785597 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-e672f15d-619f-4298-9706-21d90f48e9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:39.803192 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672f15d-619f-4298-9706-21d90f48e9f0 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:39.808590 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42871912-571f-4dda-9328-ae469c372e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:39.809477 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42871912-571f-4dda-9328-ae469c372e66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:39.809946 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42871912-571f-4dda-9328-ae469c372e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:39.810234 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42871912-571f-4dda-9328-ae469c372e66 admin admin] PATH_INFO: `/v3/users/b05308cf1e974f54a5c368eacb090f70` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:39.811576 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42871912-571f-4dda-9328-ae469c372e66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b05308cf1e974f54a5c368eacb090f70)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:39.813700 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42871912-571f-4dda-9328-ae469c372e66 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:39.882199 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-42871912-571f-4dda-9328-ae469c372e66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b05308cf1e974f54a5c368eacb090f70'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:39.890505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-42871912-571f-4dda-9328-ae469c372e66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b05308cf1e974f54a5c368eacb090f70'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:39.891493 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-42871912-571f-4dda-9328-ae469c372e66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b05308cf1e974f54a5c368eacb090f70'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:39.907686 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-42871912-571f-4dda-9328-ae469c372e66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b05308cf1e974f54a5c368eacb090f70'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:39.922028 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-42871912-571f-4dda-9328-ae469c372e66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b05308cf1e974f54a5c368eacb090f70'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:39.934591 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1189/2375] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:00:39 2022] DELETE /identity/v3/users/b05308cf1e974f54a5c368eacb090f70 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:39.939154 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6e068-a1ea-49c6-b090-63ed1dbf75ce None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:39.939575 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6e068-a1ea-49c6-b090-63ed1dbf75ce None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:39.939975 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6e068-a1ea-49c6-b090-63ed1dbf75ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:39.961621 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-96e6e068-a1ea-49c6-b090-63ed1dbf75ce None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:39.962947 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-96e6e068-a1ea-49c6-b090-63ed1dbf75ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:39.997924 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42871912-571f-4dda-9328-ae469c372e66 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:39.999832 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-42871912-571f-4dda-9328-ae469c372e66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:40.045542 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:40.063652 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1187/2376] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 12:00:40.073403 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e6e068-a1ea-49c6-b090-63ed1dbf75ce None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:40.074899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-96e6e068-a1ea-49c6-b090-63ed1dbf75ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:40.092699 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42871912-571f-4dda-9328-ae469c372e66 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:40.097901 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428067a7-45a0-479a-bc13-abaac5acef2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:40.098919 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428067a7-45a0-479a-bc13-abaac5acef2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:40.099359 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428067a7-45a0-479a-bc13-abaac5acef2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:40.099536 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428067a7-45a0-479a-bc13-abaac5acef2a admin admin] PATH_INFO: `/v3/projects/5756f3708b944e40befaf2286b1a368f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:40.102391 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428067a7-45a0-479a-bc13-abaac5acef2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5756f3708b944e40befaf2286b1a368f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:40.104373 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428067a7-45a0-479a-bc13-abaac5acef2a admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:40.110331 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:40.155851 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e6e068-a1ea-49c6-b090-63ed1dbf75ce None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:40.169109 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-428067a7-45a0-479a-bc13-abaac5acef2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5756f3708b944e40befaf2286b1a368f', 'request_id': 'req-428067a7-45a0-479a-bc13-abaac5acef2a'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:40.181457 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-428067a7-45a0-479a-bc13-abaac5acef2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5756f3708b944e40befaf2286b1a368f', 'request_id': 'req-428067a7-45a0-479a-bc13-abaac5acef2a'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:40.188827 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-428067a7-45a0-479a-bc13-abaac5acef2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5756f3708b944e40befaf2286b1a368f', 'request_id': 'req-428067a7-45a0-479a-bc13-abaac5acef2a'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:40.201169 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-428067a7-45a0-479a-bc13-abaac5acef2a admin admin] The token cache is being invalidate because project 5756f3708b944e40befaf2286b1a368f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:00:40.201592 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-428067a7-45a0-479a-bc13-abaac5acef2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:40.202790 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-428067a7-45a0-479a-bc13-abaac5acef2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:40.219532 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1190/2377] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:00:39 2022] DELETE /identity/v3/projects/5756f3708b944e40befaf2286b1a368f => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:40.236830 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e3712-879b-47fc-8e3e-ec3085d30e79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:40.238215 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e3712-879b-47fc-8e3e-ec3085d30e79 service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:40.238514 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e3712-879b-47fc-8e3e-ec3085d30e79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:40.238780 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e3712-879b-47fc-8e3e-ec3085d30e79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:40.240870 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-cc5e3712-879b-47fc-8e3e-ec3085d30e79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:40.378415 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e3712-879b-47fc-8e3e-ec3085d30e79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:40.380669 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e3712-879b-47fc-8e3e-ec3085d30e79 service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:40.400073 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1188/2378] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:00:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:00:40.676875 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428067a7-45a0-479a-bc13-abaac5acef2a admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:40.678448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-428067a7-45a0-479a-bc13-abaac5acef2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:40.698146 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428067a7-45a0-479a-bc13-abaac5acef2a admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:40.703347 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a05176-c2dd-4571-8b6f-d9ded7b28dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:40.704251 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a05176-c2dd-4571-8b6f-d9ded7b28dae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:40.712979 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a05176-c2dd-4571-8b6f-d9ded7b28dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:40.713377 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a05176-c2dd-4571-8b6f-d9ded7b28dae admin admin] PATH_INFO: `/v3/projects/0d4fa4f45d8d47cc901899530ea70588` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:40.714802 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a05176-c2dd-4571-8b6f-d9ded7b28dae admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d4fa4f45d8d47cc901899530ea70588)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:40.716861 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a05176-c2dd-4571-8b6f-d9ded7b28dae admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:40.788912 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-88a05176-c2dd-4571-8b6f-d9ded7b28dae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d4fa4f45d8d47cc901899530ea70588', 'request_id': 'req-88a05176-c2dd-4571-8b6f-d9ded7b28dae'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:40.794603 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-88a05176-c2dd-4571-8b6f-d9ded7b28dae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d4fa4f45d8d47cc901899530ea70588', 'request_id': 'req-88a05176-c2dd-4571-8b6f-d9ded7b28dae'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:40.807141 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-88a05176-c2dd-4571-8b6f-d9ded7b28dae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d4fa4f45d8d47cc901899530ea70588', 'request_id': 'req-88a05176-c2dd-4571-8b6f-d9ded7b28dae'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:40.826653 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-88a05176-c2dd-4571-8b6f-d9ded7b28dae admin admin] The token cache is being invalidate because project 0d4fa4f45d8d47cc901899530ea70588 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:00:40.827142 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-88a05176-c2dd-4571-8b6f-d9ded7b28dae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:40.828175 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-88a05176-c2dd-4571-8b6f-d9ded7b28dae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:40.829951 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1191/2379] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:00:40 2022] DELETE /identity/v3/projects/0d4fa4f45d8d47cc901899530ea70588 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:40.833822 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e3712-879b-47fc-8e3e-ec3085d30e79 service neutron] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:40.845392 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e3712-879b-47fc-8e3e-ec3085d30e79 service neutron] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:40.917403 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfdfd7a-e608-4daf-83a9-8bbacc29a3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:40.918286 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfdfd7a-e608-4daf-83a9-8bbacc29a3f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:40.918564 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfdfd7a-e608-4daf-83a9-8bbacc29a3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:40.918836 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfdfd7a-e608-4daf-83a9-8bbacc29a3f5 admin admin] PATH_INFO: `/v3/users/bbafcb21360346a9930c83e0d61b0354` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:40.920086 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfdfd7a-e608-4daf-83a9-8bbacc29a3f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbafcb21360346a9930c83e0d61b0354)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:40.924169 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfdfd7a-e608-4daf-83a9-8bbacc29a3f5 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:40.977825 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:40.993414 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-dbfdfd7a-e608-4daf-83a9-8bbacc29a3f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbafcb21360346a9930c83e0d61b0354'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:40.994112 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-dbfdfd7a-e608-4daf-83a9-8bbacc29a3f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbafcb21360346a9930c83e0d61b0354'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:41.005809 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-dbfdfd7a-e608-4daf-83a9-8bbacc29a3f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbafcb21360346a9930c83e0d61b0354'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:41.013777 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-dbfdfd7a-e608-4daf-83a9-8bbacc29a3f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbafcb21360346a9930c83e0d61b0354'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:41.021460 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-dbfdfd7a-e608-4daf-83a9-8bbacc29a3f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbafcb21360346a9930c83e0d61b0354'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:41.027910 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1189/2380] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:00:40 2022] DELETE /identity/v3/users/bbafcb21360346a9930c83e0d61b0354 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:41.307396 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a05176-c2dd-4571-8b6f-d9ded7b28dae admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:41.308934 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-88a05176-c2dd-4571-8b6f-d9ded7b28dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:41.325359 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a05176-c2dd-4571-8b6f-d9ded7b28dae admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:41.368749 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:41.387427 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004272ac-b175-47d5-a07c-149242ff92e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:41.389140 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004272ac-b175-47d5-a07c-149242ff92e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:41.389615 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004272ac-b175-47d5-a07c-149242ff92e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:41.391061 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004272ac-b175-47d5-a07c-149242ff92e3 admin admin] PATH_INFO: `/v3/projects/9c68b420926b4ea0a6acec5bb06762bd` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:41.392903 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004272ac-b175-47d5-a07c-149242ff92e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c68b420926b4ea0a6acec5bb06762bd)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:41.394990 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004272ac-b175-47d5-a07c-149242ff92e3 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:41.467610 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-004272ac-b175-47d5-a07c-149242ff92e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c68b420926b4ea0a6acec5bb06762bd', 'request_id': 'req-004272ac-b175-47d5-a07c-149242ff92e3'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:41.478136 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-004272ac-b175-47d5-a07c-149242ff92e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c68b420926b4ea0a6acec5bb06762bd', 'request_id': 'req-004272ac-b175-47d5-a07c-149242ff92e3'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:41.487978 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-004272ac-b175-47d5-a07c-149242ff92e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c68b420926b4ea0a6acec5bb06762bd', 'request_id': 'req-004272ac-b175-47d5-a07c-149242ff92e3'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:41.500135 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-004272ac-b175-47d5-a07c-149242ff92e3 admin admin] The token cache is being invalidate because project 9c68b420926b4ea0a6acec5bb06762bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:00:41.500429 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-004272ac-b175-47d5-a07c-149242ff92e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:41.501104 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-004272ac-b175-47d5-a07c-149242ff92e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:41.505866 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1192/2381] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:00:41 2022] DELETE /identity/v3/projects/9c68b420926b4ea0a6acec5bb06762bd => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:41.508055 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8f744-0d46-4051-90cc-a2aa93c44a8f None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:41.512421 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8f744-0d46-4051-90cc-a2aa93c44a8f None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:41.512616 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8f744-0d46-4051-90cc-a2aa93c44a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:41.536142 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-eac8f744-0d46-4051-90cc-a2aa93c44a8f None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:41.537421 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-eac8f744-0d46-4051-90cc-a2aa93c44a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:41.602488 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1190/2382] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:41.610098 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d5437-c228-4cff-87b9-5db1166b4743 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:41.610413 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d5437-c228-4cff-87b9-5db1166b4743 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:41.610693 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d5437-c228-4cff-87b9-5db1166b4743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:41.628585 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-133d5437-c228-4cff-87b9-5db1166b4743 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:41.629776 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-133d5437-c228-4cff-87b9-5db1166b4743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:41.638151 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1193/2383] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:41.642082 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac8f744-0d46-4051-90cc-a2aa93c44a8f None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:41.652569 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac8f744-0d46-4051-90cc-a2aa93c44a8f None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:41.657137 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030ec3e-b9e1-4c14-a50e-edef0907ef88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:41.657786 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030ec3e-b9e1-4c14-a50e-edef0907ef88 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:41.658076 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030ec3e-b9e1-4c14-a50e-edef0907ef88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:41.658355 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030ec3e-b9e1-4c14-a50e-edef0907ef88 admin admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:41.659089 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030ec3e-b9e1-4c14-a50e-edef0907ef88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:00:41.659401 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030ec3e-b9e1-4c14-a50e-edef0907ef88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:41.661038 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030ec3e-b9e1-4c14-a50e-edef0907ef88 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:41.672909 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1191/2384] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 12:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:00:41.676885 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d5437-c228-4cff-87b9-5db1166b4743 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:41.686159 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d5437-c228-4cff-87b9-5db1166b4743 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:41.691159 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb24ca-f357-48f9-acd4-970890c69a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:41.691861 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb24ca-f357-48f9-acd4-970890c69a5a admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:41.692148 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb24ca-f357-48f9-acd4-970890c69a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:41.692425 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb24ca-f357-48f9-acd4-970890c69a5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:41.693121 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb24ca-f357-48f9-acd4-970890c69a5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:41.695061 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb24ca-f357-48f9-acd4-970890c69a5a admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:41.720668 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1194/2385] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 12:00:41 2022] POST /identity/v3/projects => generated 363 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:00:41.724548 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030ec3e-b9e1-4c14-a50e-edef0907ef88 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:41.735156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030ec3e-b9e1-4c14-a50e-edef0907ef88 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:41.796260 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc954291-8951-4fb6-ac8c-e95eb8fb372f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:41.801406 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc954291-8951-4fb6-ac8c-e95eb8fb372f admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:41.801613 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc954291-8951-4fb6-ac8c-e95eb8fb372f admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:41.801901 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc954291-8951-4fb6-ac8c-e95eb8fb372f admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:41.802619 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc954291-8951-4fb6-ac8c-e95eb8fb372f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:41.804659 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc954291-8951-4fb6-ac8c-e95eb8fb372f admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:41.839204 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1192/2386] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 12:00:41 2022] POST /identity/v3/users => generated 282 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:00:41.843112 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb24ca-f357-48f9-acd4-970890c69a5a admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:41.864642 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb24ca-f357-48f9-acd4-970890c69a5a admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:41.870637 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886c6f1-ce73-420b-b07f-c6bcb7ee51df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:41.871602 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886c6f1-ce73-420b-b07f-c6bcb7ee51df admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:41.871951 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886c6f1-ce73-420b-b07f-c6bcb7ee51df admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:41.872323 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886c6f1-ce73-420b-b07f-c6bcb7ee51df admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:41.873131 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886c6f1-ce73-420b-b07f-c6bcb7ee51df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:41.874795 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886c6f1-ce73-420b-b07f-c6bcb7ee51df admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:41.886449 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1195/2387] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:00:41.890599 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc954291-8951-4fb6-ac8c-e95eb8fb372f admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:41.902750 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc954291-8951-4fb6-ac8c-e95eb8fb372f admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:41.912601 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73146c44-25a4-45cd-9e88-ff4d630a0ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:41.913279 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73146c44-25a4-45cd-9e88-ff4d630a0ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:41.913607 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73146c44-25a4-45cd-9e88-ff4d630a0ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:41.914354 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73146c44-25a4-45cd-9e88-ff4d630a0ce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:41.915111 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73146c44-25a4-45cd-9e88-ff4d630a0ce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:41.916810 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73146c44-25a4-45cd-9e88-ff4d630a0ce1 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:41.933510 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1193/2388] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 12:00:41.934831 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886c6f1-ce73-420b-b07f-c6bcb7ee51df admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:41.946168 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886c6f1-ce73-420b-b07f-c6bcb7ee51df admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:41.951366 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc2fcc-23dc-4b36-ac55-f0e7fe68750e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:41.953004 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc2fcc-23dc-4b36-ac55-f0e7fe68750e admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:41.953004 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc2fcc-23dc-4b36-ac55-f0e7fe68750e admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:41.953515 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc2fcc-23dc-4b36-ac55-f0e7fe68750e admin admin] PATH_INFO: `/v3/projects/87554bfcefad4a7b9e16e4fe956c9c88/users/34cfc699b91644b4b9b387dc9c929ee0/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:41.970589 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fc2fcc-23dc-4b36-ac55-f0e7fe68750e admin admin] RBAC: Authorizing `identity:create_grant(project_id=87554bfcefad4a7b9e16e4fe956c9c88, user_id=34cfc699b91644b4b9b387dc9c929ee0, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:41.973315 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fc2fcc-23dc-4b36-ac55-f0e7fe68750e admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:41.994962 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1196/2389] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:00:41 2022] PUT /identity/v3/projects/87554bfcefad4a7b9e16e4fe956c9c88/users/34cfc699b91644b4b9b387dc9c929ee0/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:42.005937 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9f6f2-ce6a-493e-9786-87e2589f0e76 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:42.006922 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9f6f2-ce6a-493e-9786-87e2589f0e76 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:42.007388 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9f6f2-ce6a-493e-9786-87e2589f0e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:42.037520 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:42.041048 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-c7d9f6f2-ce6a-493e-9786-87e2589f0e76 None None] MFA Rules not processed for user `34cfc699b91644b4b9b387dc9c929ee0`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:42.042698 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-c7d9f6f2-ce6a-493e-9786-87e2589f0e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:42.142147 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1194/2390] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:42 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 12:00:42.143710 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc2fcc-23dc-4b36-ac55-f0e7fe68750e admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:42.226849 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc2fcc-23dc-4b36-ac55-f0e7fe68750e admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:42.233229 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d357f30-a924-4653-91a1-b09a81a5ec7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:42.234272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d357f30-a924-4653-91a1-b09a81a5ec7d admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:42.234769 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d357f30-a924-4653-91a1-b09a81a5ec7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:42.235261 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d357f30-a924-4653-91a1-b09a81a5ec7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:42.236252 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d357f30-a924-4653-91a1-b09a81a5ec7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:42.238382 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d357f30-a924-4653-91a1-b09a81a5ec7d admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:42.254164 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:42.276071 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1197/2391] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 12:00:42 2022] POST /identity/v3/projects => generated 365 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:00:42.280779 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d9f6f2-ce6a-493e-9786-87e2589f0e76 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:42.293283 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d9f6f2-ce6a-493e-9786-87e2589f0e76 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:42.359146 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3d5c5-de20-40aa-9794-e3416655a184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:42.359852 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3d5c5-de20-40aa-9794-e3416655a184 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:42.360137 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3d5c5-de20-40aa-9794-e3416655a184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:42.360445 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3d5c5-de20-40aa-9794-e3416655a184 admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:42.361122 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3d5c5-de20-40aa-9794-e3416655a184 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:42.363139 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3d5c5-de20-40aa-9794-e3416655a184 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:42.385170 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1195/2392] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 12:00:42 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:00:42.389193 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d357f30-a924-4653-91a1-b09a81a5ec7d admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:42.400278 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d357f30-a924-4653-91a1-b09a81a5ec7d admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:42.405363 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b24ade-da21-4130-b5ce-6927f270aa14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:42.406037 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b24ade-da21-4130-b5ce-6927f270aa14 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:42.406325 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b24ade-da21-4130-b5ce-6927f270aa14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:42.406603 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b24ade-da21-4130-b5ce-6927f270aa14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:42.407484 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b24ade-da21-4130-b5ce-6927f270aa14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:42.409422 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b24ade-da21-4130-b5ce-6927f270aa14 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:42.424079 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1198/2393] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:00:42.425177 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3d5c5-de20-40aa-9794-e3416655a184 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:42.436653 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3d5c5-de20-40aa-9794-e3416655a184 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:42.441974 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c2eb2-a863-41a6-b38a-2a9004c70ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:42.442938 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c2eb2-a863-41a6-b38a-2a9004c70ed0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:42.443225 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c2eb2-a863-41a6-b38a-2a9004c70ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:42.443525 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c2eb2-a863-41a6-b38a-2a9004c70ed0 admin admin] PATH_INFO: `/v3/projects/0f7567acb3a4461896dd50adf1d4f416/users/64c0e422854f4e84be64dafccfc3359b/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:42.460481 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c2eb2-a863-41a6-b38a-2a9004c70ed0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f7567acb3a4461896dd50adf1d4f416, user_id=64c0e422854f4e84be64dafccfc3359b, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:42.463149 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c2eb2-a863-41a6-b38a-2a9004c70ed0 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:42.479756 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1196/2394] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:00:42 2022] PUT /identity/v3/projects/0f7567acb3a4461896dd50adf1d4f416/users/64c0e422854f4e84be64dafccfc3359b/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 12:00:42.484276 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b24ade-da21-4130-b5ce-6927f270aa14 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:42.495240 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b24ade-da21-4130-b5ce-6927f270aa14 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:42.558639 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c3dbd-f071-4655-8afa-92222d665abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:42.559451 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c3dbd-f071-4655-8afa-92222d665abd admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:42.559760 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c3dbd-f071-4655-8afa-92222d665abd admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:42.560107 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c3dbd-f071-4655-8afa-92222d665abd admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:42.560901 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c3dbd-f071-4655-8afa-92222d665abd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:42.562533 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c3dbd-f071-4655-8afa-92222d665abd admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:42.573670 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1199/2395] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:00:42.579560 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c2eb2-a863-41a6-b38a-2a9004c70ed0 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:42.590970 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c2eb2-a863-41a6-b38a-2a9004c70ed0 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:42.596375 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dfecb4-321c-4e30-9071-99bbf61feba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:42.597337 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dfecb4-321c-4e30-9071-99bbf61feba2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:42.597721 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dfecb4-321c-4e30-9071-99bbf61feba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:42.598095 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dfecb4-321c-4e30-9071-99bbf61feba2 admin admin] PATH_INFO: `/v3/projects/0f7567acb3a4461896dd50adf1d4f416/users/64c0e422854f4e84be64dafccfc3359b/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:42.600709 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dfecb4-321c-4e30-9071-99bbf61feba2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f7567acb3a4461896dd50adf1d4f416, user_id=64c0e422854f4e84be64dafccfc3359b, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:42.603765 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dfecb4-321c-4e30-9071-99bbf61feba2 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:42.625948 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1197/2396] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:00:42 2022] PUT /identity/v3/projects/0f7567acb3a4461896dd50adf1d4f416/users/64c0e422854f4e84be64dafccfc3359b/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:42.628687 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a99af4-e17f-4b99-a8a9-bb6190841f74 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:42.629136 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a99af4-e17f-4b99-a8a9-bb6190841f74 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:42.629523 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a99af4-e17f-4b99-a8a9-bb6190841f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:42.686909 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-66a99af4-e17f-4b99-a8a9-bb6190841f74 None None] MFA Rules not processed for user `64c0e422854f4e84be64dafccfc3359b`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:42.688228 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-66a99af4-e17f-4b99-a8a9-bb6190841f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:42.802404 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1200/2397] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:42 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 12:00:42.814388 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dfecb4-321c-4e30-9071-99bbf61feba2 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:42.816254 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-58dfecb4-321c-4e30-9071-99bbf61feba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:42.882800 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:42.905496 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dfecb4-321c-4e30-9071-99bbf61feba2 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:42.909439 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667aa70-2edf-4e27-8f24-de680b66c0f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:42.910092 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667aa70-2edf-4e27-8f24-de680b66c0f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:42.910489 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667aa70-2edf-4e27-8f24-de680b66c0f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:42.910798 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667aa70-2edf-4e27-8f24-de680b66c0f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:42.921730 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c667aa70-2edf-4e27-8f24-de680b66c0f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:42.923244 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c667aa70-2edf-4e27-8f24-de680b66c0f0 service cinder] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:42.933789 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1198/2398] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:00:42 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:00:43.351597 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a99af4-e17f-4b99-a8a9-bb6190841f74 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:43.390869 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:43.438508 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a99af4-e17f-4b99-a8a9-bb6190841f74 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:43.443461 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b2c5d-e798-4452-98e2-86ffadc7affe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:43.444889 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b2c5d-e798-4452-98e2-86ffadc7affe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:43.445170 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b2c5d-e798-4452-98e2-86ffadc7affe admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:43.445441 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b2c5d-e798-4452-98e2-86ffadc7affe admin admin] PATH_INFO: `/v3/users/34cfc699b91644b4b9b387dc9c929ee0` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:43.446660 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b2c5d-e798-4452-98e2-86ffadc7affe admin admin] RBAC: Authorizing `identity:delete_user(user_id=34cfc699b91644b4b9b387dc9c929ee0)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:43.448611 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b2c5d-e798-4452-98e2-86ffadc7affe admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:43.496028 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1d3b2c5d-e798-4452-98e2-86ffadc7affe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34cfc699b91644b4b9b387dc9c929ee0'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:43.502776 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1d3b2c5d-e798-4452-98e2-86ffadc7affe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34cfc699b91644b4b9b387dc9c929ee0'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:43.503424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1d3b2c5d-e798-4452-98e2-86ffadc7affe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34cfc699b91644b4b9b387dc9c929ee0'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:43.515479 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1d3b2c5d-e798-4452-98e2-86ffadc7affe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34cfc699b91644b4b9b387dc9c929ee0'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:43.523230 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1d3b2c5d-e798-4452-98e2-86ffadc7affe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34cfc699b91644b4b9b387dc9c929ee0'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:43.529831 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1201/2399] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:00:43 2022] DELETE /identity/v3/users/34cfc699b91644b4b9b387dc9c929ee0 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:43.534347 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ddd560-758e-4883-a9d9-ed21c6eac849 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:43.534637 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ddd560-758e-4883-a9d9-ed21c6eac849 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:43.534917 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ddd560-758e-4883-a9d9-ed21c6eac849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:43.573335 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-69ddd560-758e-4883-a9d9-ed21c6eac849 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:43.574551 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-69ddd560-758e-4883-a9d9-ed21c6eac849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:43.633489 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1199/2400] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:43.643102 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b2c5d-e798-4452-98e2-86ffadc7affe admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:43.644527 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-1d3b2c5d-e798-4452-98e2-86ffadc7affe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:43.724854 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b2c5d-e798-4452-98e2-86ffadc7affe admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:43.728681 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f0540-cd4f-4583-a70d-5809fb75f7ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:43.729357 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f0540-cd4f-4583-a70d-5809fb75f7ee service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:43.729645 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f0540-cd4f-4583-a70d-5809fb75f7ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:43.729910 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f0540-cd4f-4583-a70d-5809fb75f7ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:43.739634 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f0540-cd4f-4583-a70d-5809fb75f7ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:43.741613 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f0540-cd4f-4583-a70d-5809fb75f7ee service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:43.751073 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1202/2401] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:00:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:00:44.138178 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ddd560-758e-4883-a9d9-ed21c6eac849 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:44.139820 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-69ddd560-758e-4883-a9d9-ed21c6eac849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:44.155102 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ddd560-758e-4883-a9d9-ed21c6eac849 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:44.160094 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f36b7-1be2-4a5a-8f74-f234e9837b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:44.162056 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f36b7-1be2-4a5a-8f74-f234e9837b41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:44.163210 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f36b7-1be2-4a5a-8f74-f234e9837b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:44.163910 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f36b7-1be2-4a5a-8f74-f234e9837b41 admin admin] PATH_INFO: `/v3/projects/87554bfcefad4a7b9e16e4fe956c9c88` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:44.165136 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f36b7-1be2-4a5a-8f74-f234e9837b41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87554bfcefad4a7b9e16e4fe956c9c88)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:44.167128 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f36b7-1be2-4a5a-8f74-f234e9837b41 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:44.218483 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-d03f36b7-1be2-4a5a-8f74-f234e9837b41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87554bfcefad4a7b9e16e4fe956c9c88', 'request_id': 'req-d03f36b7-1be2-4a5a-8f74-f234e9837b41'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:44.224403 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-d03f36b7-1be2-4a5a-8f74-f234e9837b41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87554bfcefad4a7b9e16e4fe956c9c88', 'request_id': 'req-d03f36b7-1be2-4a5a-8f74-f234e9837b41'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:44.232879 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-d03f36b7-1be2-4a5a-8f74-f234e9837b41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87554bfcefad4a7b9e16e4fe956c9c88', 'request_id': 'req-d03f36b7-1be2-4a5a-8f74-f234e9837b41'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:44.245196 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-d03f36b7-1be2-4a5a-8f74-f234e9837b41 admin admin] The token cache is being invalidate because project 87554bfcefad4a7b9e16e4fe956c9c88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:00:44.245486 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-d03f36b7-1be2-4a5a-8f74-f234e9837b41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:44.246118 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-d03f36b7-1be2-4a5a-8f74-f234e9837b41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:44.247701 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1200/2402] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:00:44 2022] DELETE /identity/v3/projects/87554bfcefad4a7b9e16e4fe956c9c88 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:44.252085 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f0540-cd4f-4583-a70d-5809fb75f7ee service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:44.261786 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f0540-cd4f-4583-a70d-5809fb75f7ee service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:44.274172 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:44.321737 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa81da4-4940-40fe-b210-4aec5551d780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:44.322694 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa81da4-4940-40fe-b210-4aec5551d780 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:44.322978 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa81da4-4940-40fe-b210-4aec5551d780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:44.323254 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa81da4-4940-40fe-b210-4aec5551d780 admin admin] PATH_INFO: `/v3/users/64c0e422854f4e84be64dafccfc3359b` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:44.324605 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa81da4-4940-40fe-b210-4aec5551d780 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64c0e422854f4e84be64dafccfc3359b)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:44.326801 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa81da4-4940-40fe-b210-4aec5551d780 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:44.375448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-7fa81da4-4940-40fe-b210-4aec5551d780 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64c0e422854f4e84be64dafccfc3359b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:44.382604 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-7fa81da4-4940-40fe-b210-4aec5551d780 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64c0e422854f4e84be64dafccfc3359b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:44.383261 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-7fa81da4-4940-40fe-b210-4aec5551d780 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64c0e422854f4e84be64dafccfc3359b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:44.396818 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-7fa81da4-4940-40fe-b210-4aec5551d780 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64c0e422854f4e84be64dafccfc3359b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:44.408474 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-7fa81da4-4940-40fe-b210-4aec5551d780 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64c0e422854f4e84be64dafccfc3359b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:44.415378 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1203/2403] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:00:44 2022] DELETE /identity/v3/users/64c0e422854f4e84be64dafccfc3359b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:44.692135 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f36b7-1be2-4a5a-8f74-f234e9837b41 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:44.693666 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-d03f36b7-1be2-4a5a-8f74-f234e9837b41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:44.707261 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f36b7-1be2-4a5a-8f74-f234e9837b41 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:44.754976 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:44.773626 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74707d01-fb11-4303-8fbb-8be600bd66e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:44.774489 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74707d01-fb11-4303-8fbb-8be600bd66e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:44.774907 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74707d01-fb11-4303-8fbb-8be600bd66e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:44.775175 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74707d01-fb11-4303-8fbb-8be600bd66e8 admin admin] PATH_INFO: `/v3/projects/0f7567acb3a4461896dd50adf1d4f416` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:44.776411 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74707d01-fb11-4303-8fbb-8be600bd66e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f7567acb3a4461896dd50adf1d4f416)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:44.778340 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74707d01-fb11-4303-8fbb-8be600bd66e8 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:44.824735 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-74707d01-fb11-4303-8fbb-8be600bd66e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f7567acb3a4461896dd50adf1d4f416', 'request_id': 'req-74707d01-fb11-4303-8fbb-8be600bd66e8'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:44.830075 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-74707d01-fb11-4303-8fbb-8be600bd66e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f7567acb3a4461896dd50adf1d4f416', 'request_id': 'req-74707d01-fb11-4303-8fbb-8be600bd66e8'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:44.839201 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-74707d01-fb11-4303-8fbb-8be600bd66e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f7567acb3a4461896dd50adf1d4f416', 'request_id': 'req-74707d01-fb11-4303-8fbb-8be600bd66e8'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:44.851800 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-74707d01-fb11-4303-8fbb-8be600bd66e8 admin admin] The token cache is being invalidate because project 0f7567acb3a4461896dd50adf1d4f416 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:00:44.852114 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-74707d01-fb11-4303-8fbb-8be600bd66e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:44.855570 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-74707d01-fb11-4303-8fbb-8be600bd66e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:44.857202 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1201/2404] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:00:44 2022] DELETE /identity/v3/projects/0f7567acb3a4461896dd50adf1d4f416 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:44.862058 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcaadbd-bd81-4d80-86dc-2872f32c48e0 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:44.862552 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcaadbd-bd81-4d80-86dc-2872f32c48e0 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:44.862655 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcaadbd-bd81-4d80-86dc-2872f32c48e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:44.903494 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-0fcaadbd-bd81-4d80-86dc-2872f32c48e0 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:44.904673 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-0fcaadbd-bd81-4d80-86dc-2872f32c48e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:44.968252 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1204/2405] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:44.970165 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74707d01-fb11-4303-8fbb-8be600bd66e8 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:44.971337 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-74707d01-fb11-4303-8fbb-8be600bd66e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:44.975187 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37c4ae-e7f4-4729-a0b7-005cd2c54723 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:44.975577 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37c4ae-e7f4-4729-a0b7-005cd2c54723 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:44.977349 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37c4ae-e7f4-4729-a0b7-005cd2c54723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:44.984838 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74707d01-fb11-4303-8fbb-8be600bd66e8 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:44.989582 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266755ae-ec3d-4d57-8a25-385ef84dd9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:44.990635 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266755ae-ec3d-4d57-8a25-385ef84dd9ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:44.990756 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266755ae-ec3d-4d57-8a25-385ef84dd9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:44.991032 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266755ae-ec3d-4d57-8a25-385ef84dd9ea admin admin] PATH_INFO: `/v3/users/fd1ad1d901f641c29c14a25e98a16b7f` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:44.992282 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266755ae-ec3d-4d57-8a25-385ef84dd9ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd1ad1d901f641c29c14a25e98a16b7f)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:44.994218 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266755ae-ec3d-4d57-8a25-385ef84dd9ea admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:45.003107 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-ee37c4ae-e7f4-4729-a0b7-005cd2c54723 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:45.004615 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-ee37c4ae-e7f4-4729-a0b7-005cd2c54723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:45.014818 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1205/2406] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:45.019984 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37c4ae-e7f4-4729-a0b7-005cd2c54723 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:45.031231 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37c4ae-e7f4-4729-a0b7-005cd2c54723 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:45.037086 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c78e1-3f06-4a55-ba4b-815be4f1da5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:45.037787 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c78e1-3f06-4a55-ba4b-815be4f1da5c admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:45.038072 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c78e1-3f06-4a55-ba4b-815be4f1da5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:45.038359 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c78e1-3f06-4a55-ba4b-815be4f1da5c admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:45.039087 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33c78e1-3f06-4a55-ba4b-815be4f1da5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:00:45.039396 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33c78e1-3f06-4a55-ba4b-815be4f1da5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:45.041657 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33c78e1-3f06-4a55-ba4b-815be4f1da5c admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:45.050627 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-266755ae-ec3d-4d57-8a25-385ef84dd9ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd1ad1d901f641c29c14a25e98a16b7f'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:45.051279 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:45.051400 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-266755ae-ec3d-4d57-8a25-385ef84dd9ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd1ad1d901f641c29c14a25e98a16b7f'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:45.057036 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1206/2407] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 12:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:00:45.060287 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c78e1-3f06-4a55-ba4b-815be4f1da5c admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:45.062635 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-f33c78e1-3f06-4a55-ba4b-815be4f1da5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:45.070816 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-266755ae-ec3d-4d57-8a25-385ef84dd9ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd1ad1d901f641c29c14a25e98a16b7f'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:45.076433 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c78e1-3f06-4a55-ba4b-815be4f1da5c admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:45.077960 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-266755ae-ec3d-4d57-8a25-385ef84dd9ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd1ad1d901f641c29c14a25e98a16b7f'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:45.081390 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc2c0d-39ec-4641-bb5e-8d3435c807c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:45.082043 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc2c0d-39ec-4641-bb5e-8d3435c807c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:45.082328 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc2c0d-39ec-4641-bb5e-8d3435c807c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:45.082607 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc2c0d-39ec-4641-bb5e-8d3435c807c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:45.083310 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffc2c0d-39ec-4641-bb5e-8d3435c807c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:45.085803 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffc2c0d-39ec-4641-bb5e-8d3435c807c8 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:45.085981 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-266755ae-ec3d-4d57-8a25-385ef84dd9ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd1ad1d901f641c29c14a25e98a16b7f'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:45.092820 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1202/2408] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:00:44 2022] DELETE /identity/v3/users/fd1ad1d901f641c29c14a25e98a16b7f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:45.098764 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5aca5d-b24f-489b-810f-cccfbcff2ebf None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:45.099058 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5aca5d-b24f-489b-810f-cccfbcff2ebf None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:45.099339 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5aca5d-b24f-489b-810f-cccfbcff2ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:45.115743 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1207/2409] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 12:00:45 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 12:00:45.117629 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-0b5aca5d-b24f-489b-810f-cccfbcff2ebf None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:45.118815 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-0b5aca5d-b24f-489b-810f-cccfbcff2ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:45.120059 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc2c0d-39ec-4641-bb5e-8d3435c807c8 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:45.189302 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc2c0d-39ec-4641-bb5e-8d3435c807c8 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:45.189578 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:45.195309 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90554b3c-0b68-40a0-94b4-7a0400c66b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:45.196115 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90554b3c-0b68-40a0-94b4-7a0400c66b08 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:45.196469 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90554b3c-0b68-40a0-94b4-7a0400c66b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:45.196824 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90554b3c-0b68-40a0-94b4-7a0400c66b08 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:45.197595 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90554b3c-0b68-40a0-94b4-7a0400c66b08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:45.199625 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90554b3c-0b68-40a0-94b4-7a0400c66b08 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:45.216857 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1203/2410] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 12:00:45.226931 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5aca5d-b24f-489b-810f-cccfbcff2ebf None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:45.228625 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-0b5aca5d-b24f-489b-810f-cccfbcff2ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:45.229064 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1208/2411] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 12:00:45 2022] POST /identity/v3/users => generated 291 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 12:00:45.233243 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90554b3c-0b68-40a0-94b4-7a0400c66b08 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:45.244512 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90554b3c-0b68-40a0-94b4-7a0400c66b08 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:45.252580 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5e6b3-d4cb-4df6-8e6f-26dceb2ea2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:45.252580 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5e6b3-d4cb-4df6-8e6f-26dceb2ea2fa admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:45.252580 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5e6b3-d4cb-4df6-8e6f-26dceb2ea2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:45.252580 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5e6b3-d4cb-4df6-8e6f-26dceb2ea2fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:45.253045 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a5e6b3-d4cb-4df6-8e6f-26dceb2ea2fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:45.253976 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a5e6b3-d4cb-4df6-8e6f-26dceb2ea2fa admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:45.265357 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1209/2412] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:00:45.269371 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5e6b3-d4cb-4df6-8e6f-26dceb2ea2fa admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:45.280922 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5e6b3-d4cb-4df6-8e6f-26dceb2ea2fa admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:45.287542 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8308ef9-5e55-4804-85bc-78676e3abdb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:45.289143 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8308ef9-5e55-4804-85bc-78676e3abdb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:45.289143 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8308ef9-5e55-4804-85bc-78676e3abdb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:45.289485 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8308ef9-5e55-4804-85bc-78676e3abdb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:45.290646 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8308ef9-5e55-4804-85bc-78676e3abdb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:45.293441 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8308ef9-5e55-4804-85bc-78676e3abdb2 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:45.306596 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1210/2413] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 12:00:45.309306 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5aca5d-b24f-489b-810f-cccfbcff2ebf None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:45.310529 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8308ef9-5e55-4804-85bc-78676e3abdb2 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:45.313013 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e347a44-4f4e-461c-98c0-26a02b2d9b1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:45.313662 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e347a44-4f4e-461c-98c0-26a02b2d9b1e service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:45.313948 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e347a44-4f4e-461c-98c0-26a02b2d9b1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:45.314227 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e347a44-4f4e-461c-98c0-26a02b2d9b1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:45.320611 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8308ef9-5e55-4804-85bc-78676e3abdb2 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:45.324889 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e347a44-4f4e-461c-98c0-26a02b2d9b1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:45.325945 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d5b7d-416f-4fd3-ad07-ab9a8c1bacd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:45.326571 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e347a44-4f4e-461c-98c0-26a02b2d9b1e service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:45.326862 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d5b7d-416f-4fd3-ad07-ab9a8c1bacd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:45.327146 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d5b7d-416f-4fd3-ad07-ab9a8c1bacd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:45.327435 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d5b7d-416f-4fd3-ad07-ab9a8c1bacd2 admin admin] PATH_INFO: `/v3/projects/0d2fc0f601014a9490dbe624bfae1afc/users/a16680f61ab1471e9fcc6a49dc3c3803/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:45.337155 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1204/2414] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:00:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:00:45.344922 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d5b7d-416f-4fd3-ad07-ab9a8c1bacd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d2fc0f601014a9490dbe624bfae1afc, user_id=a16680f61ab1471e9fcc6a49dc3c3803, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:45.347625 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d5b7d-416f-4fd3-ad07-ab9a8c1bacd2 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:45.371537 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1211/2415] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:00:45 2022] PUT /identity/v3/projects/0d2fc0f601014a9490dbe624bfae1afc/users/a16680f61ab1471e9fcc6a49dc3c3803/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 12:00:45.374497 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d2137-18ef-42be-abf7-91b357dace58 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:45.374792 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d2137-18ef-42be-abf7-91b357dace58 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:45.375073 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d2137-18ef-42be-abf7-91b357dace58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:45.406207 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-f61d2137-18ef-42be-abf7-91b357dace58 None None] MFA Rules not processed for user `a16680f61ab1471e9fcc6a49dc3c3803`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:45.407352 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-f61d2137-18ef-42be-abf7-91b357dace58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:45.490209 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1205/2416] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:45.494935 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d5b7d-416f-4fd3-ad07-ab9a8c1bacd2 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:45.563034 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d5b7d-416f-4fd3-ad07-ab9a8c1bacd2 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:45.569444 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c3882-bfde-4ca9-afc2-428f248dc695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:45.570946 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c3882-bfde-4ca9-afc2-428f248dc695 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:45.571417 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c3882-bfde-4ca9-afc2-428f248dc695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:45.571856 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c3882-bfde-4ca9-afc2-428f248dc695 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:45.572668 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c3882-bfde-4ca9-afc2-428f248dc695 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:45.575037 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c3882-bfde-4ca9-afc2-428f248dc695 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:45.609558 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1212/2417] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 12:00:45 2022] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:00:45.613383 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d2137-18ef-42be-abf7-91b357dace58 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:45.626609 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d2137-18ef-42be-abf7-91b357dace58 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:45.644575 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c3882-bfde-4ca9-afc2-428f248dc695 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:45.646420 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-4c1c3882-bfde-4ca9-afc2-428f248dc695 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:45.657198 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:45.730425 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebee8d2-6719-4fd5-a7df-6c9be29c1cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:45.731518 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebee8d2-6719-4fd5-a7df-6c9be29c1cad admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:45.731986 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebee8d2-6719-4fd5-a7df-6c9be29c1cad admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:45.733001 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebee8d2-6719-4fd5-a7df-6c9be29c1cad admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:45.733242 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebee8d2-6719-4fd5-a7df-6c9be29c1cad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:45.735367 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebee8d2-6719-4fd5-a7df-6c9be29c1cad admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:45.760208 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1206/2418] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 12:00:45 2022] POST /identity/v3/users => generated 297 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 12:00:45.760685 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c3882-bfde-4ca9-afc2-428f248dc695 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:45.767408 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebee8d2-6719-4fd5-a7df-6c9be29c1cad admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:45.768461 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f6345-64e6-4072-91ab-09cd52bc0446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:45.769422 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f6345-64e6-4072-91ab-09cd52bc0446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:45.769793 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f6345-64e6-4072-91ab-09cd52bc0446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:45.770128 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f6345-64e6-4072-91ab-09cd52bc0446 admin admin] PATH_INFO: `/v3/projects/df6d5157a2cf4a4397946886b6ede998` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:45.771380 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f6345-64e6-4072-91ab-09cd52bc0446 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df6d5157a2cf4a4397946886b6ede998)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:45.773694 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f6345-64e6-4072-91ab-09cd52bc0446 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:45.777498 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebee8d2-6719-4fd5-a7df-6c9be29c1cad admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:45.782174 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede95ba-37fc-4011-95e1-a41ea46d5b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:45.782827 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede95ba-37fc-4011-95e1-a41ea46d5b32 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:45.783109 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede95ba-37fc-4011-95e1-a41ea46d5b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:45.783384 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede95ba-37fc-4011-95e1-a41ea46d5b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:45.784155 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede95ba-37fc-4011-95e1-a41ea46d5b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:45.785769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede95ba-37fc-4011-95e1-a41ea46d5b32 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:45.788862 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:45.800848 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1207/2419] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 12:00:45.806925 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede95ba-37fc-4011-95e1-a41ea46d5b32 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:45.816537 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede95ba-37fc-4011-95e1-a41ea46d5b32 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:45.824979 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-4a1f6345-64e6-4072-91ab-09cd52bc0446 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df6d5157a2cf4a4397946886b6ede998', 'request_id': 'req-4a1f6345-64e6-4072-91ab-09cd52bc0446'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:45.835244 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-4a1f6345-64e6-4072-91ab-09cd52bc0446 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df6d5157a2cf4a4397946886b6ede998', 'request_id': 'req-4a1f6345-64e6-4072-91ab-09cd52bc0446'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:45.843493 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-4a1f6345-64e6-4072-91ab-09cd52bc0446 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df6d5157a2cf4a4397946886b6ede998', 'request_id': 'req-4a1f6345-64e6-4072-91ab-09cd52bc0446'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:45.856096 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-4a1f6345-64e6-4072-91ab-09cd52bc0446 admin admin] The token cache is being invalidate because project df6d5157a2cf4a4397946886b6ede998 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:00:45.856396 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-4a1f6345-64e6-4072-91ab-09cd52bc0446 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:45.857053 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-4a1f6345-64e6-4072-91ab-09cd52bc0446 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:45.858623 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1213/2420] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:00:45 2022] DELETE /identity/v3/projects/df6d5157a2cf4a4397946886b6ede998 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:45.882364 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51339c9-d349-4454-b480-98c1218d768c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:45.883415 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51339c9-d349-4454-b480-98c1218d768c admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:45.883973 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51339c9-d349-4454-b480-98c1218d768c admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:45.884338 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51339c9-d349-4454-b480-98c1218d768c admin admin] PATH_INFO: `/v3/projects/10d915877646405ebb14440ddf135be3/users/8200a475735747e0a384c6dfeec1c875/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:45.905027 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51339c9-d349-4454-b480-98c1218d768c admin admin] RBAC: Authorizing `identity:create_grant(project_id=10d915877646405ebb14440ddf135be3, user_id=8200a475735747e0a384c6dfeec1c875, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:45.907792 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51339c9-d349-4454-b480-98c1218d768c admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:45.925792 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1208/2421] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:00:45 2022] PUT /identity/v3/projects/10d915877646405ebb14440ddf135be3/users/8200a475735747e0a384c6dfeec1c875/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:45.930491 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f6345-64e6-4072-91ab-09cd52bc0446 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:45.932097 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-4a1f6345-64e6-4072-91ab-09cd52bc0446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:45.946528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f6345-64e6-4072-91ab-09cd52bc0446 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:46.013046 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa1ecd-ba1a-459b-bed8-87cd2c3b1e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:46.013741 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa1ecd-ba1a-459b-bed8-87cd2c3b1e5e admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:46.014030 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa1ecd-ba1a-459b-bed8-87cd2c3b1e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:46.014307 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa1ecd-ba1a-459b-bed8-87cd2c3b1e5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:46.015043 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa1ecd-ba1a-459b-bed8-87cd2c3b1e5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:46.016701 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa1ecd-ba1a-459b-bed8-87cd2c3b1e5e admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:46.035741 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1214/2422] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:00:46.037943 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51339c9-d349-4454-b480-98c1218d768c admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:46.049857 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51339c9-d349-4454-b480-98c1218d768c admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:46.055184 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39a7eb-9404-4246-93e9-180d6b23602b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:46.056165 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39a7eb-9404-4246-93e9-180d6b23602b admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:46.056446 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39a7eb-9404-4246-93e9-180d6b23602b admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:46.056726 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39a7eb-9404-4246-93e9-180d6b23602b admin admin] PATH_INFO: `/v3/projects/10d915877646405ebb14440ddf135be3/users/8200a475735747e0a384c6dfeec1c875/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:46.058719 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a39a7eb-9404-4246-93e9-180d6b23602b admin admin] RBAC: Authorizing `identity:create_grant(project_id=10d915877646405ebb14440ddf135be3, user_id=8200a475735747e0a384c6dfeec1c875, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:46.061559 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a39a7eb-9404-4246-93e9-180d6b23602b admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:46.074720 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1209/2423] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:00:46 2022] PUT /identity/v3/projects/10d915877646405ebb14440ddf135be3/users/8200a475735747e0a384c6dfeec1c875/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:46.085518 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf60bf5-35fd-4bd5-a655-23f188e8d6f7 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:46.085817 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf60bf5-35fd-4bd5-a655-23f188e8d6f7 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:46.086102 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf60bf5-35fd-4bd5-a655-23f188e8d6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:46.113559 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-caf60bf5-35fd-4bd5-a655-23f188e8d6f7 None None] MFA Rules not processed for user `8200a475735747e0a384c6dfeec1c875`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:46.114769 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-caf60bf5-35fd-4bd5-a655-23f188e8d6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:46.141549 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:46.188319 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1215/2424] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:46.201293 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39a7eb-9404-4246-93e9-180d6b23602b admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:46.202999 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-0a39a7eb-9404-4246-93e9-180d6b23602b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:46.261455 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39a7eb-9404-4246-93e9-180d6b23602b admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:46.265203 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f5d2d-ba02-438d-8868-06ee54b1525e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:46.265858 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f5d2d-ba02-438d-8868-06ee54b1525e service cinder] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:46.266143 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f5d2d-ba02-438d-8868-06ee54b1525e service cinder] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:46.266414 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f5d2d-ba02-438d-8868-06ee54b1525e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:46.276703 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f5d2d-ba02-438d-8868-06ee54b1525e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:46.278135 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f5d2d-ba02-438d-8868-06ee54b1525e service cinder] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:46.289163 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1210/2425] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:00:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:00:46.614946 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf60bf5-35fd-4bd5-a655-23f188e8d6f7 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:46.624775 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf60bf5-35fd-4bd5-a655-23f188e8d6f7 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:46.629344 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba836829-176a-4b41-8138-d2a9b1b29966 tempest-VolumeQuotaClassesTest-1046597559 tempest-VolumeQuotaClassesTest-1046597559-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8200a475735747e0a384c6dfeec1c875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10d915877646405ebb14440ddf135be3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:46.630002 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba836829-176a-4b41-8138-d2a9b1b29966 tempest-VolumeQuotaClassesTest-1046597559 tempest-VolumeQuotaClassesTest-1046597559-project-admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:46.630287 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba836829-176a-4b41-8138-d2a9b1b29966 tempest-VolumeQuotaClassesTest-1046597559 tempest-VolumeQuotaClassesTest-1046597559-project-admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:46.630561 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba836829-176a-4b41-8138-d2a9b1b29966 tempest-VolumeQuotaClassesTest-1046597559 tempest-VolumeQuotaClassesTest-1046597559-project-admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:46.631836 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba836829-176a-4b41-8138-d2a9b1b29966 tempest-VolumeQuotaClassesTest-1046597559 tempest-VolumeQuotaClassesTest-1046597559-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:00:46.632141 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba836829-176a-4b41-8138-d2a9b1b29966 tempest-VolumeQuotaClassesTest-1046597559 tempest-VolumeQuotaClassesTest-1046597559-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:46.633734 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba836829-176a-4b41-8138-d2a9b1b29966 tempest-VolumeQuotaClassesTest-1046597559 tempest-VolumeQuotaClassesTest-1046597559-project-admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:46.645558 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1216/2426] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 12:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:00:46.651106 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f5d2d-ba02-438d-8868-06ee54b1525e service cinder] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:46.660972 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f5d2d-ba02-438d-8868-06ee54b1525e service cinder] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:46.665639 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ffa7f-c259-4686-871d-cc7e057b3d70 tempest-VolumeQuotaClassesTest-1046597559 tempest-VolumeQuotaClassesTest-1046597559-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8200a475735747e0a384c6dfeec1c875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10d915877646405ebb14440ddf135be3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:46.666299 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ffa7f-c259-4686-871d-cc7e057b3d70 tempest-VolumeQuotaClassesTest-1046597559 tempest-VolumeQuotaClassesTest-1046597559-project-admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:46.666582 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ffa7f-c259-4686-871d-cc7e057b3d70 tempest-VolumeQuotaClassesTest-1046597559 tempest-VolumeQuotaClassesTest-1046597559-project-admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:46.666867 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ffa7f-c259-4686-871d-cc7e057b3d70 tempest-VolumeQuotaClassesTest-1046597559 tempest-VolumeQuotaClassesTest-1046597559-project-admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:46.667605 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ffa7f-c259-4686-871d-cc7e057b3d70 tempest-VolumeQuotaClassesTest-1046597559 tempest-VolumeQuotaClassesTest-1046597559-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:46.669515 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ffa7f-c259-4686-871d-cc7e057b3d70 tempest-VolumeQuotaClassesTest-1046597559 tempest-VolumeQuotaClassesTest-1046597559-project-admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:46.696759 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1211/2427] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 12:00:46 2022] POST /identity/v3/projects => generated 353 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:00:46.700812 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba836829-176a-4b41-8138-d2a9b1b29966 tempest-VolumeQuotaClassesTest-1046597559 tempest-VolumeQuotaClassesTest-1046597559-project-admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:46.711829 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba836829-176a-4b41-8138-d2a9b1b29966 tempest-VolumeQuotaClassesTest-1046597559 tempest-VolumeQuotaClassesTest-1046597559-project-admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:46.777243 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19160c-90b8-4174-b0f3-a2a1cbf13f90 tempest-VolumeQuotaClassesTest-1046597559 tempest-VolumeQuotaClassesTest-1046597559-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8200a475735747e0a384c6dfeec1c875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10d915877646405ebb14440ddf135be3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:46.778274 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19160c-90b8-4174-b0f3-a2a1cbf13f90 tempest-VolumeQuotaClassesTest-1046597559 tempest-VolumeQuotaClassesTest-1046597559-project-admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:46.779034 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19160c-90b8-4174-b0f3-a2a1cbf13f90 tempest-VolumeQuotaClassesTest-1046597559 tempest-VolumeQuotaClassesTest-1046597559-project-admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:46.779776 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19160c-90b8-4174-b0f3-a2a1cbf13f90 tempest-VolumeQuotaClassesTest-1046597559 tempest-VolumeQuotaClassesTest-1046597559-project-admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:46.781081 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19160c-90b8-4174-b0f3-a2a1cbf13f90 tempest-VolumeQuotaClassesTest-1046597559 tempest-VolumeQuotaClassesTest-1046597559-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:00:46.781448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19160c-90b8-4174-b0f3-a2a1cbf13f90 tempest-VolumeQuotaClassesTest-1046597559 tempest-VolumeQuotaClassesTest-1046597559-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:46.784152 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19160c-90b8-4174-b0f3-a2a1cbf13f90 tempest-VolumeQuotaClassesTest-1046597559 tempest-VolumeQuotaClassesTest-1046597559-project-admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:46.798366 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1217/2428] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 12:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:00:46.844144 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ffa7f-c259-4686-871d-cc7e057b3d70 tempest-VolumeQuotaClassesTest-1046597559 tempest-VolumeQuotaClassesTest-1046597559-project-admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:46.857370 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ffa7f-c259-4686-871d-cc7e057b3d70 tempest-VolumeQuotaClassesTest-1046597559 tempest-VolumeQuotaClassesTest-1046597559-project-admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:46.864299 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f31452-bb90-47da-9d19-fb0de0f4ba64 tempest-VolumeQuotaClassesTest-1046597559 tempest-VolumeQuotaClassesTest-1046597559-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8200a475735747e0a384c6dfeec1c875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10d915877646405ebb14440ddf135be3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:46.865178 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f31452-bb90-47da-9d19-fb0de0f4ba64 tempest-VolumeQuotaClassesTest-1046597559 tempest-VolumeQuotaClassesTest-1046597559-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:46.866014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f31452-bb90-47da-9d19-fb0de0f4ba64 tempest-VolumeQuotaClassesTest-1046597559 tempest-VolumeQuotaClassesTest-1046597559-project-admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:46.866285 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f31452-bb90-47da-9d19-fb0de0f4ba64 tempest-VolumeQuotaClassesTest-1046597559 tempest-VolumeQuotaClassesTest-1046597559-project-admin] PATH_INFO: `/v3/projects/9cf718ca8f7d408487d578b81da2dcf9` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:46.867525 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f31452-bb90-47da-9d19-fb0de0f4ba64 tempest-VolumeQuotaClassesTest-1046597559 tempest-VolumeQuotaClassesTest-1046597559-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9cf718ca8f7d408487d578b81da2dcf9)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:46.869433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f31452-bb90-47da-9d19-fb0de0f4ba64 tempest-VolumeQuotaClassesTest-1046597559 tempest-VolumeQuotaClassesTest-1046597559-project-admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:46.921321 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:46.925330 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-48f31452-bb90-47da-9d19-fb0de0f4ba64 tempest-VolumeQuotaClassesTest-1046597559 tempest-VolumeQuotaClassesTest-1046597559-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cf718ca8f7d408487d578b81da2dcf9', 'request_id': 'req-48f31452-bb90-47da-9d19-fb0de0f4ba64'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:46.932727 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-48f31452-bb90-47da-9d19-fb0de0f4ba64 tempest-VolumeQuotaClassesTest-1046597559 tempest-VolumeQuotaClassesTest-1046597559-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cf718ca8f7d408487d578b81da2dcf9', 'request_id': 'req-48f31452-bb90-47da-9d19-fb0de0f4ba64'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:46.945713 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-48f31452-bb90-47da-9d19-fb0de0f4ba64 tempest-VolumeQuotaClassesTest-1046597559 tempest-VolumeQuotaClassesTest-1046597559-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cf718ca8f7d408487d578b81da2dcf9', 'request_id': 'req-48f31452-bb90-47da-9d19-fb0de0f4ba64'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:46.957979 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-48f31452-bb90-47da-9d19-fb0de0f4ba64 tempest-VolumeQuotaClassesTest-1046597559 tempest-VolumeQuotaClassesTest-1046597559-project-admin] The token cache is being invalidate because project 9cf718ca8f7d408487d578b81da2dcf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:00:46.958272 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-48f31452-bb90-47da-9d19-fb0de0f4ba64 tempest-VolumeQuotaClassesTest-1046597559 tempest-VolumeQuotaClassesTest-1046597559-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:46.958954 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-48f31452-bb90-47da-9d19-fb0de0f4ba64 tempest-VolumeQuotaClassesTest-1046597559 tempest-VolumeQuotaClassesTest-1046597559-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:46.960613 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1212/2429] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:00:46 2022] DELETE /identity/v3/projects/9cf718ca8f7d408487d578b81da2dcf9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:47.203626 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19160c-90b8-4174-b0f3-a2a1cbf13f90 tempest-VolumeQuotaClassesTest-1046597559 tempest-VolumeQuotaClassesTest-1046597559-project-admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:47.205382 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-ce19160c-90b8-4174-b0f3-a2a1cbf13f90 tempest-VolumeQuotaClassesTest-1046597559 tempest-VolumeQuotaClassesTest-1046597559-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:47.297326 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19160c-90b8-4174-b0f3-a2a1cbf13f90 tempest-VolumeQuotaClassesTest-1046597559 tempest-VolumeQuotaClassesTest-1046597559-project-admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:47.371863 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:47.394251 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4b8d8-44e0-4aa0-b60f-4c5207266988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:47.396270 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4b8d8-44e0-4aa0-b60f-4c5207266988 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:47.397578 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4b8d8-44e0-4aa0-b60f-4c5207266988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:47.398075 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4b8d8-44e0-4aa0-b60f-4c5207266988 admin admin] PATH_INFO: `/v3/users/a16680f61ab1471e9fcc6a49dc3c3803` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:47.399776 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f4b8d8-44e0-4aa0-b60f-4c5207266988 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a16680f61ab1471e9fcc6a49dc3c3803)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:47.403139 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f4b8d8-44e0-4aa0-b60f-4c5207266988 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:47.465692 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-c2f4b8d8-44e0-4aa0-b60f-4c5207266988 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a16680f61ab1471e9fcc6a49dc3c3803'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:47.473940 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-c2f4b8d8-44e0-4aa0-b60f-4c5207266988 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a16680f61ab1471e9fcc6a49dc3c3803'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:47.474657 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-c2f4b8d8-44e0-4aa0-b60f-4c5207266988 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a16680f61ab1471e9fcc6a49dc3c3803'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:47.491533 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-c2f4b8d8-44e0-4aa0-b60f-4c5207266988 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a16680f61ab1471e9fcc6a49dc3c3803'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:47.502358 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-c2f4b8d8-44e0-4aa0-b60f-4c5207266988 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a16680f61ab1471e9fcc6a49dc3c3803'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:47.512276 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1218/2430] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:00:47 2022] DELETE /identity/v3/users/a16680f61ab1471e9fcc6a49dc3c3803 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:47.516645 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283c6e1-2be4-48fa-9c34-893345d76f48 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:47.516938 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283c6e1-2be4-48fa-9c34-893345d76f48 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:47.517222 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283c6e1-2be4-48fa-9c34-893345d76f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:47.536531 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-1283c6e1-2be4-48fa-9c34-893345d76f48 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:47.537901 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-1283c6e1-2be4-48fa-9c34-893345d76f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:47.602869 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1213/2431] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:47.611958 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4b8d8-44e0-4aa0-b60f-4c5207266988 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:47.613374 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-c2f4b8d8-44e0-4aa0-b60f-4c5207266988 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:47.671379 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4b8d8-44e0-4aa0-b60f-4c5207266988 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:47.674993 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ac287-03dc-4bc4-968a-6234a2b777a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:47.675660 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ac287-03dc-4bc4-968a-6234a2b777a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:47.675943 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ac287-03dc-4bc4-968a-6234a2b777a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:47.676212 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ac287-03dc-4bc4-968a-6234a2b777a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:47.685568 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ac287-03dc-4bc4-968a-6234a2b777a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:47.686978 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ac287-03dc-4bc4-968a-6234a2b777a9 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:47.696939 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1219/2432] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:00:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:00:47.983188 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283c6e1-2be4-48fa-9c34-893345d76f48 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:47.984688 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-1283c6e1-2be4-48fa-9c34-893345d76f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:47.997755 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283c6e1-2be4-48fa-9c34-893345d76f48 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:48.002754 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a79de1-229a-4be1-8d7a-8633097d9cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:48.003666 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a79de1-229a-4be1-8d7a-8633097d9cab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:48.003950 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a79de1-229a-4be1-8d7a-8633097d9cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:48.004226 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a79de1-229a-4be1-8d7a-8633097d9cab admin admin] PATH_INFO: `/v3/projects/0d2fc0f601014a9490dbe624bfae1afc` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:48.005418 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a79de1-229a-4be1-8d7a-8633097d9cab admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d2fc0f601014a9490dbe624bfae1afc)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:48.007413 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a79de1-229a-4be1-8d7a-8633097d9cab admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:48.054344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-32a79de1-229a-4be1-8d7a-8633097d9cab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d2fc0f601014a9490dbe624bfae1afc', 'request_id': 'req-32a79de1-229a-4be1-8d7a-8633097d9cab'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:48.059824 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-32a79de1-229a-4be1-8d7a-8633097d9cab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d2fc0f601014a9490dbe624bfae1afc', 'request_id': 'req-32a79de1-229a-4be1-8d7a-8633097d9cab'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:48.067702 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-32a79de1-229a-4be1-8d7a-8633097d9cab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d2fc0f601014a9490dbe624bfae1afc', 'request_id': 'req-32a79de1-229a-4be1-8d7a-8633097d9cab'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:48.078968 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-32a79de1-229a-4be1-8d7a-8633097d9cab admin admin] The token cache is being invalidate because project 0d2fc0f601014a9490dbe624bfae1afc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:00:48.079257 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-32a79de1-229a-4be1-8d7a-8633097d9cab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:48.079892 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-32a79de1-229a-4be1-8d7a-8633097d9cab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:48.081443 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1214/2433] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:00:47 2022] DELETE /identity/v3/projects/0d2fc0f601014a9490dbe624bfae1afc => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:48.085368 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ac287-03dc-4bc4-968a-6234a2b777a9 service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:48.094916 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ac287-03dc-4bc4-968a-6234a2b777a9 service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:48.152742 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249bd22-43ce-4f2c-868d-271427a16600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:48.153676 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249bd22-43ce-4f2c-868d-271427a16600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:48.154023 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249bd22-43ce-4f2c-868d-271427a16600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:48.154371 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249bd22-43ce-4f2c-868d-271427a16600 admin admin] PATH_INFO: `/v3/users/8200a475735747e0a384c6dfeec1c875` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:48.155573 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5249bd22-43ce-4f2c-868d-271427a16600 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8200a475735747e0a384c6dfeec1c875)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:48.157500 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5249bd22-43ce-4f2c-868d-271427a16600 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:48.168545 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:48.211328 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-5249bd22-43ce-4f2c-868d-271427a16600 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8200a475735747e0a384c6dfeec1c875'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:48.218204 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-5249bd22-43ce-4f2c-868d-271427a16600 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8200a475735747e0a384c6dfeec1c875'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:48.218850 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-5249bd22-43ce-4f2c-868d-271427a16600 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8200a475735747e0a384c6dfeec1c875'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:48.231197 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-5249bd22-43ce-4f2c-868d-271427a16600 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8200a475735747e0a384c6dfeec1c875'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:48.238002 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-5249bd22-43ce-4f2c-868d-271427a16600 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8200a475735747e0a384c6dfeec1c875'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:48.244078 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1220/2434] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:00:48 2022] DELETE /identity/v3/users/8200a475735747e0a384c6dfeec1c875 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:48.509176 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a79de1-229a-4be1-8d7a-8633097d9cab admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:48.510672 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-32a79de1-229a-4be1-8d7a-8633097d9cab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:48.525720 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a79de1-229a-4be1-8d7a-8633097d9cab admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:48.578786 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:48.584660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1cee9b-f565-4ea8-b352-a47f930396d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:48.585568 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1cee9b-f565-4ea8-b352-a47f930396d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:48.585837 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1cee9b-f565-4ea8-b352-a47f930396d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:48.586115 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1cee9b-f565-4ea8-b352-a47f930396d2 admin admin] PATH_INFO: `/v3/projects/10d915877646405ebb14440ddf135be3` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:48.587371 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1cee9b-f565-4ea8-b352-a47f930396d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10d915877646405ebb14440ddf135be3)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:48.590241 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1cee9b-f565-4ea8-b352-a47f930396d2 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:48.640480 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-6f1cee9b-f565-4ea8-b352-a47f930396d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10d915877646405ebb14440ddf135be3', 'request_id': 'req-6f1cee9b-f565-4ea8-b352-a47f930396d2'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:48.646616 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-6f1cee9b-f565-4ea8-b352-a47f930396d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10d915877646405ebb14440ddf135be3', 'request_id': 'req-6f1cee9b-f565-4ea8-b352-a47f930396d2'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:48.655194 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-6f1cee9b-f565-4ea8-b352-a47f930396d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10d915877646405ebb14440ddf135be3', 'request_id': 'req-6f1cee9b-f565-4ea8-b352-a47f930396d2'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:48.666517 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-6f1cee9b-f565-4ea8-b352-a47f930396d2 admin admin] The token cache is being invalidate because project 10d915877646405ebb14440ddf135be3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:00:48.666838 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-6f1cee9b-f565-4ea8-b352-a47f930396d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:48.667466 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-6f1cee9b-f565-4ea8-b352-a47f930396d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:48.669041 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1215/2435] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:00:48 2022] DELETE /identity/v3/projects/10d915877646405ebb14440ddf135be3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:48.675980 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bed77d-dd96-4bb4-bc2d-0c3f4fc414c4 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:48.675980 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bed77d-dd96-4bb4-bc2d-0c3f4fc414c4 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:48.675980 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bed77d-dd96-4bb4-bc2d-0c3f4fc414c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:48.693288 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-23bed77d-dd96-4bb4-bc2d-0c3f4fc414c4 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:48.695015 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-23bed77d-dd96-4bb4-bc2d-0c3f4fc414c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:48.754800 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1221/2436] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:48.763834 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc4d7d-a2ee-4db7-b9be-28037cacc640 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:48.764693 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc4d7d-a2ee-4db7-b9be-28037cacc640 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:48.765273 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc4d7d-a2ee-4db7-b9be-28037cacc640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:48.787311 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-15bc4d7d-a2ee-4db7-b9be-28037cacc640 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:48.788534 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-15bc4d7d-a2ee-4db7-b9be-28037cacc640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:48.796577 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1216/2437] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:48.800419 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bed77d-dd96-4bb4-bc2d-0c3f4fc414c4 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:48.810267 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bed77d-dd96-4bb4-bc2d-0c3f4fc414c4 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:48.817112 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305b660-d40c-4f53-a4ae-82002773f8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:48.817833 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305b660-d40c-4f53-a4ae-82002773f8e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:48.818200 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305b660-d40c-4f53-a4ae-82002773f8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:48.819075 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305b660-d40c-4f53-a4ae-82002773f8e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:48.819887 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305b660-d40c-4f53-a4ae-82002773f8e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:00:48.820259 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305b660-d40c-4f53-a4ae-82002773f8e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:48.821895 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305b660-d40c-4f53-a4ae-82002773f8e1 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:48.837637 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1222/2438] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 12:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:00:48.838967 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc4d7d-a2ee-4db7-b9be-28037cacc640 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:48.848532 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc4d7d-a2ee-4db7-b9be-28037cacc640 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:48.853571 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfdb8e1-1773-4749-aa0f-04278426e23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:48.854259 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdb8e1-1773-4749-aa0f-04278426e23b admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:48.854593 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdb8e1-1773-4749-aa0f-04278426e23b admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:48.854948 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdb8e1-1773-4749-aa0f-04278426e23b admin admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:48.855709 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfdb8e1-1773-4749-aa0f-04278426e23b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:48.857861 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfdb8e1-1773-4749-aa0f-04278426e23b admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:48.885376 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1217/2439] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 12:00:48 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:00:48.889501 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305b660-d40c-4f53-a4ae-82002773f8e1 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:48.907352 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305b660-d40c-4f53-a4ae-82002773f8e1 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:48.965299 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88055b6-50dc-4686-81ad-2f5a472cabbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:48.966054 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88055b6-50dc-4686-81ad-2f5a472cabbb admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:48.966405 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88055b6-50dc-4686-81ad-2f5a472cabbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:48.966744 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88055b6-50dc-4686-81ad-2f5a472cabbb admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:48.967543 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88055b6-50dc-4686-81ad-2f5a472cabbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:48.969616 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88055b6-50dc-4686-81ad-2f5a472cabbb admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:48.991405 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1223/2440] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 12:00:48 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:00:48.995485 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfdb8e1-1773-4749-aa0f-04278426e23b admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:49.009092 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfdb8e1-1773-4749-aa0f-04278426e23b admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:49.013799 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c57fe-4549-4cff-bd9a-b12fd5a722e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:49.014519 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c57fe-4549-4cff-bd9a-b12fd5a722e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:49.014750 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c57fe-4549-4cff-bd9a-b12fd5a722e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:49.015032 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c57fe-4549-4cff-bd9a-b12fd5a722e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:49.015793 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c57fe-4549-4cff-bd9a-b12fd5a722e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:49.017390 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c57fe-4549-4cff-bd9a-b12fd5a722e3 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:49.031924 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1218/2441] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:00:49.033117 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88055b6-50dc-4686-81ad-2f5a472cabbb admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:49.040729 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:49.043821 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88055b6-50dc-4686-81ad-2f5a472cabbb admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:49.050559 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d086ac-d5ce-49ae-b879-53850c154133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:49.051804 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d086ac-d5ce-49ae-b879-53850c154133 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:49.051804 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d086ac-d5ce-49ae-b879-53850c154133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:49.052051 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d086ac-d5ce-49ae-b879-53850c154133 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:49.053240 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d086ac-d5ce-49ae-b879-53850c154133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:49.054882 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d086ac-d5ce-49ae-b879-53850c154133 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:49.065789 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1224/2442] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:00:49.070858 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c57fe-4549-4cff-bd9a-b12fd5a722e3 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:49.081600 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c57fe-4549-4cff-bd9a-b12fd5a722e3 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:49.086750 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc15f55-b1e7-4b42-87fb-5c28cd086484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:49.087660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc15f55-b1e7-4b42-87fb-5c28cd086484 admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:49.087942 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc15f55-b1e7-4b42-87fb-5c28cd086484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:49.088215 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc15f55-b1e7-4b42-87fb-5c28cd086484 admin admin] PATH_INFO: `/v3/projects/23d273d531924bff8f7f9ac714e43f62/users/c8aabfc182d94f93a69e5ecaf0484dc4/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:49.103579 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc15f55-b1e7-4b42-87fb-5c28cd086484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23d273d531924bff8f7f9ac714e43f62, user_id=c8aabfc182d94f93a69e5ecaf0484dc4, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:49.106237 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc15f55-b1e7-4b42-87fb-5c28cd086484 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:49.130100 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1219/2443] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:00:49 2022] PUT /identity/v3/projects/23d273d531924bff8f7f9ac714e43f62/users/c8aabfc182d94f93a69e5ecaf0484dc4/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:49.132599 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898418d-1d6e-4132-86e9-757b980a18e8 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:49.133189 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898418d-1d6e-4132-86e9-757b980a18e8 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:49.133636 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898418d-1d6e-4132-86e9-757b980a18e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:49.162766 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-3898418d-1d6e-4132-86e9-757b980a18e8 None None] MFA Rules not processed for user `c8aabfc182d94f93a69e5ecaf0484dc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:49.164436 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-3898418d-1d6e-4132-86e9-757b980a18e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:49.244432 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1225/2444] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:49.248978 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc15f55-b1e7-4b42-87fb-5c28cd086484 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:49.313972 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc15f55-b1e7-4b42-87fb-5c28cd086484 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:49.319406 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e240103-eae3-4c88-9795-20a9393455dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:49.320106 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e240103-eae3-4c88-9795-20a9393455dd admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:49.320392 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e240103-eae3-4c88-9795-20a9393455dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:49.320667 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e240103-eae3-4c88-9795-20a9393455dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:49.321356 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e240103-eae3-4c88-9795-20a9393455dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:49.323272 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e240103-eae3-4c88-9795-20a9393455dd admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:49.351102 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1220/2445] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 12:00:49 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:00:49.355129 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898418d-1d6e-4132-86e9-757b980a18e8 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:49.367284 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898418d-1d6e-4132-86e9-757b980a18e8 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:49.424078 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654edfcd-e2aa-4121-b2cf-c3a70b170451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:49.424745 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654edfcd-e2aa-4121-b2cf-c3a70b170451 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:49.425031 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654edfcd-e2aa-4121-b2cf-c3a70b170451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:49.425312 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654edfcd-e2aa-4121-b2cf-c3a70b170451 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:49.426009 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654edfcd-e2aa-4121-b2cf-c3a70b170451 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:49.427975 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654edfcd-e2aa-4121-b2cf-c3a70b170451 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:49.448656 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1226/2446] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 12:00:49 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:00:49.452751 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e240103-eae3-4c88-9795-20a9393455dd admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:49.463763 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e240103-eae3-4c88-9795-20a9393455dd admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:49.468673 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a09a7b8-2188-4bf9-937b-1fd19473d1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:49.469465 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09a7b8-2188-4bf9-937b-1fd19473d1d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:49.469827 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09a7b8-2188-4bf9-937b-1fd19473d1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:49.470110 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09a7b8-2188-4bf9-937b-1fd19473d1d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:49.470842 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a09a7b8-2188-4bf9-937b-1fd19473d1d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:49.472476 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a09a7b8-2188-4bf9-937b-1fd19473d1d9 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:49.473879 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:49.488571 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1221/2447] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 12:00:49.490344 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654edfcd-e2aa-4121-b2cf-c3a70b170451 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:49.500560 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654edfcd-e2aa-4121-b2cf-c3a70b170451 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:49.505272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d231e65a-a313-44d4-bbea-954b3c40aa3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:49.506655 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231e65a-a313-44d4-bbea-954b3c40aa3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:49.506936 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231e65a-a313-44d4-bbea-954b3c40aa3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:49.507214 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231e65a-a313-44d4-bbea-954b3c40aa3b admin admin] PATH_INFO: `/v3/projects/b52c46640cf94506aff09b2db940344b/users/2dd07e794a534b2598362b0c8394de4f/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:49.522937 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d231e65a-a313-44d4-bbea-954b3c40aa3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b52c46640cf94506aff09b2db940344b, user_id=2dd07e794a534b2598362b0c8394de4f, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:49.525654 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d231e65a-a313-44d4-bbea-954b3c40aa3b admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:49.538798 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1227/2448] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:00:49 2022] PUT /identity/v3/projects/b52c46640cf94506aff09b2db940344b/users/2dd07e794a534b2598362b0c8394de4f/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:49.542868 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a09a7b8-2188-4bf9-937b-1fd19473d1d9 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:49.553798 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a09a7b8-2188-4bf9-937b-1fd19473d1d9 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:49.611605 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24e612-a9e4-466f-a896-e9a6b56c9311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:49.612420 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24e612-a9e4-466f-a896-e9a6b56c9311 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:49.612768 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24e612-a9e4-466f-a896-e9a6b56c9311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:49.613117 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24e612-a9e4-466f-a896-e9a6b56c9311 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:49.613905 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a24e612-a9e4-466f-a896-e9a6b56c9311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:49.615599 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a24e612-a9e4-466f-a896-e9a6b56c9311 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:49.625588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1222/2449] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:00:49.629790 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d231e65a-a313-44d4-bbea-954b3c40aa3b admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:49.640813 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d231e65a-a313-44d4-bbea-954b3c40aa3b admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:49.645919 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d38db-005d-4722-b22c-baf387300933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:49.647773 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d38db-005d-4722-b22c-baf387300933 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:49.648056 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d38db-005d-4722-b22c-baf387300933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:49.648333 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d38db-005d-4722-b22c-baf387300933 admin admin] PATH_INFO: `/v3/projects/b52c46640cf94506aff09b2db940344b/users/2dd07e794a534b2598362b0c8394de4f/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:49.650530 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d38db-005d-4722-b22c-baf387300933 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b52c46640cf94506aff09b2db940344b, user_id=2dd07e794a534b2598362b0c8394de4f, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:49.653701 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d38db-005d-4722-b22c-baf387300933 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:49.665292 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1228/2450] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:00:49 2022] PUT /identity/v3/projects/b52c46640cf94506aff09b2db940344b/users/2dd07e794a534b2598362b0c8394de4f/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 12:00:49.676388 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a91fe-53f1-47b2-ae5d-6e5e06d5b254 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:49.676777 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a91fe-53f1-47b2-ae5d-6e5e06d5b254 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:49.677057 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a91fe-53f1-47b2-ae5d-6e5e06d5b254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:49.705130 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-679a91fe-53f1-47b2-ae5d-6e5e06d5b254 None None] MFA Rules not processed for user `2dd07e794a534b2598362b0c8394de4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:49.706354 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-679a91fe-53f1-47b2-ae5d-6e5e06d5b254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:49.784358 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1223/2451] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:49.795128 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d38db-005d-4722-b22c-baf387300933 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:49.796953 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-4b4d38db-005d-4722-b22c-baf387300933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:49.839313 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:49.858885 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d38db-005d-4722-b22c-baf387300933 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:49.862599 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3864a32-b940-4467-a44b-c355f4b80685 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:49.863254 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3864a32-b940-4467-a44b-c355f4b80685 service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:49.863558 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3864a32-b940-4467-a44b-c355f4b80685 service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:49.863835 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3864a32-b940-4467-a44b-c355f4b80685 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:49.873814 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3864a32-b940-4467-a44b-c355f4b80685 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:49.875345 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3864a32-b940-4467-a44b-c355f4b80685 service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:49.886331 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1229/2452] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:00:49 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:00:50.048939 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a91fe-53f1-47b2-ae5d-6e5e06d5b254 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:50.115443 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a91fe-53f1-47b2-ae5d-6e5e06d5b254 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:50.120352 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506f761-e91a-419f-916e-47bcc078eb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:50.121350 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506f761-e91a-419f-916e-47bcc078eb49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:50.121637 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506f761-e91a-419f-916e-47bcc078eb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:50.121907 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506f761-e91a-419f-916e-47bcc078eb49 admin admin] PATH_INFO: `/v3/users/c8aabfc182d94f93a69e5ecaf0484dc4` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:50.123239 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506f761-e91a-419f-916e-47bcc078eb49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8aabfc182d94f93a69e5ecaf0484dc4)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:50.125038 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506f761-e91a-419f-916e-47bcc078eb49 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:50.148295 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:50.178756 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-4506f761-e91a-419f-916e-47bcc078eb49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8aabfc182d94f93a69e5ecaf0484dc4'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:50.179492 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-4506f761-e91a-419f-916e-47bcc078eb49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8aabfc182d94f93a69e5ecaf0484dc4'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:50.192818 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-4506f761-e91a-419f-916e-47bcc078eb49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8aabfc182d94f93a69e5ecaf0484dc4'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:50.200553 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-4506f761-e91a-419f-916e-47bcc078eb49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8aabfc182d94f93a69e5ecaf0484dc4'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:50.208128 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-4506f761-e91a-419f-916e-47bcc078eb49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8aabfc182d94f93a69e5ecaf0484dc4'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:50.215014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1224/2453] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:00:50 2022] DELETE /identity/v3/users/c8aabfc182d94f93a69e5ecaf0484dc4 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:50.219472 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00afd44f-a0a4-4d63-a553-c4c6d011a220 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:50.219786 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00afd44f-a0a4-4d63-a553-c4c6d011a220 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:50.220066 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00afd44f-a0a4-4d63-a553-c4c6d011a220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:50.238365 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-00afd44f-a0a4-4d63-a553-c4c6d011a220 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:50.239987 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-00afd44f-a0a4-4d63-a553-c4c6d011a220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:50.319020 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1230/2454] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 12:00:50.328110 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506f761-e91a-419f-916e-47bcc078eb49 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:50.329518 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-4506f761-e91a-419f-916e-47bcc078eb49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:50.391605 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506f761-e91a-419f-916e-47bcc078eb49 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:50.396182 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4d1e0-266a-48fe-af25-2573c2002796 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:50.397777 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4d1e0-266a-48fe-af25-2573c2002796 service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:50.398063 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4d1e0-266a-48fe-af25-2573c2002796 service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:50.398339 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4d1e0-266a-48fe-af25-2573c2002796 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:50.408573 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4d1e0-266a-48fe-af25-2573c2002796 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:50.410028 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4d1e0-266a-48fe-af25-2573c2002796 service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:50.420466 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1225/2455] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:00:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:00:50.702689 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00afd44f-a0a4-4d63-a553-c4c6d011a220 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:50.704155 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-00afd44f-a0a4-4d63-a553-c4c6d011a220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:50.716586 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00afd44f-a0a4-4d63-a553-c4c6d011a220 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:50.721664 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87114bcd-3135-40c3-8340-87969904938e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:50.722529 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87114bcd-3135-40c3-8340-87969904938e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:50.722807 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87114bcd-3135-40c3-8340-87969904938e admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:50.723071 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87114bcd-3135-40c3-8340-87969904938e admin admin] PATH_INFO: `/v3/projects/23d273d531924bff8f7f9ac714e43f62` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:50.724278 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87114bcd-3135-40c3-8340-87969904938e admin admin] RBAC: Authorizing `identity:delete_project(project_id=23d273d531924bff8f7f9ac714e43f62)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:50.727201 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87114bcd-3135-40c3-8340-87969904938e admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:50.779716 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-87114bcd-3135-40c3-8340-87969904938e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23d273d531924bff8f7f9ac714e43f62', 'request_id': 'req-87114bcd-3135-40c3-8340-87969904938e'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:50.785552 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-87114bcd-3135-40c3-8340-87969904938e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23d273d531924bff8f7f9ac714e43f62', 'request_id': 'req-87114bcd-3135-40c3-8340-87969904938e'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:50.793281 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-87114bcd-3135-40c3-8340-87969904938e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23d273d531924bff8f7f9ac714e43f62', 'request_id': 'req-87114bcd-3135-40c3-8340-87969904938e'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:50.807543 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-87114bcd-3135-40c3-8340-87969904938e admin admin] The token cache is being invalidate because project 23d273d531924bff8f7f9ac714e43f62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:00:50.807843 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-87114bcd-3135-40c3-8340-87969904938e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:50.808701 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-87114bcd-3135-40c3-8340-87969904938e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:50.810520 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1231/2456] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:00:50 2022] DELETE /identity/v3/projects/23d273d531924bff8f7f9ac714e43f62 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:50.814304 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4d1e0-266a-48fe-af25-2573c2002796 service neutron] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:50.825130 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4d1e0-266a-48fe-af25-2573c2002796 service neutron] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:50.882646 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2a9d6-8489-4968-a4f7-018c06dba2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:50.883542 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2a9d6-8489-4968-a4f7-018c06dba2ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:50.883860 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2a9d6-8489-4968-a4f7-018c06dba2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:50.884130 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2a9d6-8489-4968-a4f7-018c06dba2ce admin admin] PATH_INFO: `/v3/users/2dd07e794a534b2598362b0c8394de4f` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:50.885383 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac2a9d6-8489-4968-a4f7-018c06dba2ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dd07e794a534b2598362b0c8394de4f)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:50.887323 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac2a9d6-8489-4968-a4f7-018c06dba2ce admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:50.933269 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:50.939183 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-cac2a9d6-8489-4968-a4f7-018c06dba2ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dd07e794a534b2598362b0c8394de4f'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:50.939879 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-cac2a9d6-8489-4968-a4f7-018c06dba2ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dd07e794a534b2598362b0c8394de4f'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:50.955441 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-cac2a9d6-8489-4968-a4f7-018c06dba2ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dd07e794a534b2598362b0c8394de4f'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:50.962872 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-cac2a9d6-8489-4968-a4f7-018c06dba2ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dd07e794a534b2598362b0c8394de4f'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:50.970324 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-cac2a9d6-8489-4968-a4f7-018c06dba2ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dd07e794a534b2598362b0c8394de4f'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:50.977280 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1226/2457] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:00:50 2022] DELETE /identity/v3/users/2dd07e794a534b2598362b0c8394de4f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:51.194138 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f543c-1a8f-4631-bed2-e491671e29f8 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:51.194551 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f543c-1a8f-4631-bed2-e491671e29f8 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:51.195084 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f543c-1a8f-4631-bed2-e491671e29f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:51.214282 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-639f543c-1a8f-4631-bed2-e491671e29f8 None None] MFA Rules not processed for user `abcc58cb66804297b184e41726c281bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:51.215603 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-639f543c-1a8f-4631-bed2-e491671e29f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:51.260602 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2a9d6-8489-4968-a4f7-018c06dba2ce admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:51.262122 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-cac2a9d6-8489-4968-a4f7-018c06dba2ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:51.279701 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1232/2458] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:51.347349 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2a9d6-8489-4968-a4f7-018c06dba2ce admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:51.353113 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5801f1c-a2cd-4914-89a2-4179f86b5eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:51.353977 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5801f1c-a2cd-4914-89a2-4179f86b5eae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:51.354257 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5801f1c-a2cd-4914-89a2-4179f86b5eae admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:51.354529 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5801f1c-a2cd-4914-89a2-4179f86b5eae admin admin] PATH_INFO: `/v3/projects/b52c46640cf94506aff09b2db940344b` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:51.355749 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5801f1c-a2cd-4914-89a2-4179f86b5eae admin admin] RBAC: Authorizing `identity:delete_project(project_id=b52c46640cf94506aff09b2db940344b)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:51.357694 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5801f1c-a2cd-4914-89a2-4179f86b5eae admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:51.405966 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-f5801f1c-a2cd-4914-89a2-4179f86b5eae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b52c46640cf94506aff09b2db940344b', 'request_id': 'req-f5801f1c-a2cd-4914-89a2-4179f86b5eae'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:51.414124 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-f5801f1c-a2cd-4914-89a2-4179f86b5eae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b52c46640cf94506aff09b2db940344b', 'request_id': 'req-f5801f1c-a2cd-4914-89a2-4179f86b5eae'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:51.424531 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-f5801f1c-a2cd-4914-89a2-4179f86b5eae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b52c46640cf94506aff09b2db940344b', 'request_id': 'req-f5801f1c-a2cd-4914-89a2-4179f86b5eae'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:51.437186 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-f5801f1c-a2cd-4914-89a2-4179f86b5eae admin admin] The token cache is being invalidate because project b52c46640cf94506aff09b2db940344b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:00:51.437472 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-f5801f1c-a2cd-4914-89a2-4179f86b5eae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:51.438103 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-f5801f1c-a2cd-4914-89a2-4179f86b5eae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:00:51.439819 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1227/2459] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:00:51 2022] DELETE /identity/v3/projects/b52c46640cf94506aff09b2db940344b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 12:00:51.444718 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83d354-8e8b-4074-a66d-c89387b54a01 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:51.445213 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83d354-8e8b-4074-a66d-c89387b54a01 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:51.445405 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83d354-8e8b-4074-a66d-c89387b54a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:51.458504 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:51.465496 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-4f83d354-8e8b-4074-a66d-c89387b54a01 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:51.467526 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-4f83d354-8e8b-4074-a66d-c89387b54a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:51.531146 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1233/2460] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:51.539243 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f2924-44d6-4b36-99f5-1e88902b3076 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:51.539563 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f2924-44d6-4b36-99f5-1e88902b3076 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:51.539844 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f2924-44d6-4b36-99f5-1e88902b3076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:51.557758 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-5a7f2924-44d6-4b36-99f5-1e88902b3076 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:51.558946 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-5a7f2924-44d6-4b36-99f5-1e88902b3076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:51.566780 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1228/2461] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:51.571097 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83d354-8e8b-4074-a66d-c89387b54a01 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:51.581879 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83d354-8e8b-4074-a66d-c89387b54a01 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:51.587087 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60801c3c-ccc5-4fbf-ab48-c415db55a983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:51.587952 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60801c3c-ccc5-4fbf-ab48-c415db55a983 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:51.588106 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60801c3c-ccc5-4fbf-ab48-c415db55a983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:51.588379 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60801c3c-ccc5-4fbf-ab48-c415db55a983 admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:51.589097 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60801c3c-ccc5-4fbf-ab48-c415db55a983 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:00:51.589402 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60801c3c-ccc5-4fbf-ab48-c415db55a983 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:51.590988 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60801c3c-ccc5-4fbf-ab48-c415db55a983 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:51.603509 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1234/2462] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 12:00:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:00:51.607743 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f2924-44d6-4b36-99f5-1e88902b3076 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:51.617199 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f2924-44d6-4b36-99f5-1e88902b3076 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:51.621915 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d193bc4-5f9c-410c-85c4-031a00e3ae59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:51.622568 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d193bc4-5f9c-410c-85c4-031a00e3ae59 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:51.622852 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d193bc4-5f9c-410c-85c4-031a00e3ae59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:51.623124 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d193bc4-5f9c-410c-85c4-031a00e3ae59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:51.623869 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d193bc4-5f9c-410c-85c4-031a00e3ae59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:51.625757 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d193bc4-5f9c-410c-85c4-031a00e3ae59 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:51.652986 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1229/2463] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 12:00:51 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:00:51.657151 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60801c3c-ccc5-4fbf-ab48-c415db55a983 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:51.668952 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60801c3c-ccc5-4fbf-ab48-c415db55a983 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:51.726542 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae87d9b-786f-4cb8-ac6e-13e57fe804dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:51.727207 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae87d9b-786f-4cb8-ac6e-13e57fe804dc admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:51.727487 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae87d9b-786f-4cb8-ac6e-13e57fe804dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:51.727838 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae87d9b-786f-4cb8-ac6e-13e57fe804dc admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:51.728527 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae87d9b-786f-4cb8-ac6e-13e57fe804dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:51.730463 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae87d9b-786f-4cb8-ac6e-13e57fe804dc admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:51.752002 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1235/2464] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 12:00:51 2022] POST /identity/v3/users => generated 285 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:00:51.756750 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d193bc4-5f9c-410c-85c4-031a00e3ae59 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:51.769139 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d193bc4-5f9c-410c-85c4-031a00e3ae59 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:51.775166 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f02dbce-64ff-419e-a92a-6fab6d21c1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:51.775986 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02dbce-64ff-419e-a92a-6fab6d21c1d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:51.776300 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02dbce-64ff-419e-a92a-6fab6d21c1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:51.776589 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02dbce-64ff-419e-a92a-6fab6d21c1d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:51.777323 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f02dbce-64ff-419e-a92a-6fab6d21c1d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:51.778929 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f02dbce-64ff-419e-a92a-6fab6d21c1d0 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:51.792437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1230/2465] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:00:51.793610 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae87d9b-786f-4cb8-ac6e-13e57fe804dc admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:51.803555 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae87d9b-786f-4cb8-ac6e-13e57fe804dc admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:51.808259 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a29a3-4776-40e1-bdd6-e84e2a29519f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:51.808910 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a29a3-4776-40e1-bdd6-e84e2a29519f admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:51.809196 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a29a3-4776-40e1-bdd6-e84e2a29519f admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:51.809471 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a29a3-4776-40e1-bdd6-e84e2a29519f admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:51.810373 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a29a3-4776-40e1-bdd6-e84e2a29519f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:51.812005 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a29a3-4776-40e1-bdd6-e84e2a29519f admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:51.822609 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1236/2466] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:00:51.826642 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f02dbce-64ff-419e-a92a-6fab6d21c1d0 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:51.837109 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f02dbce-64ff-419e-a92a-6fab6d21c1d0 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:51.841653 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2642737-2c46-4dd7-ace9-007c50512277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:51.842655 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2642737-2c46-4dd7-ace9-007c50512277 admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:51.842944 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2642737-2c46-4dd7-ace9-007c50512277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:51.843221 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2642737-2c46-4dd7-ace9-007c50512277 admin admin] PATH_INFO: `/v3/projects/b47026058aec4213ac06c61a11e5f069/users/d4d7a1fed77b4588b3f4f7b5a30059d4/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:51.846308 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:51.860395 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2642737-2c46-4dd7-ace9-007c50512277 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b47026058aec4213ac06c61a11e5f069, user_id=d4d7a1fed77b4588b3f4f7b5a30059d4, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:51.863600 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2642737-2c46-4dd7-ace9-007c50512277 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:51.876459 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1231/2467] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:00:51 2022] PUT /identity/v3/projects/b47026058aec4213ac06c61a11e5f069/users/d4d7a1fed77b4588b3f4f7b5a30059d4/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:00:51.888927 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee5ae4-e857-45e6-bf5d-f683dca6b3f7 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:51.889415 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee5ae4-e857-45e6-bf5d-f683dca6b3f7 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:51.889734 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee5ae4-e857-45e6-bf5d-f683dca6b3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:51.928521 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-beee5ae4-e857-45e6-bf5d-f683dca6b3f7 None None] MFA Rules not processed for user `d4d7a1fed77b4588b3f4f7b5a30059d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:51.929825 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-beee5ae4-e857-45e6-bf5d-f683dca6b3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:52.012210 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1237/2468] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:00:51 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:52.024194 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2642737-2c46-4dd7-ace9-007c50512277 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:52.025914 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-e2642737-2c46-4dd7-ace9-007c50512277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:52.089257 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2642737-2c46-4dd7-ace9-007c50512277 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:52.092929 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed529ae7-6baf-45ec-b832-08297041bb07 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aa048aec48b4755ac13eae997bff2fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:52.093653 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed529ae7-6baf-45ec-b832-08297041bb07 service glance] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:52.093943 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed529ae7-6baf-45ec-b832-08297041bb07 service glance] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:52.094219 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed529ae7-6baf-45ec-b832-08297041bb07 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:52.105228 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed529ae7-6baf-45ec-b832-08297041bb07 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:52.106872 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed529ae7-6baf-45ec-b832-08297041bb07 service glance] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:52.116793 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1232/2469] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:00:52 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:00:58.463802 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f711b-9a47-4961-a980-ac8028108885 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:58.464307 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f711b-9a47-4961-a980-ac8028108885 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:58.465256 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f711b-9a47-4961-a980-ac8028108885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:58.469329 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:00:58.499203 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-327f711b-9a47-4961-a980-ac8028108885 None None] MFA Rules not processed for user `a55cbe88e78e4f3a82b8703a3b1804e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:00:58.500613 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-327f711b-9a47-4961-a980-ac8028108885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:58.561824 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1238/2470] 10.222.0.15 () {58 vars in 1009 bytes} [Fri Jun 3 12:00:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:00:58.614510 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed529ae7-6baf-45ec-b832-08297041bb07 service glance] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:00:58.616687 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-ed529ae7-6baf-45ec-b832-08297041bb07 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:00:58.712936 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed529ae7-6baf-45ec-b832-08297041bb07 service glance] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:00:58.718305 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981a6eb-17a3-47aa-90af-42aaaa6bf5b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f52901fe535420bb0019272d4eafe72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:00:58.719044 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981a6eb-17a3-47aa-90af-42aaaa6bf5b0 service swift] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:00:58.719338 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981a6eb-17a3-47aa-90af-42aaaa6bf5b0 service swift] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:00:58.719696 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981a6eb-17a3-47aa-90af-42aaaa6bf5b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:00:58.730078 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5981a6eb-17a3-47aa-90af-42aaaa6bf5b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:00:58.731718 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5981a6eb-17a3-47aa-90af-42aaaa6bf5b0 service swift] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:00:58.741735 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1233/2471] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Jun 3 12:00:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 12:01:08.554416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=28 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:01:08.738041 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=64,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:01:20.805859 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f3926-20ae-4e78-a3e2-bf775af62b5f None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:01:20.806302 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f3926-20ae-4e78-a3e2-bf775af62b5f None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:01:20.806302 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f3926-20ae-4e78-a3e2-bf775af62b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:01:20.825178 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-974f3926-20ae-4e78-a3e2-bf775af62b5f None None] MFA Rules not processed for user `a55cbe88e78e4f3a82b8703a3b1804e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:01:20.826401 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-974f3926-20ae-4e78-a3e2-bf775af62b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:01:20.840226 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1239/2472] 10.222.0.15 () {58 vars in 967 bytes} [Fri Jun 3 12:01:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:01:20.853031 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981a6eb-17a3-47aa-90af-42aaaa6bf5b0 service swift] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:01:20.863361 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981a6eb-17a3-47aa-90af-42aaaa6bf5b0 service swift] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:01:20.869666 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9380a56-722b-4de9-b86b-8dd63cc2f31a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f52901fe535420bb0019272d4eafe72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:01:20.870508 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9380a56-722b-4de9-b86b-8dd63cc2f31a service swift] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:01:20.870788 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9380a56-722b-4de9-b86b-8dd63cc2f31a service swift] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:01:20.871081 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9380a56-722b-4de9-b86b-8dd63cc2f31a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:01:20.879359 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9380a56-722b-4de9-b86b-8dd63cc2f31a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:01:20.881014 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9380a56-722b-4de9-b86b-8dd63cc2f31a service swift] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:01:20.888972 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1234/2473] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Jun 3 12:01:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 12:01:22.835318 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f3926-20ae-4e78-a3e2-bf775af62b5f None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:01:22.836756 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-974f3926-20ae-4e78-a3e2-bf775af62b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:01:22.904280 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f3926-20ae-4e78-a3e2-bf775af62b5f None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:01:22.908778 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e3513-5292-45ce-9f5d-7a844d0ea41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:01:22.909649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e3513-5292-45ce-9f5d-7a844d0ea41a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:01:22.909935 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e3513-5292-45ce-9f5d-7a844d0ea41a admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:01:22.910243 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e3513-5292-45ce-9f5d-7a844d0ea41a admin admin] PATH_INFO: `/v3/users/c82999dd117a4335ae779cd92d45db4b` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:01:22.911428 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e3513-5292-45ce-9f5d-7a844d0ea41a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c82999dd117a4335ae779cd92d45db4b)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:01:22.913374 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e3513-5292-45ce-9f5d-7a844d0ea41a admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:01:22.959737 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-940e3513-5292-45ce-9f5d-7a844d0ea41a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c82999dd117a4335ae779cd92d45db4b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:01:22.966546 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-940e3513-5292-45ce-9f5d-7a844d0ea41a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c82999dd117a4335ae779cd92d45db4b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:01:22.967204 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-940e3513-5292-45ce-9f5d-7a844d0ea41a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c82999dd117a4335ae779cd92d45db4b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:01:22.978929 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-940e3513-5292-45ce-9f5d-7a844d0ea41a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c82999dd117a4335ae779cd92d45db4b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:01:22.986052 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-940e3513-5292-45ce-9f5d-7a844d0ea41a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c82999dd117a4335ae779cd92d45db4b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:01:22.992799 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1240/2474] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:01:22 2022] DELETE /identity/v3/users/c82999dd117a4335ae779cd92d45db4b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:01:23.163875 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9380a56-722b-4de9-b86b-8dd63cc2f31a service swift] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:01:23.174715 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9380a56-722b-4de9-b86b-8dd63cc2f31a service swift] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:01:23.255371 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b25b31-d679-4fb1-b203-004a38373ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:01:23.256431 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b25b31-d679-4fb1-b203-004a38373ab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:01:23.256721 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b25b31-d679-4fb1-b203-004a38373ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:01:23.257005 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b25b31-d679-4fb1-b203-004a38373ab0 admin admin] PATH_INFO: `/v3/projects/75f93cd1b2a5494e933eedb3af0c283a` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:01:23.258475 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b25b31-d679-4fb1-b203-004a38373ab0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75f93cd1b2a5494e933eedb3af0c283a)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:01:23.260887 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b25b31-d679-4fb1-b203-004a38373ab0 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:01:23.334432 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-21b25b31-d679-4fb1-b203-004a38373ab0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75f93cd1b2a5494e933eedb3af0c283a', 'request_id': 'req-21b25b31-d679-4fb1-b203-004a38373ab0'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:01:23.343338 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-21b25b31-d679-4fb1-b203-004a38373ab0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75f93cd1b2a5494e933eedb3af0c283a', 'request_id': 'req-21b25b31-d679-4fb1-b203-004a38373ab0'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:01:23.355457 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-21b25b31-d679-4fb1-b203-004a38373ab0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75f93cd1b2a5494e933eedb3af0c283a', 'request_id': 'req-21b25b31-d679-4fb1-b203-004a38373ab0'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:01:23.373653 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-21b25b31-d679-4fb1-b203-004a38373ab0 admin admin] The token cache is being invalidate because project 75f93cd1b2a5494e933eedb3af0c283a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:01:23.374391 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-21b25b31-d679-4fb1-b203-004a38373ab0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:01:23.375188 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-21b25b31-d679-4fb1-b203-004a38373ab0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:01:23.381852 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1235/2475] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:01:23 2022] DELETE /identity/v3/projects/75f93cd1b2a5494e933eedb3af0c283a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:01:23.383343 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc281aa-3362-4cac-9b8b-d1d90fa989f9 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:01:23.383675 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc281aa-3362-4cac-9b8b-d1d90fa989f9 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:01:23.383960 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc281aa-3362-4cac-9b8b-d1d90fa989f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:01:23.460701 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-5fc281aa-3362-4cac-9b8b-d1d90fa989f9 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:01:23.461926 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-5fc281aa-3362-4cac-9b8b-d1d90fa989f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:01:23.515265 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:01:23.539354 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1241/2476] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:01:23.541247 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61087f70-e260-4510-88cd-ee887ca4e160 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:01:23.541547 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61087f70-e260-4510-88cd-ee887ca4e160 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:01:23.541837 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61087f70-e260-4510-88cd-ee887ca4e160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:01:23.560232 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-61087f70-e260-4510-88cd-ee887ca4e160 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:01:23.561422 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-61087f70-e260-4510-88cd-ee887ca4e160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:01:23.569223 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1236/2477] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 12:01:23.573373 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc281aa-3362-4cac-9b8b-d1d90fa989f9 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:01:23.583711 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc281aa-3362-4cac-9b8b-d1d90fa989f9 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:01:23.588309 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4edaec-28af-4699-ac0a-cf38dc120f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:01:23.588945 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4edaec-28af-4699-ac0a-cf38dc120f05 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:01:23.589227 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4edaec-28af-4699-ac0a-cf38dc120f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:01:23.589495 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4edaec-28af-4699-ac0a-cf38dc120f05 admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:01:23.590210 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4edaec-28af-4699-ac0a-cf38dc120f05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:01:23.590512 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4edaec-28af-4699-ac0a-cf38dc120f05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:01:23.592293 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4edaec-28af-4699-ac0a-cf38dc120f05 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:01:23.605655 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1242/2478] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 12:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:01:23.609707 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61087f70-e260-4510-88cd-ee887ca4e160 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:01:23.619023 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61087f70-e260-4510-88cd-ee887ca4e160 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:01:23.624903 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db02b907-694e-4adb-88a0-23d790e88cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:01:23.625558 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02b907-694e-4adb-88a0-23d790e88cc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:01:23.625839 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02b907-694e-4adb-88a0-23d790e88cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:01:23.626213 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02b907-694e-4adb-88a0-23d790e88cc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:01:23.626897 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db02b907-694e-4adb-88a0-23d790e88cc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:01:23.628857 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db02b907-694e-4adb-88a0-23d790e88cc2 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:01:23.658599 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1237/2479] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 12:01:23 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:01:23.659795 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4edaec-28af-4699-ac0a-cf38dc120f05 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:01:23.671567 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4edaec-28af-4699-ac0a-cf38dc120f05 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:01:23.730476 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e50803-3db6-49dc-b216-0ae914f59c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:01:23.731157 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e50803-3db6-49dc-b216-0ae914f59c59 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:01:23.731476 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e50803-3db6-49dc-b216-0ae914f59c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:01:23.731793 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e50803-3db6-49dc-b216-0ae914f59c59 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:01:23.732485 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e50803-3db6-49dc-b216-0ae914f59c59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:01:23.734439 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e50803-3db6-49dc-b216-0ae914f59c59 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:01:23.754016 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1243/2480] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 12:01:23 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 12:01:23.758385 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db02b907-694e-4adb-88a0-23d790e88cc2 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:01:23.769585 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db02b907-694e-4adb-88a0-23d790e88cc2 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:01:23.774953 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe275a6-615e-4827-b202-5abfc47696f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:01:23.775646 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe275a6-615e-4827-b202-5abfc47696f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:01:23.775929 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe275a6-615e-4827-b202-5abfc47696f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:01:23.776199 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe275a6-615e-4827-b202-5abfc47696f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:01:23.776918 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe275a6-615e-4827-b202-5abfc47696f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:01:23.778516 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe275a6-615e-4827-b202-5abfc47696f1 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:01:23.790728 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1238/2481] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 12:01:23.794848 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e50803-3db6-49dc-b216-0ae914f59c59 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:01:23.804797 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e50803-3db6-49dc-b216-0ae914f59c59 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:01:23.809427 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4506a2-955f-496e-9ba6-2b13d357286e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:01:23.810054 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4506a2-955f-496e-9ba6-2b13d357286e admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:01:23.810338 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4506a2-955f-496e-9ba6-2b13d357286e admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:01:23.810612 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4506a2-955f-496e-9ba6-2b13d357286e admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:01:23.811335 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4506a2-955f-496e-9ba6-2b13d357286e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:01:23.812963 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4506a2-955f-496e-9ba6-2b13d357286e admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:01:23.823479 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1244/2482] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:01:23.827309 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe275a6-615e-4827-b202-5abfc47696f1 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:01:23.837848 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe275a6-615e-4827-b202-5abfc47696f1 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:01:23.842373 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018ea16-2099-45cc-b995-a896c5e2955a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:01:23.843245 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018ea16-2099-45cc-b995-a896c5e2955a admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:01:23.843552 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018ea16-2099-45cc-b995-a896c5e2955a admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:01:23.843829 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018ea16-2099-45cc-b995-a896c5e2955a admin admin] PATH_INFO: `/v3/projects/8a84f7c6c96c4a43bf6f2f4a59725156/users/89f94b41bbc442d3bc065a0487de7259/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:01:23.858977 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b018ea16-2099-45cc-b995-a896c5e2955a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a84f7c6c96c4a43bf6f2f4a59725156, user_id=89f94b41bbc442d3bc065a0487de7259, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:01:23.861635 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b018ea16-2099-45cc-b995-a896c5e2955a admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:01:23.873977 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1239/2483] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:01:23 2022] PUT /identity/v3/projects/8a84f7c6c96c4a43bf6f2f4a59725156/users/89f94b41bbc442d3bc065a0487de7259/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:01:23.884956 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08c9fa-1d48-4043-8b3b-589a525db8bc None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:01:23.885475 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08c9fa-1d48-4043-8b3b-589a525db8bc None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:01:23.885696 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08c9fa-1d48-4043-8b3b-589a525db8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:01:23.913729 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-fd08c9fa-1d48-4043-8b3b-589a525db8bc None None] MFA Rules not processed for user `89f94b41bbc442d3bc065a0487de7259`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:01:23.914927 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-fd08c9fa-1d48-4043-8b3b-589a525db8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:01:23.977964 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1245/2484] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:01:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:01:23.988485 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018ea16-2099-45cc-b995-a896c5e2955a admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:01:23.990160 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-b018ea16-2099-45cc-b995-a896c5e2955a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:01:24.008075 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:01:24.069588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018ea16-2099-45cc-b995-a896c5e2955a admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:01:24.073086 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1155376-33ab-45c0-9a53-a35165852880 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:01:24.073719 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1155376-33ab-45c0-9a53-a35165852880 service cinder] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:01:24.074004 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1155376-33ab-45c0-9a53-a35165852880 service cinder] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:01:24.074275 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1155376-33ab-45c0-9a53-a35165852880 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:01:24.082368 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1155376-33ab-45c0-9a53-a35165852880 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:01:24.084391 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1155376-33ab-45c0-9a53-a35165852880 service cinder] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:01:24.093044 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1240/2485] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:01:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:01:26.481863 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae5694-f3bf-4b4d-b762-a8dd7408256e None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:01:26.482344 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae5694-f3bf-4b4d-b762-a8dd7408256e None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:01:26.482448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae5694-f3bf-4b4d-b762-a8dd7408256e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:01:26.500872 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-4cae5694-f3bf-4b4d-b762-a8dd7408256e None None] MFA Rules not processed for user `89f94b41bbc442d3bc065a0487de7259`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:01:26.502072 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-4cae5694-f3bf-4b4d-b762-a8dd7408256e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:01:26.509427 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1246/2486] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:01:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:01:27.147239 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1155376-33ab-45c0-9a53-a35165852880 service cinder] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:01:27.150048 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-c1155376-33ab-45c0-9a53-a35165852880 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:01:27.215212 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1155376-33ab-45c0-9a53-a35165852880 service cinder] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:01:27.218881 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6981b1d-3e97-4362-8a2b-4601357aafa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:01:27.219566 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6981b1d-3e97-4362-8a2b-4601357aafa4 service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:01:27.219867 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6981b1d-3e97-4362-8a2b-4601357aafa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:01:27.220135 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6981b1d-3e97-4362-8a2b-4601357aafa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:01:27.221980 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-c6981b1d-3e97-4362-8a2b-4601357aafa4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:01:27.290324 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6981b1d-3e97-4362-8a2b-4601357aafa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:01:27.291796 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6981b1d-3e97-4362-8a2b-4601357aafa4 service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:01:27.302562 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1241/2487] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:01:27 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:01:36.495688 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=76,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:01:37.297011 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=79 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:01:39.416213 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae5694-f3bf-4b4d-b762-a8dd7408256e None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:01:39.417661 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-4cae5694-f3bf-4b4d-b762-a8dd7408256e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:01:39.509524 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae5694-f3bf-4b4d-b762-a8dd7408256e None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:01:39.514506 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdfe46d-721a-4230-83c3-5732256ba105 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5a91437dd64e2491ce41b4d12d4835', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:01:39.515140 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdfe46d-721a-4230-83c3-5732256ba105 service placement] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:01:39.515423 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdfe46d-721a-4230-83c3-5732256ba105 service placement] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:01:39.515727 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdfe46d-721a-4230-83c3-5732256ba105 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:01:39.517568 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-7fdfe46d-721a-4230-83c3-5732256ba105 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:01:39.529622 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdfe46d-721a-4230-83c3-5732256ba105 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:01:39.531199 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdfe46d-721a-4230-83c3-5732256ba105 service placement] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:01:39.541507 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1247/2488] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:01:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:01:49.537624 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=41 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:01:49.805665 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6981b1d-3e97-4362-8a2b-4601357aafa4 service neutron] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:01:49.807071 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-c6981b1d-3e97-4362-8a2b-4601357aafa4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:01:49.870065 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6981b1d-3e97-4362-8a2b-4601357aafa4 service neutron] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:01:49.874589 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e312f-5444-4150-972a-5667b82f2c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:01:49.875445 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e312f-5444-4150-972a-5667b82f2c7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:01:49.875758 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e312f-5444-4150-972a-5667b82f2c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:01:49.876035 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e312f-5444-4150-972a-5667b82f2c7f admin admin] PATH_INFO: `/v3/users/d4d7a1fed77b4588b3f4f7b5a30059d4` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:01:49.877203 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e312f-5444-4150-972a-5667b82f2c7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4d7a1fed77b4588b3f4f7b5a30059d4)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:01:49.879113 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e312f-5444-4150-972a-5667b82f2c7f admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:01:49.925925 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-d79e312f-5444-4150-972a-5667b82f2c7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4d7a1fed77b4588b3f4f7b5a30059d4'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:01:49.926571 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-d79e312f-5444-4150-972a-5667b82f2c7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4d7a1fed77b4588b3f4f7b5a30059d4'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:01:49.938204 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-d79e312f-5444-4150-972a-5667b82f2c7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4d7a1fed77b4588b3f4f7b5a30059d4'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:01:49.945138 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-d79e312f-5444-4150-972a-5667b82f2c7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4d7a1fed77b4588b3f4f7b5a30059d4'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:01:49.952659 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-d79e312f-5444-4150-972a-5667b82f2c7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4d7a1fed77b4588b3f4f7b5a30059d4'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:01:49.959403 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1242/2489] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:01:49 2022] DELETE /identity/v3/users/d4d7a1fed77b4588b3f4f7b5a30059d4 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:01:49.963897 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9bdd36-3a1b-440e-afc1-aa1c9fb5105c None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:01:49.964174 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9bdd36-3a1b-440e-afc1-aa1c9fb5105c None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:01:49.964452 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9bdd36-3a1b-440e-afc1-aa1c9fb5105c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:01:49.982642 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-1b9bdd36-3a1b-440e-afc1-aa1c9fb5105c None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:01:49.983861 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-1b9bdd36-3a1b-440e-afc1-aa1c9fb5105c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:01:50.042092 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1248/2490] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:01:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:01:50.051385 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e312f-5444-4150-972a-5667b82f2c7f admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:01:50.052840 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-d79e312f-5444-4150-972a-5667b82f2c7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:01:50.108349 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e312f-5444-4150-972a-5667b82f2c7f admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:01:50.111921 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848f689-1709-4190-9d0d-fccbd7fc3f66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:01:50.112555 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848f689-1709-4190-9d0d-fccbd7fc3f66 service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:01:50.112835 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848f689-1709-4190-9d0d-fccbd7fc3f66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:01:50.113109 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848f689-1709-4190-9d0d-fccbd7fc3f66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:01:50.121859 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b848f689-1709-4190-9d0d-fccbd7fc3f66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:01:50.123276 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b848f689-1709-4190-9d0d-fccbd7fc3f66 service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:01:50.133090 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1243/2491] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:01:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:01:50.425437 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9bdd36-3a1b-440e-afc1-aa1c9fb5105c None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:01:50.427415 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-1b9bdd36-3a1b-440e-afc1-aa1c9fb5105c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:01:50.439305 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9bdd36-3a1b-440e-afc1-aa1c9fb5105c None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:01:50.445206 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85178c-d758-429f-a547-05008cfbc607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:01:50.446078 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85178c-d758-429f-a547-05008cfbc607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:01:50.446359 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85178c-d758-429f-a547-05008cfbc607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:01:50.447017 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85178c-d758-429f-a547-05008cfbc607 admin admin] PATH_INFO: `/v3/projects/b47026058aec4213ac06c61a11e5f069` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:01:50.450083 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c85178c-d758-429f-a547-05008cfbc607 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b47026058aec4213ac06c61a11e5f069)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:01:50.452235 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c85178c-d758-429f-a547-05008cfbc607 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:01:50.643791 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-4c85178c-d758-429f-a547-05008cfbc607 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b47026058aec4213ac06c61a11e5f069', 'request_id': 'req-4c85178c-d758-429f-a547-05008cfbc607'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:01:50.649785 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-4c85178c-d758-429f-a547-05008cfbc607 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b47026058aec4213ac06c61a11e5f069', 'request_id': 'req-4c85178c-d758-429f-a547-05008cfbc607'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:01:50.658191 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-4c85178c-d758-429f-a547-05008cfbc607 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b47026058aec4213ac06c61a11e5f069', 'request_id': 'req-4c85178c-d758-429f-a547-05008cfbc607'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:01:50.671653 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-4c85178c-d758-429f-a547-05008cfbc607 admin admin] The token cache is being invalidate because project b47026058aec4213ac06c61a11e5f069 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:01:50.671941 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-4c85178c-d758-429f-a547-05008cfbc607 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:01:50.672644 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-4c85178c-d758-429f-a547-05008cfbc607 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:01:50.678573 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1249/2492] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:01:50 2022] DELETE /identity/v3/projects/b47026058aec4213ac06c61a11e5f069 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:01:50.681617 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1916da-5676-45eb-bb84-590ab9e3b339 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:01:50.681768 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1916da-5676-45eb-bb84-590ab9e3b339 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:01:50.682184 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1916da-5676-45eb-bb84-590ab9e3b339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:01:50.703314 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-4a1916da-5676-45eb-bb84-590ab9e3b339 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:01:50.704609 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-4a1916da-5676-45eb-bb84-590ab9e3b339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:01:50.725406 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:01:50.772914 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1244/2493] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:01:50.780665 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf6aecd-90b8-48ee-b6d8-8385d5d281a9 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:01:50.780958 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf6aecd-90b8-48ee-b6d8-8385d5d281a9 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:01:50.781225 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf6aecd-90b8-48ee-b6d8-8385d5d281a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:01:50.801577 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-edf6aecd-90b8-48ee-b6d8-8385d5d281a9 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:01:50.803520 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-edf6aecd-90b8-48ee-b6d8-8385d5d281a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:01:50.815549 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1250/2494] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:01:50.819823 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1916da-5676-45eb-bb84-590ab9e3b339 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:01:50.830795 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1916da-5676-45eb-bb84-590ab9e3b339 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:01:50.836212 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b1a1b-b72c-459a-8c95-dec9a1f08d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:01:50.839675 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b1a1b-b72c-459a-8c95-dec9a1f08d27 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:01:50.840094 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b1a1b-b72c-459a-8c95-dec9a1f08d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:01:50.840380 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b1a1b-b72c-459a-8c95-dec9a1f08d27 admin admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:01:50.841426 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25b1a1b-b72c-459a-8c95-dec9a1f08d27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:01:50.841707 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25b1a1b-b72c-459a-8c95-dec9a1f08d27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:01:50.843531 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25b1a1b-b72c-459a-8c95-dec9a1f08d27 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:01:50.860173 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1245/2495] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 12:01:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:01:50.866498 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf6aecd-90b8-48ee-b6d8-8385d5d281a9 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:01:50.877105 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf6aecd-90b8-48ee-b6d8-8385d5d281a9 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:01:50.882616 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa9340-5188-4fd5-99f2-9720347cd20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:01:50.883280 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa9340-5188-4fd5-99f2-9720347cd20b admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:01:50.883607 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa9340-5188-4fd5-99f2-9720347cd20b admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:01:50.883904 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa9340-5188-4fd5-99f2-9720347cd20b admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:01:50.884569 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caa9340-5188-4fd5-99f2-9720347cd20b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:01:50.886496 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caa9340-5188-4fd5-99f2-9720347cd20b admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:01:50.914631 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1251/2496] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 12:01:50 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:01:50.920514 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b1a1b-b72c-459a-8c95-dec9a1f08d27 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:01:50.932909 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b1a1b-b72c-459a-8c95-dec9a1f08d27 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:01:50.997280 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ece1a1-34a9-4153-8824-fd246d4fb490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:01:50.997959 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ece1a1-34a9-4153-8824-fd246d4fb490 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:01:50.998244 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ece1a1-34a9-4153-8824-fd246d4fb490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:01:50.998520 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ece1a1-34a9-4153-8824-fd246d4fb490 admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:01:50.999213 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ece1a1-34a9-4153-8824-fd246d4fb490 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:01:51.001191 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ece1a1-34a9-4153-8824-fd246d4fb490 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:01:51.022312 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1246/2497] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 12:01:50 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:01:51.026531 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa9340-5188-4fd5-99f2-9720347cd20b admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:01:51.037243 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa9340-5188-4fd5-99f2-9720347cd20b admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:01:51.041763 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb967d4-d52a-4f1a-abc3-8b4ea7ca50f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:01:51.042409 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb967d4-d52a-4f1a-abc3-8b4ea7ca50f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:01:51.043287 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb967d4-d52a-4f1a-abc3-8b4ea7ca50f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:01:51.043671 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb967d4-d52a-4f1a-abc3-8b4ea7ca50f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:01:51.044375 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb967d4-d52a-4f1a-abc3-8b4ea7ca50f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:01:51.045940 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb967d4-d52a-4f1a-abc3-8b4ea7ca50f8 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:01:51.056736 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1252/2498] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:01:51.060685 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ece1a1-34a9-4153-8824-fd246d4fb490 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:01:51.070616 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ece1a1-34a9-4153-8824-fd246d4fb490 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:01:51.075313 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff15155-2142-436c-8ce3-220577f0395f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:01:51.076007 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff15155-2142-436c-8ce3-220577f0395f admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:01:51.076297 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff15155-2142-436c-8ce3-220577f0395f admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:01:51.076577 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff15155-2142-436c-8ce3-220577f0395f admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:01:51.077925 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff15155-2142-436c-8ce3-220577f0395f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:01:51.079544 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff15155-2142-436c-8ce3-220577f0395f admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:01:51.089410 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1247/2499] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:01:51.093294 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb967d4-d52a-4f1a-abc3-8b4ea7ca50f8 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:01:51.103630 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb967d4-d52a-4f1a-abc3-8b4ea7ca50f8 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:01:51.108129 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f06636-2e60-4910-95df-df1898166def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:01:51.108978 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f06636-2e60-4910-95df-df1898166def admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:01:51.109254 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f06636-2e60-4910-95df-df1898166def admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:01:51.109523 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f06636-2e60-4910-95df-df1898166def admin admin] PATH_INFO: `/v3/projects/ee183bd9adc84828869db4ea188e1d04/users/55a7777f97f24a6b811919f4d98964c1/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:01:51.124018 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f06636-2e60-4910-95df-df1898166def admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee183bd9adc84828869db4ea188e1d04, user_id=55a7777f97f24a6b811919f4d98964c1, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:01:51.126620 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f06636-2e60-4910-95df-df1898166def admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:01:51.138970 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1253/2500] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:01:51 2022] PUT /identity/v3/projects/ee183bd9adc84828869db4ea188e1d04/users/55a7777f97f24a6b811919f4d98964c1/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 12:01:51.204058 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecab14-e725-4e16-8e65-d96aef2970e0 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:01:51.204350 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecab14-e725-4e16-8e65-d96aef2970e0 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:01:51.204631 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecab14-e725-4e16-8e65-d96aef2970e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:01:51.232076 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-07ecab14-e725-4e16-8e65-d96aef2970e0 None None] MFA Rules not processed for user `55a7777f97f24a6b811919f4d98964c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:01:51.233293 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-07ecab14-e725-4e16-8e65-d96aef2970e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:01:51.296528 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1248/2501] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:01:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:01:51.308062 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f06636-2e60-4910-95df-df1898166def admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:01:51.309702 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-11f06636-2e60-4910-95df-df1898166def admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:01:51.332211 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:01:51.371373 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f06636-2e60-4910-95df-df1898166def admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:01:51.374998 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3505a5-cdf1-4b2d-bb84-ca864b170dcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:01:51.375691 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3505a5-cdf1-4b2d-bb84-ca864b170dcc service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:01:51.375972 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3505a5-cdf1-4b2d-bb84-ca864b170dcc service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:01:51.376247 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3505a5-cdf1-4b2d-bb84-ca864b170dcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:01:51.384810 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3505a5-cdf1-4b2d-bb84-ca864b170dcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:01:51.386230 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3505a5-cdf1-4b2d-bb84-ca864b170dcc service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:01:51.395143 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1254/2502] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:01:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:01:51.862802 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3dbede-2db2-4f14-b4d8-5144ce98651b None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:01:51.863264 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3dbede-2db2-4f14-b4d8-5144ce98651b None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:01:51.863364 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3dbede-2db2-4f14-b4d8-5144ce98651b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:01:51.888312 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:01:51.914268 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-5f3dbede-2db2-4f14-b4d8-5144ce98651b None None] MFA Rules not processed for user `a55cbe88e78e4f3a82b8703a3b1804e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:01:51.915479 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-5f3dbede-2db2-4f14-b4d8-5144ce98651b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:01:51.977827 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1249/2503] 10.222.0.15 () {58 vars in 1009 bytes} [Fri Jun 3 12:01:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:01:51.989504 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3505a5-cdf1-4b2d-bb84-ca864b170dcc service cinder] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:01:51.990891 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-3f3505a5-cdf1-4b2d-bb84-ca864b170dcc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:01:52.078958 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3505a5-cdf1-4b2d-bb84-ca864b170dcc service cinder] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:01:52.083980 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8261418-ee2c-4563-a360-b7d71b34e702 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f52901fe535420bb0019272d4eafe72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:01:52.084616 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8261418-ee2c-4563-a360-b7d71b34e702 service swift] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:01:52.084899 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8261418-ee2c-4563-a360-b7d71b34e702 service swift] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:01:52.085174 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8261418-ee2c-4563-a360-b7d71b34e702 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:01:52.093172 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8261418-ee2c-4563-a360-b7d71b34e702 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:01:52.094733 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8261418-ee2c-4563-a360-b7d71b34e702 service swift] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:01:52.102665 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1255/2504] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Jun 3 12:01:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 12:01:52.605763 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41b280-aef6-45ad-8831-1256b1b8f1af None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:01:52.606055 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41b280-aef6-45ad-8831-1256b1b8f1af None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:01:52.606355 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41b280-aef6-45ad-8831-1256b1b8f1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:01:52.625912 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-5b41b280-aef6-45ad-8831-1256b1b8f1af None None] MFA Rules not processed for user `a55cbe88e78e4f3a82b8703a3b1804e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:01:52.627154 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-5b41b280-aef6-45ad-8831-1256b1b8f1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:01:52.634324 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1250/2505] 10.222.0.15 () {58 vars in 967 bytes} [Fri Jun 3 12:01:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:01:52.647424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8261418-ee2c-4563-a360-b7d71b34e702 service swift] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:01:52.657997 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8261418-ee2c-4563-a360-b7d71b34e702 service swift] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:01:52.663718 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab8a55-6774-4d83-9eda-a2d61f9a5b46 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f52901fe535420bb0019272d4eafe72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:01:52.664350 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab8a55-6774-4d83-9eda-a2d61f9a5b46 service swift] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:01:52.664637 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab8a55-6774-4d83-9eda-a2d61f9a5b46 service swift] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:01:52.664915 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab8a55-6774-4d83-9eda-a2d61f9a5b46 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:01:52.673373 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab8a55-6774-4d83-9eda-a2d61f9a5b46 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:01:52.674948 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab8a55-6774-4d83-9eda-a2d61f9a5b46 service swift] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:01:52.683818 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1256/2506] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Jun 3 12:01:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 12:01:52.910425 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8df76e-5610-4a6c-8aa8-6ff2335031f0 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:01:52.911901 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8df76e-5610-4a6c-8aa8-6ff2335031f0 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:01:52.912248 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8df76e-5610-4a6c-8aa8-6ff2335031f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:01:52.931318 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-af8df76e-5610-4a6c-8aa8-6ff2335031f0 None None] MFA Rules not processed for user `a55cbe88e78e4f3a82b8703a3b1804e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:01:52.932552 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-af8df76e-5610-4a6c-8aa8-6ff2335031f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:01:52.939834 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1251/2507] 10.222.0.15 () {58 vars in 1009 bytes} [Fri Jun 3 12:01:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:01:52.951490 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab8a55-6774-4d83-9eda-a2d61f9a5b46 service swift] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:01:52.962415 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab8a55-6774-4d83-9eda-a2d61f9a5b46 service swift] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:01:52.967335 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254685b7-fd4a-4443-a526-b0420469ba70 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f52901fe535420bb0019272d4eafe72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:01:52.968002 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254685b7-fd4a-4443-a526-b0420469ba70 service swift] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:01:52.968290 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254685b7-fd4a-4443-a526-b0420469ba70 service swift] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:01:52.968569 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254685b7-fd4a-4443-a526-b0420469ba70 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:01:52.977077 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254685b7-fd4a-4443-a526-b0420469ba70 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:01:52.978643 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254685b7-fd4a-4443-a526-b0420469ba70 service swift] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:01:52.986761 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1257/2508] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Jun 3 12:01:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 12:01:53.301260 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d376336-6636-4024-98ed-b02741caf46e None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:01:53.301548 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d376336-6636-4024-98ed-b02741caf46e None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:01:53.302398 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d376336-6636-4024-98ed-b02741caf46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:01:53.319803 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-5d376336-6636-4024-98ed-b02741caf46e None None] MFA Rules not processed for user `a55cbe88e78e4f3a82b8703a3b1804e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:01:53.320996 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-5d376336-6636-4024-98ed-b02741caf46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:01:53.327996 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1252/2509] 10.222.0.15 () {58 vars in 967 bytes} [Fri Jun 3 12:01:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:01:53.339656 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254685b7-fd4a-4443-a526-b0420469ba70 service swift] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:01:53.350461 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254685b7-fd4a-4443-a526-b0420469ba70 service swift] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:01:53.355245 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d088959-a50f-4e00-ae7d-9f9c4df73fa6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f52901fe535420bb0019272d4eafe72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:01:53.355904 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d088959-a50f-4e00-ae7d-9f9c4df73fa6 service swift] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:01:53.356184 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d088959-a50f-4e00-ae7d-9f9c4df73fa6 service swift] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:01:53.356454 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d088959-a50f-4e00-ae7d-9f9c4df73fa6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:01:53.364971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d088959-a50f-4e00-ae7d-9f9c4df73fa6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:01:53.366521 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d088959-a50f-4e00-ae7d-9f9c4df73fa6 service swift] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:01:53.374528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1258/2510] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Jun 3 12:01:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 12:01:53.968544 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d376336-6636-4024-98ed-b02741caf46e None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:01:54.026999 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d376336-6636-4024-98ed-b02741caf46e None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:01:54.031708 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d0d58-cee6-4c8d-989c-87ec9df8ef52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:01:54.032618 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d0d58-cee6-4c8d-989c-87ec9df8ef52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:01:54.032901 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d0d58-cee6-4c8d-989c-87ec9df8ef52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:01:54.033210 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d0d58-cee6-4c8d-989c-87ec9df8ef52 admin admin] PATH_INFO: `/v3/users/55a7777f97f24a6b811919f4d98964c1` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:01:54.034465 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d0d58-cee6-4c8d-989c-87ec9df8ef52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55a7777f97f24a6b811919f4d98964c1)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:01:54.036464 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d0d58-cee6-4c8d-989c-87ec9df8ef52 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:01:54.090994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-168d0d58-cee6-4c8d-989c-87ec9df8ef52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55a7777f97f24a6b811919f4d98964c1'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:01:54.091674 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-168d0d58-cee6-4c8d-989c-87ec9df8ef52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55a7777f97f24a6b811919f4d98964c1'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:01:54.104246 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-168d0d58-cee6-4c8d-989c-87ec9df8ef52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55a7777f97f24a6b811919f4d98964c1'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:01:54.110070 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:01:54.112029 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-168d0d58-cee6-4c8d-989c-87ec9df8ef52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55a7777f97f24a6b811919f4d98964c1'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:01:54.120820 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-168d0d58-cee6-4c8d-989c-87ec9df8ef52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55a7777f97f24a6b811919f4d98964c1'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:01:54.127642 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1253/2511] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:01:53 2022] DELETE /identity/v3/users/55a7777f97f24a6b811919f4d98964c1 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:01:54.134922 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc9a49-2cd9-429a-b5dc-8a131dae259b None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:01:54.135210 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc9a49-2cd9-429a-b5dc-8a131dae259b None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:01:54.135495 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc9a49-2cd9-429a-b5dc-8a131dae259b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:01:54.153373 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-d1fc9a49-2cd9-429a-b5dc-8a131dae259b None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:01:54.158362 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-d1fc9a49-2cd9-429a-b5dc-8a131dae259b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:01:54.208953 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:01:54.221349 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1259/2512] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:01:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:01:54.234314 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d0d58-cee6-4c8d-989c-87ec9df8ef52 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:01:54.234314 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-168d0d58-cee6-4c8d-989c-87ec9df8ef52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:01:54.296247 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d0d58-cee6-4c8d-989c-87ec9df8ef52 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:01:54.300025 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25b068-c2ef-4ddf-b938-e65f37cad667 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:01:54.300678 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25b068-c2ef-4ddf-b938-e65f37cad667 service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:01:54.300964 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25b068-c2ef-4ddf-b938-e65f37cad667 service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:01:54.301273 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25b068-c2ef-4ddf-b938-e65f37cad667 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:01:54.311276 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25b068-c2ef-4ddf-b938-e65f37cad667 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:01:54.312735 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25b068-c2ef-4ddf-b938-e65f37cad667 service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:01:54.322894 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1254/2513] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:01:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:01:54.601829 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc9a49-2cd9-429a-b5dc-8a131dae259b None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:01:54.603695 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-d1fc9a49-2cd9-429a-b5dc-8a131dae259b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:01:54.623521 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc9a49-2cd9-429a-b5dc-8a131dae259b None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:01:54.628585 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96cb44-8345-40cd-8917-f445ad6dfa6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:01:54.629543 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96cb44-8345-40cd-8917-f445ad6dfa6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:01:54.629755 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96cb44-8345-40cd-8917-f445ad6dfa6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:01:54.630074 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96cb44-8345-40cd-8917-f445ad6dfa6b admin admin] PATH_INFO: `/v3/projects/ee183bd9adc84828869db4ea188e1d04` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:01:54.631234 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96cb44-8345-40cd-8917-f445ad6dfa6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee183bd9adc84828869db4ea188e1d04)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:01:54.633365 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96cb44-8345-40cd-8917-f445ad6dfa6b admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:01:54.681657 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-cf96cb44-8345-40cd-8917-f445ad6dfa6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee183bd9adc84828869db4ea188e1d04', 'request_id': 'req-cf96cb44-8345-40cd-8917-f445ad6dfa6b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:01:54.687704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-cf96cb44-8345-40cd-8917-f445ad6dfa6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee183bd9adc84828869db4ea188e1d04', 'request_id': 'req-cf96cb44-8345-40cd-8917-f445ad6dfa6b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:01:54.695124 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-cf96cb44-8345-40cd-8917-f445ad6dfa6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee183bd9adc84828869db4ea188e1d04', 'request_id': 'req-cf96cb44-8345-40cd-8917-f445ad6dfa6b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:01:54.706798 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-cf96cb44-8345-40cd-8917-f445ad6dfa6b admin admin] The token cache is being invalidate because project ee183bd9adc84828869db4ea188e1d04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:01:54.707320 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-cf96cb44-8345-40cd-8917-f445ad6dfa6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:01:54.707991 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-cf96cb44-8345-40cd-8917-f445ad6dfa6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:01:54.709501 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1260/2514] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:01:54 2022] DELETE /identity/v3/projects/ee183bd9adc84828869db4ea188e1d04 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:01:55.422744 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25b068-c2ef-4ddf-b938-e65f37cad667 service neutron] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:01:55.424140 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-de25b068-c2ef-4ddf-b938-e65f37cad667 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:01:55.437488 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25b068-c2ef-4ddf-b938-e65f37cad667 service neutron] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:01:55.492212 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc55c4ba-a424-4e12-a62b-ebcd3f42095a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:01:55.493089 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55c4ba-a424-4e12-a62b-ebcd3f42095a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:01:55.493370 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55c4ba-a424-4e12-a62b-ebcd3f42095a admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:01:55.493645 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55c4ba-a424-4e12-a62b-ebcd3f42095a admin admin] PATH_INFO: `/v3/users/89f94b41bbc442d3bc065a0487de7259` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:01:55.494827 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc55c4ba-a424-4e12-a62b-ebcd3f42095a admin admin] RBAC: Authorizing `identity:delete_user(user_id=89f94b41bbc442d3bc065a0487de7259)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:01:55.496834 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc55c4ba-a424-4e12-a62b-ebcd3f42095a admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:01:55.542837 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-cc55c4ba-a424-4e12-a62b-ebcd3f42095a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89f94b41bbc442d3bc065a0487de7259'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:01:55.543472 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-cc55c4ba-a424-4e12-a62b-ebcd3f42095a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89f94b41bbc442d3bc065a0487de7259'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:01:55.555416 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-cc55c4ba-a424-4e12-a62b-ebcd3f42095a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89f94b41bbc442d3bc065a0487de7259'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:01:55.563114 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-cc55c4ba-a424-4e12-a62b-ebcd3f42095a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89f94b41bbc442d3bc065a0487de7259'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:01:55.569924 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-cc55c4ba-a424-4e12-a62b-ebcd3f42095a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89f94b41bbc442d3bc065a0487de7259'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:01:55.575829 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1255/2515] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:01:55 2022] DELETE /identity/v3/users/89f94b41bbc442d3bc065a0487de7259 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:01:55.580268 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d347d-a21c-47a5-ad5b-f5abfc157943 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:01:55.580553 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d347d-a21c-47a5-ad5b-f5abfc157943 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:01:55.580826 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d347d-a21c-47a5-ad5b-f5abfc157943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:01:55.597658 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-b05d347d-a21c-47a5-ad5b-f5abfc157943 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:01:55.599363 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-b05d347d-a21c-47a5-ad5b-f5abfc157943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:01:55.656172 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1261/2516] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:01:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:01:55.666140 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc55c4ba-a424-4e12-a62b-ebcd3f42095a admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:01:55.667597 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-cc55c4ba-a424-4e12-a62b-ebcd3f42095a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:01:55.681485 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:01:55.729309 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc55c4ba-a424-4e12-a62b-ebcd3f42095a admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:01:55.733363 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787654e2-ed0a-437f-abdd-01368a77c84a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:01:55.734015 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787654e2-ed0a-437f-abdd-01368a77c84a service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:01:55.734299 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787654e2-ed0a-437f-abdd-01368a77c84a service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:01:55.734572 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787654e2-ed0a-437f-abdd-01368a77c84a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:01:55.746899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787654e2-ed0a-437f-abdd-01368a77c84a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:01:55.748398 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787654e2-ed0a-437f-abdd-01368a77c84a service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:01:55.759438 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1256/2517] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:01:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:01:55.933448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d347d-a21c-47a5-ad5b-f5abfc157943 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:01:55.934889 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-b05d347d-a21c-47a5-ad5b-f5abfc157943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:01:55.948912 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d347d-a21c-47a5-ad5b-f5abfc157943 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:01:55.953851 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d42ac-cf7c-43b3-90b8-2dbd6a3f9271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:01:55.955337 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d42ac-cf7c-43b3-90b8-2dbd6a3f9271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:01:55.955994 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d42ac-cf7c-43b3-90b8-2dbd6a3f9271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:01:55.956270 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d42ac-cf7c-43b3-90b8-2dbd6a3f9271 admin admin] PATH_INFO: `/v3/projects/8a84f7c6c96c4a43bf6f2f4a59725156` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:01:55.957450 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813d42ac-cf7c-43b3-90b8-2dbd6a3f9271 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a84f7c6c96c4a43bf6f2f4a59725156)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:01:55.959897 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813d42ac-cf7c-43b3-90b8-2dbd6a3f9271 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:01:56.006455 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-813d42ac-cf7c-43b3-90b8-2dbd6a3f9271 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a84f7c6c96c4a43bf6f2f4a59725156', 'request_id': 'req-813d42ac-cf7c-43b3-90b8-2dbd6a3f9271'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:01:56.011890 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-813d42ac-cf7c-43b3-90b8-2dbd6a3f9271 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a84f7c6c96c4a43bf6f2f4a59725156', 'request_id': 'req-813d42ac-cf7c-43b3-90b8-2dbd6a3f9271'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:01:56.019228 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-813d42ac-cf7c-43b3-90b8-2dbd6a3f9271 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a84f7c6c96c4a43bf6f2f4a59725156', 'request_id': 'req-813d42ac-cf7c-43b3-90b8-2dbd6a3f9271'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:01:56.027109 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:01:56.031444 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-813d42ac-cf7c-43b3-90b8-2dbd6a3f9271 admin admin] The token cache is being invalidate because project 8a84f7c6c96c4a43bf6f2f4a59725156 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:01:56.031956 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-813d42ac-cf7c-43b3-90b8-2dbd6a3f9271 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:01:56.032724 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-813d42ac-cf7c-43b3-90b8-2dbd6a3f9271 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:01:56.034722 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1262/2518] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:01:55 2022] DELETE /identity/v3/projects/8a84f7c6c96c4a43bf6f2f4a59725156 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:02:05.754674 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=21 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:02:07.624638 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd97ec4-1d3f-458d-b9f4-24cc075f959b None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:02:07.625195 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd97ec4-1d3f-458d-b9f4-24cc075f959b None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:02:07.625195 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd97ec4-1d3f-458d-b9f4-24cc075f959b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:02:07.642842 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-bfd97ec4-1d3f-458d-b9f4-24cc075f959b None None] MFA Rules not processed for user `a55cbe88e78e4f3a82b8703a3b1804e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:02:07.644065 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-bfd97ec4-1d3f-458d-b9f4-24cc075f959b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:02:07.701938 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1257/2519] 10.222.0.15 () {58 vars in 1009 bytes} [Fri Jun 3 12:02:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:02:07.724225 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d42ac-cf7c-43b3-90b8-2dbd6a3f9271 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:02:07.725611 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-813d42ac-cf7c-43b3-90b8-2dbd6a3f9271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:02:07.793224 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d42ac-cf7c-43b3-90b8-2dbd6a3f9271 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:02:07.798082 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1e4bb-8002-4046-8ae1-1e371539bebc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f52901fe535420bb0019272d4eafe72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:02:07.798717 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1e4bb-8002-4046-8ae1-1e371539bebc service swift] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:02:07.798997 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1e4bb-8002-4046-8ae1-1e371539bebc service swift] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:02:07.799269 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1e4bb-8002-4046-8ae1-1e371539bebc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:02:07.807572 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1e4bb-8002-4046-8ae1-1e371539bebc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:02:07.810287 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1e4bb-8002-4046-8ae1-1e371539bebc service swift] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:02:07.817958 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1263/2520] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Jun 3 12:02:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 12:02:17.694282 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=25 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:02:17.814531 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=32 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:02:21.468871 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950fc37-625f-42b3-9f8e-bba79c288090 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:02:21.469428 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950fc37-625f-42b3-9f8e-bba79c288090 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:02:21.469537 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950fc37-625f-42b3-9f8e-bba79c288090 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:02:21.470910 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1258/2521] 10.222.0.15 () {54 vars in 921 bytes} [Fri Jun 3 12:02:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:02:21.476723 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa64257-1e29-4552-89fb-27e8074b7355 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:02:21.477188 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa64257-1e29-4552-89fb-27e8074b7355 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:02:21.477293 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa64257-1e29-4552-89fb-27e8074b7355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:02:21.530268 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-0aa64257-1e29-4552-89fb-27e8074b7355 None None] MFA Rules not processed for user `6247bfb7aebd45eeb97ba5933be44c6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:02:21.531549 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-0aa64257-1e29-4552-89fb-27e8074b7355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:02:21.608595 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1264/2522] 10.222.0.15 () {58 vars in 1018 bytes} [Fri Jun 3 12:02:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:02:21.620888 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950fc37-625f-42b3-9f8e-bba79c288090 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:02:21.622562 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-c950fc37-625f-42b3-9f8e-bba79c288090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:02:21.700076 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950fc37-625f-42b3-9f8e-bba79c288090 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:02:21.703484 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8ddb4-1e38-45c0-841b-c419fcf0a88a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aa048aec48b4755ac13eae997bff2fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:02:21.704145 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8ddb4-1e38-45c0-841b-c419fcf0a88a service glance] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:02:21.704424 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8ddb4-1e38-45c0-841b-c419fcf0a88a service glance] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:02:21.704694 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8ddb4-1e38-45c0-841b-c419fcf0a88a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:02:21.714532 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b8ddb4-1e38-45c0-841b-c419fcf0a88a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:02:21.715988 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b8ddb4-1e38-45c0-841b-c419fcf0a88a service glance] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:02:21.726795 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1259/2523] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:02:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:02:21.792562 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0ff9a-65ad-489c-8006-6fc586216ccc None None] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:02:21.792857 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0ff9a-65ad-489c-8006-6fc586216ccc None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:02:21.793134 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0ff9a-65ad-489c-8006-6fc586216ccc None None] PATH_INFO: `/` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:02:21.794490 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1265/2524] 10.222.0.15 () {54 vars in 921 bytes} [Fri Jun 3 12:02:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:02:21.799384 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab022ca0-996b-471a-b205-9b3b25269603 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:02:21.799700 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab022ca0-996b-471a-b205-9b3b25269603 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:02:21.799984 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab022ca0-996b-471a-b205-9b3b25269603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:02:21.818292 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-ab022ca0-996b-471a-b205-9b3b25269603 None None] MFA Rules not processed for user `a78b4284099546cd9c126a5739380b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:02:21.819466 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-ab022ca0-996b-471a-b205-9b3b25269603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:02:21.868711 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1260/2525] 10.222.0.15 () {58 vars in 1018 bytes} [Fri Jun 3 12:02:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:02:21.879986 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0ff9a-65ad-489c-8006-6fc586216ccc None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:02:21.881739 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-d6b0ff9a-65ad-489c-8006-6fc586216ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:02:21.894680 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0ff9a-65ad-489c-8006-6fc586216ccc None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:02:21.898577 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2011534f-6091-46c8-8efe-58734d06f781 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:02:21.899213 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011534f-6091-46c8-8efe-58734d06f781 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:02:21.899493 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011534f-6091-46c8-8efe-58734d06f781 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:02:21.899795 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011534f-6091-46c8-8efe-58734d06f781 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:02:21.907115 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2011534f-6091-46c8-8efe-58734d06f781 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:02:21.908577 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2011534f-6091-46c8-8efe-58734d06f781 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:02:21.916852 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1266/2526] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:02:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:02:22.030261 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfca735-e58e-4cd9-af52-4098d14d33c2 None None] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:02:22.030547 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfca735-e58e-4cd9-af52-4098d14d33c2 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:02:22.030823 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfca735-e58e-4cd9-af52-4098d14d33c2 None None] PATH_INFO: `/` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:02:22.032459 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1261/2527] 10.222.0.15 () {54 vars in 921 bytes} [Fri Jun 3 12:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 03 12:02:22.038654 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7425fe-d75e-4ef4-aefc-08029a4b8f2a None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:02:22.038964 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7425fe-d75e-4ef4-aefc-08029a4b8f2a None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:02:22.039237 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7425fe-d75e-4ef4-aefc-08029a4b8f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:02:22.057533 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-8a7425fe-d75e-4ef4-aefc-08029a4b8f2a None None] MFA Rules not processed for user `6247bfb7aebd45eeb97ba5933be44c6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:02:22.058721 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-8a7425fe-d75e-4ef4-aefc-08029a4b8f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:02:22.069243 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1267/2528] 10.222.0.15 () {58 vars in 1018 bytes} [Fri Jun 3 12:02:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:02:22.080158 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfca735-e58e-4cd9-af52-4098d14d33c2 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:02:22.092772 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfca735-e58e-4cd9-af52-4098d14d33c2 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:02:22.096464 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc27cef-1946-438b-b7b5-c88775a6eac5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:02:22.097100 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc27cef-1946-438b-b7b5-c88775a6eac5 service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:02:22.097378 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc27cef-1946-438b-b7b5-c88775a6eac5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:02:22.098214 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc27cef-1946-438b-b7b5-c88775a6eac5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:02:22.108651 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc27cef-1946-438b-b7b5-c88775a6eac5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:02:22.110169 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc27cef-1946-438b-b7b5-c88775a6eac5 service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:02:22.121319 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1262/2529] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:02:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 12:02:24.658384 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf20496-982f-4cb1-aafd-4188662ace0e None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:02:24.658877 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf20496-982f-4cb1-aafd-4188662ace0e None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:02:24.658969 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf20496-982f-4cb1-aafd-4188662ace0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:02:24.676197 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-cdf20496-982f-4cb1-aafd-4188662ace0e None None] MFA Rules not processed for user `a55cbe88e78e4f3a82b8703a3b1804e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:02:24.677382 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-cdf20496-982f-4cb1-aafd-4188662ace0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:02:24.684385 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1268/2530] 10.222.0.15 () {58 vars in 1009 bytes} [Fri Jun 3 12:02:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:02:24.696449 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc27cef-1946-438b-b7b5-c88775a6eac5 service neutron] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:02:24.707424 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc27cef-1946-438b-b7b5-c88775a6eac5 service neutron] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:02:24.712923 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa93375-0b33-41aa-ab5e-4f472bfcfc95 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f52901fe535420bb0019272d4eafe72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:02:24.713571 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa93375-0b33-41aa-ab5e-4f472bfcfc95 service swift] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:02:24.713851 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa93375-0b33-41aa-ab5e-4f472bfcfc95 service swift] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:02:24.714120 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa93375-0b33-41aa-ab5e-4f472bfcfc95 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:02:24.721910 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa93375-0b33-41aa-ab5e-4f472bfcfc95 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:02:24.723480 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa93375-0b33-41aa-ab5e-4f472bfcfc95 service swift] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:02:24.731283 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1263/2531] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Jun 3 12:02:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 12:02:34.671114 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=58 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:02:34.728175 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=70 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:02:52.975151 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c3014-7359-43cd-ad5f-55d4c7e2a670 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:02:52.975668 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c3014-7359-43cd-ad5f-55d4c7e2a670 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:02:52.975775 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c3014-7359-43cd-ad5f-55d4c7e2a670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:02:52.993740 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-ff3c3014-7359-43cd-ad5f-55d4c7e2a670 None None] MFA Rules not processed for user `a55cbe88e78e4f3a82b8703a3b1804e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:02:52.994918 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-ff3c3014-7359-43cd-ad5f-55d4c7e2a670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:02:53.002427 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1269/2532] 10.222.0.15 () {58 vars in 967 bytes} [Fri Jun 3 12:02:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:02:53.015966 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa93375-0b33-41aa-ab5e-4f472bfcfc95 service swift] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:02:53.027209 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa93375-0b33-41aa-ab5e-4f472bfcfc95 service swift] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:02:53.032387 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61dfcf2-a06b-4a38-ab0f-9861673fc587 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f52901fe535420bb0019272d4eafe72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:02:53.033022 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61dfcf2-a06b-4a38-ab0f-9861673fc587 service swift] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:02:53.033305 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61dfcf2-a06b-4a38-ab0f-9861673fc587 service swift] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:02:53.033608 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61dfcf2-a06b-4a38-ab0f-9861673fc587 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:02:53.041668 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61dfcf2-a06b-4a38-ab0f-9861673fc587 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:02:53.043295 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61dfcf2-a06b-4a38-ab0f-9861673fc587 service swift] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:02:53.052044 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1264/2533] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Jun 3 12:02:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 12:03:02.988952 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:03:03.048288 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=6 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:03:07.482417 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d584b07-4ae5-43a5-8e81-4af7003554e9 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:03:07.482952 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d584b07-4ae5-43a5-8e81-4af7003554e9 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:03:07.483057 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d584b07-4ae5-43a5-8e81-4af7003554e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:03:07.500129 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-7d584b07-4ae5-43a5-8e81-4af7003554e9 None None] MFA Rules not processed for user `abcc58cb66804297b184e41726c281bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:03:07.501305 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-7d584b07-4ae5-43a5-8e81-4af7003554e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:03:07.555159 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1270/2534] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:03:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:03:17.548653 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=25 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:03:49.354588 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61dfcf2-a06b-4a38-ab0f-9861673fc587 service swift] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:03:49.356041 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-a61dfcf2-a06b-4a38-ab0f-9861673fc587 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:03:49.371859 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61dfcf2-a06b-4a38-ab0f-9861673fc587 service swift] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:03:49.377087 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056256ca-4635-4d2e-9625-ff13eb193a59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:03:49.377744 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056256ca-4635-4d2e-9625-ff13eb193a59 service nova] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:03:49.378024 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056256ca-4635-4d2e-9625-ff13eb193a59 service nova] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:03:49.378295 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056256ca-4635-4d2e-9625-ff13eb193a59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:03:49.380698 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-056256ca-4635-4d2e-9625-ff13eb193a59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:03:49.436432 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056256ca-4635-4d2e-9625-ff13eb193a59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:03:49.438022 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056256ca-4635-4d2e-9625-ff13eb193a59 service nova] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:03:49.447687 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1265/2535] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:03:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:03:49.603028 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d584b07-4ae5-43a5-8e81-4af7003554e9 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:03:49.604368 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-7d584b07-4ae5-43a5-8e81-4af7003554e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:03:49.658966 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d584b07-4ae5-43a5-8e81-4af7003554e9 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:03:49.662996 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecffac9e-46b4-43b1-a252-bf6363da0f7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:03:49.663670 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffac9e-46b4-43b1-a252-bf6363da0f7e service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:03:49.663950 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffac9e-46b4-43b1-a252-bf6363da0f7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:03:49.664223 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffac9e-46b4-43b1-a252-bf6363da0f7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:03:49.665925 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-ecffac9e-46b4-43b1-a252-bf6363da0f7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:03:49.679389 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecffac9e-46b4-43b1-a252-bf6363da0f7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:03:49.680826 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecffac9e-46b4-43b1-a252-bf6363da0f7e service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:03:49.691443 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1271/2536] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:03:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:03:52.216180 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056256ca-4635-4d2e-9625-ff13eb193a59 service nova] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:03:52.217669 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-056256ca-4635-4d2e-9625-ff13eb193a59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:03:52.229868 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056256ca-4635-4d2e-9625-ff13eb193a59 service nova] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:03:52.233446 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a0929-7db1-4b19-a582-182cd4d96e42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:03:52.234085 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a0929-7db1-4b19-a582-182cd4d96e42 service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:03:52.234372 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a0929-7db1-4b19-a582-182cd4d96e42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:03:52.234651 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a0929-7db1-4b19-a582-182cd4d96e42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:03:52.236412 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-499a0929-7db1-4b19-a582-182cd4d96e42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:03:52.250031 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499a0929-7db1-4b19-a582-182cd4d96e42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:03:52.251458 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499a0929-7db1-4b19-a582-182cd4d96e42 service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:03:52.262327 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1266/2537] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:03:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:03:55.153231 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecffac9e-46b4-43b1-a252-bf6363da0f7e service cinder] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:03:55.154762 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-ecffac9e-46b4-43b1-a252-bf6363da0f7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:03:55.170172 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecffac9e-46b4-43b1-a252-bf6363da0f7e service cinder] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:03:55.176847 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d907a-7581-434c-9255-b550d7d14e67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:03:55.177516 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d907a-7581-434c-9255-b550d7d14e67 service nova] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:03:55.177803 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d907a-7581-434c-9255-b550d7d14e67 service nova] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:03:55.178084 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d907a-7581-434c-9255-b550d7d14e67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:03:55.179977 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-315d907a-7581-434c-9255-b550d7d14e67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:03:55.194010 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d907a-7581-434c-9255-b550d7d14e67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:03:55.195554 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d907a-7581-434c-9255-b550d7d14e67 service nova] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:03:55.211815 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1272/2538] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:03:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:03:57.948889 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909a1ce-9d3e-4616-8fa7-25a118a3ccc0 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:03:57.949362 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909a1ce-9d3e-4616-8fa7-25a118a3ccc0 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:03:57.949362 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909a1ce-9d3e-4616-8fa7-25a118a3ccc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:03:57.966534 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-a909a1ce-9d3e-4616-8fa7-25a118a3ccc0 None None] MFA Rules not processed for user `b76f9ea7268a4e70a402f3c9ea6220e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:03:57.967752 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-a909a1ce-9d3e-4616-8fa7-25a118a3ccc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:03:57.974457 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1267/2539] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:03:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:03:58.279156 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d907a-7581-434c-9255-b550d7d14e67 service nova] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:03:58.288772 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d907a-7581-434c-9255-b550d7d14e67 service nova] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:03:58.292512 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c1766-1ca0-4240-8529-77b173068fc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:03:58.293161 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c1766-1ca0-4240-8529-77b173068fc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:03:58.293450 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c1766-1ca0-4240-8529-77b173068fc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:03:58.293730 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c1766-1ca0-4240-8529-77b173068fc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:03:58.295635 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-490c1766-1ca0-4240-8529-77b173068fc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:03:58.306162 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c1766-1ca0-4240-8529-77b173068fc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:03:58.307848 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c1766-1ca0-4240-8529-77b173068fc2 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:03:58.318348 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1273/2540] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:03:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:03:58.622231 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909a1ce-9d3e-4616-8fa7-25a118a3ccc0 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:03:58.623683 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-a909a1ce-9d3e-4616-8fa7-25a118a3ccc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:03:58.693342 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909a1ce-9d3e-4616-8fa7-25a118a3ccc0 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:03:58.698331 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06658a3c-bad5-4bb3-b962-198e8f3a2beb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5a91437dd64e2491ce41b4d12d4835', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:03:58.698984 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06658a3c-bad5-4bb3-b962-198e8f3a2beb service placement] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:03:58.699266 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06658a3c-bad5-4bb3-b962-198e8f3a2beb service placement] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:03:58.699567 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06658a3c-bad5-4bb3-b962-198e8f3a2beb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:03:58.701285 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-06658a3c-bad5-4bb3-b962-198e8f3a2beb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:03:58.713172 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06658a3c-bad5-4bb3-b962-198e8f3a2beb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:03:58.714770 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06658a3c-bad5-4bb3-b962-198e8f3a2beb service placement] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:03:58.724733 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1268/2541] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:03:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:04:00.578658 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c1766-1ca0-4240-8529-77b173068fc2 service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:04:00.588078 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c1766-1ca0-4240-8529-77b173068fc2 service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:04:00.591825 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e4549-1dff-420e-bb1f-e2ee498da97a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:04:00.592734 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e4549-1dff-420e-bb1f-e2ee498da97a service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:04:00.593022 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e4549-1dff-420e-bb1f-e2ee498da97a service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:04:00.593360 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e4549-1dff-420e-bb1f-e2ee498da97a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:04:00.595188 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-241e4549-1dff-420e-bb1f-e2ee498da97a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:04:00.607775 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e4549-1dff-420e-bb1f-e2ee498da97a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:04:00.609496 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e4549-1dff-420e-bb1f-e2ee498da97a service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:04:00.618560 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1274/2542] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:04:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:04:07.018073 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06658a3c-bad5-4bb3-b962-198e8f3a2beb service placement] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:04:07.028756 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06658a3c-bad5-4bb3-b962-198e8f3a2beb service placement] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:04:07.032559 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6166f4-6345-48d3-83dc-f58b6a2821c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:04:07.033212 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6166f4-6345-48d3-83dc-f58b6a2821c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:04:07.033494 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6166f4-6345-48d3-83dc-f58b6a2821c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:04:07.033769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6166f4-6345-48d3-83dc-f58b6a2821c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:04:07.035828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-ae6166f4-6345-48d3-83dc-f58b6a2821c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:04:07.053964 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6166f4-6345-48d3-83dc-f58b6a2821c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:04:07.055601 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6166f4-6345-48d3-83dc-f58b6a2821c5 service cinder] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:04:07.066393 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1269/2543] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:04:07 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:04:08.482166 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e4549-1dff-420e-bb1f-e2ee498da97a service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:04:08.496083 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e4549-1dff-420e-bb1f-e2ee498da97a service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:04:08.502200 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9525ea-5950-4cf0-80d4-13da0eafbd5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:04:08.502835 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9525ea-5950-4cf0-80d4-13da0eafbd5d service nova] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:04:08.503115 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9525ea-5950-4cf0-80d4-13da0eafbd5d service nova] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:04:08.503390 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9525ea-5950-4cf0-80d4-13da0eafbd5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:04:08.505176 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-cd9525ea-5950-4cf0-80d4-13da0eafbd5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:04:08.517571 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9525ea-5950-4cf0-80d4-13da0eafbd5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:04:08.519116 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9525ea-5950-4cf0-80d4-13da0eafbd5d service nova] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:04:08.529973 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1275/2544] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:04:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:04:17.060963 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=75 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:04:18.526090 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=50 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:04:30.169523 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6166f4-6345-48d3-83dc-f58b6a2821c5 service cinder] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:04:30.179558 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6166f4-6345-48d3-83dc-f58b6a2821c5 service cinder] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:04:30.183083 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6bc44-31a6-4e2f-a0c6-1ef6bd8c018e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:04:30.183747 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6bc44-31a6-4e2f-a0c6-1ef6bd8c018e service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:04:30.184033 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6bc44-31a6-4e2f-a0c6-1ef6bd8c018e service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:04:30.184311 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6bc44-31a6-4e2f-a0c6-1ef6bd8c018e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:04:30.186109 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-3de6bc44-31a6-4e2f-a0c6-1ef6bd8c018e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:04:30.249298 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de6bc44-31a6-4e2f-a0c6-1ef6bd8c018e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:04:30.250746 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de6bc44-31a6-4e2f-a0c6-1ef6bd8c018e service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:04:30.260337 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1270/2545] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:04:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:04:33.520917 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9525ea-5950-4cf0-80d4-13da0eafbd5d service nova] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:04:33.522794 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-cd9525ea-5950-4cf0-80d4-13da0eafbd5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:04:33.536520 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9525ea-5950-4cf0-80d4-13da0eafbd5d service nova] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:04:33.541202 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a6ef3-3aea-45f1-9db0-d6551bdd8216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:04:33.542062 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a6ef3-3aea-45f1-9db0-d6551bdd8216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:04:33.542418 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a6ef3-3aea-45f1-9db0-d6551bdd8216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:04:33.542690 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a6ef3-3aea-45f1-9db0-d6551bdd8216 admin admin] PATH_INFO: `/v3/users/abcc58cb66804297b184e41726c281bb` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:04:33.543904 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a6ef3-3aea-45f1-9db0-d6551bdd8216 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abcc58cb66804297b184e41726c281bb)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:04:33.545808 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a6ef3-3aea-45f1-9db0-d6551bdd8216 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:04:33.592661 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-f79a6ef3-3aea-45f1-9db0-d6551bdd8216 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abcc58cb66804297b184e41726c281bb'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:04:33.599559 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-f79a6ef3-3aea-45f1-9db0-d6551bdd8216 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abcc58cb66804297b184e41726c281bb'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:04:33.600229 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-f79a6ef3-3aea-45f1-9db0-d6551bdd8216 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abcc58cb66804297b184e41726c281bb'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:04:33.611905 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-f79a6ef3-3aea-45f1-9db0-d6551bdd8216 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abcc58cb66804297b184e41726c281bb'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:04:33.619936 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-f79a6ef3-3aea-45f1-9db0-d6551bdd8216 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abcc58cb66804297b184e41726c281bb'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:04:33.625910 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1276/2546] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:04:33 2022] DELETE /identity/v3/users/abcc58cb66804297b184e41726c281bb => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:04:33.798144 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6bc44-31a6-4e2f-a0c6-1ef6bd8c018e service neutron] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:04:33.810217 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6bc44-31a6-4e2f-a0c6-1ef6bd8c018e service neutron] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:04:33.866968 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3f021-73ad-41ce-a528-8fc3c84da09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:04:33.867784 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3f021-73ad-41ce-a528-8fc3c84da09e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:04:33.868070 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3f021-73ad-41ce-a528-8fc3c84da09e admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:04:33.868349 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3f021-73ad-41ce-a528-8fc3c84da09e admin admin] PATH_INFO: `/v3/projects/799fb68a55084528ab5573051a1bf121` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:04:33.869529 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f3f021-73ad-41ce-a528-8fc3c84da09e admin admin] RBAC: Authorizing `identity:delete_project(project_id=799fb68a55084528ab5573051a1bf121)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:04:33.871433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f3f021-73ad-41ce-a528-8fc3c84da09e admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:04:33.917110 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-c5f3f021-73ad-41ce-a528-8fc3c84da09e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '799fb68a55084528ab5573051a1bf121', 'request_id': 'req-c5f3f021-73ad-41ce-a528-8fc3c84da09e'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:04:33.922460 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-c5f3f021-73ad-41ce-a528-8fc3c84da09e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '799fb68a55084528ab5573051a1bf121', 'request_id': 'req-c5f3f021-73ad-41ce-a528-8fc3c84da09e'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:04:33.929921 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-c5f3f021-73ad-41ce-a528-8fc3c84da09e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '799fb68a55084528ab5573051a1bf121', 'request_id': 'req-c5f3f021-73ad-41ce-a528-8fc3c84da09e'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:04:33.940569 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-c5f3f021-73ad-41ce-a528-8fc3c84da09e admin admin] The token cache is being invalidate because project 799fb68a55084528ab5573051a1bf121 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:04:33.940855 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-c5f3f021-73ad-41ce-a528-8fc3c84da09e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:04:33.941471 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-c5f3f021-73ad-41ce-a528-8fc3c84da09e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:04:33.942993 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1271/2547] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:04:33 2022] DELETE /identity/v3/projects/799fb68a55084528ab5573051a1bf121 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:04:33.947938 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cf5fe-f5a5-4e7c-98f7-614c7c68527b None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:04:33.948226 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cf5fe-f5a5-4e7c-98f7-614c7c68527b None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:04:33.948503 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cf5fe-f5a5-4e7c-98f7-614c7c68527b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:04:33.965889 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-4e7cf5fe-f5a5-4e7c-98f7-614c7c68527b None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:04:33.967061 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-4e7cf5fe-f5a5-4e7c-98f7-614c7c68527b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:04:34.025086 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1277/2548] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:04:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:04:34.032540 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df7cca-ee8d-41e3-addd-818112f88d6a None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:04:34.032830 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df7cca-ee8d-41e3-addd-818112f88d6a None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:04:34.033105 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df7cca-ee8d-41e3-addd-818112f88d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:04:34.051283 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-c0df7cca-ee8d-41e3-addd-818112f88d6a None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:04:34.053046 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-c0df7cca-ee8d-41e3-addd-818112f88d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:04:34.060753 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1272/2549] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:04:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:04:34.064757 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7cf5fe-f5a5-4e7c-98f7-614c7c68527b None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:04:34.074512 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7cf5fe-f5a5-4e7c-98f7-614c7c68527b None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:04:34.079204 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34063418-ba34-4ad2-93e3-aa82c93e8158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:04:34.079877 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34063418-ba34-4ad2-93e3-aa82c93e8158 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:04:34.080160 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34063418-ba34-4ad2-93e3-aa82c93e8158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:04:34.080437 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34063418-ba34-4ad2-93e3-aa82c93e8158 admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:04:34.081158 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34063418-ba34-4ad2-93e3-aa82c93e8158 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:04:34.081466 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34063418-ba34-4ad2-93e3-aa82c93e8158 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:04:34.083065 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34063418-ba34-4ad2-93e3-aa82c93e8158 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:04:34.094467 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1278/2550] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 12:04:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:04:34.099154 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df7cca-ee8d-41e3-addd-818112f88d6a None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:04:34.108839 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df7cca-ee8d-41e3-addd-818112f88d6a None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:04:34.113640 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad95af-c24f-44c1-82ee-274eda7f3aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:04:34.114978 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad95af-c24f-44c1-82ee-274eda7f3aeb admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:04:34.115317 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad95af-c24f-44c1-82ee-274eda7f3aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:04:34.115646 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad95af-c24f-44c1-82ee-274eda7f3aeb admin admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:04:34.116376 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad95af-c24f-44c1-82ee-274eda7f3aeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:04:34.118366 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad95af-c24f-44c1-82ee-274eda7f3aeb admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:04:34.133870 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:04:34.152302 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1273/2551] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 12:04:34 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:04:34.153113 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34063418-ba34-4ad2-93e3-aa82c93e8158 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:04:34.164295 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34063418-ba34-4ad2-93e3-aa82c93e8158 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:04:34.222889 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b47bd-888c-4b9d-9f9b-2b42426362b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:04:34.223620 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b47bd-888c-4b9d-9f9b-2b42426362b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:04:34.224422 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b47bd-888c-4b9d-9f9b-2b42426362b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:04:34.224704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b47bd-888c-4b9d-9f9b-2b42426362b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:04:34.225388 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b47bd-888c-4b9d-9f9b-2b42426362b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:04:34.227294 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b47bd-888c-4b9d-9f9b-2b42426362b3 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:04:34.234003 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:04:34.249472 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1279/2552] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 12:04:34 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:04:34.253577 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad95af-c24f-44c1-82ee-274eda7f3aeb admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:04:34.264823 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad95af-c24f-44c1-82ee-274eda7f3aeb admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:04:34.269490 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b716c49-4d22-4b86-821b-a7bb732a0aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:04:34.270184 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b716c49-4d22-4b86-821b-a7bb732a0aae admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:04:34.270983 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b716c49-4d22-4b86-821b-a7bb732a0aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:04:34.271269 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b716c49-4d22-4b86-821b-a7bb732a0aae admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:04:34.272448 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b716c49-4d22-4b86-821b-a7bb732a0aae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:04:34.274250 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b716c49-4d22-4b86-821b-a7bb732a0aae admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:04:34.285879 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1274/2553] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 12:04:34.290209 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b47bd-888c-4b9d-9f9b-2b42426362b3 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:04:34.300808 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b47bd-888c-4b9d-9f9b-2b42426362b3 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:04:34.306131 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef18c02-a4ea-4060-977a-1279714ec6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:04:34.306796 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef18c02-a4ea-4060-977a-1279714ec6fe admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:04:34.307104 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef18c02-a4ea-4060-977a-1279714ec6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:04:34.307348 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef18c02-a4ea-4060-977a-1279714ec6fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:04:34.308122 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef18c02-a4ea-4060-977a-1279714ec6fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:04:34.309935 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef18c02-a4ea-4060-977a-1279714ec6fe admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:04:34.320740 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1280/2554] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:04:34.324864 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b716c49-4d22-4b86-821b-a7bb732a0aae admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:04:34.336114 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b716c49-4d22-4b86-821b-a7bb732a0aae admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:04:34.340921 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362df3b3-c7d9-4112-86dd-a4e093fc087e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:04:34.341873 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362df3b3-c7d9-4112-86dd-a4e093fc087e admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:04:34.342158 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362df3b3-c7d9-4112-86dd-a4e093fc087e admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:04:34.342432 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362df3b3-c7d9-4112-86dd-a4e093fc087e admin admin] PATH_INFO: `/v3/projects/db41a74c9582485b9def49d558170121/users/76db57106a684c7592dc8cba4bc0a9d7/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:04:34.358109 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362df3b3-c7d9-4112-86dd-a4e093fc087e admin admin] RBAC: Authorizing `identity:create_grant(project_id=db41a74c9582485b9def49d558170121, user_id=76db57106a684c7592dc8cba4bc0a9d7, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:04:34.360849 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362df3b3-c7d9-4112-86dd-a4e093fc087e admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:04:34.373807 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1275/2555] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:04:34 2022] PUT /identity/v3/projects/db41a74c9582485b9def49d558170121/users/76db57106a684c7592dc8cba4bc0a9d7/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:04:34.378755 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff0d82-45ea-4034-9048-7dfd4de07ad1 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:04:34.379031 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff0d82-45ea-4034-9048-7dfd4de07ad1 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:04:34.379336 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff0d82-45ea-4034-9048-7dfd4de07ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:04:34.397392 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-feff0d82-45ea-4034-9048-7dfd4de07ad1 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:04:34.398574 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-feff0d82-45ea-4034-9048-7dfd4de07ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:04:34.458321 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1281/2556] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:04:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:04:34.468592 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362df3b3-c7d9-4112-86dd-a4e093fc087e admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:04:34.470319 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-362df3b3-c7d9-4112-86dd-a4e093fc087e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:04:34.528819 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362df3b3-c7d9-4112-86dd-a4e093fc087e admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:04:34.532518 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4cf5c8-7e5d-4916-9b3c-60669250217e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:04:34.533172 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4cf5c8-7e5d-4916-9b3c-60669250217e service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:04:34.533458 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4cf5c8-7e5d-4916-9b3c-60669250217e service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:04:34.533740 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4cf5c8-7e5d-4916-9b3c-60669250217e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:04:34.543597 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4cf5c8-7e5d-4916-9b3c-60669250217e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:04:34.545039 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4cf5c8-7e5d-4916-9b3c-60669250217e service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:04:34.555252 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1276/2557] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:04:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:04:38.527302 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb0237-9fac-434f-a5ca-ec80e8d96aed None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:04:38.527938 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb0237-9fac-434f-a5ca-ec80e8d96aed None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:04:38.527938 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb0237-9fac-434f-a5ca-ec80e8d96aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:04:38.557411 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-0beb0237-9fac-434f-a5ca-ec80e8d96aed None None] MFA Rules not processed for user `76db57106a684c7592dc8cba4bc0a9d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:04:38.558542 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-0beb0237-9fac-434f-a5ca-ec80e8d96aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:04:38.626701 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1282/2558] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:04:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:04:38.641885 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4cf5c8-7e5d-4916-9b3c-60669250217e service neutron] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:04:38.643407 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-bc4cf5c8-7e5d-4916-9b3c-60669250217e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:04:38.733717 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4cf5c8-7e5d-4916-9b3c-60669250217e service neutron] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:04:38.746017 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603e0d4-2999-4e68-a018-c24840f66760 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:04:38.747053 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603e0d4-2999-4e68-a018-c24840f66760 service nova] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:04:38.747558 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603e0d4-2999-4e68-a018-c24840f66760 service nova] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:04:38.748007 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603e0d4-2999-4e68-a018-c24840f66760 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:04:38.758228 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603e0d4-2999-4e68-a018-c24840f66760 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:04:38.760664 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603e0d4-2999-4e68-a018-c24840f66760 service nova] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:04:38.775810 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1277/2559] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:04:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:04:40.061417 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffd69f-6bea-44c9-9994-52d10e7a4875 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:04:40.061903 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffd69f-6bea-44c9-9994-52d10e7a4875 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:04:40.062023 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ffd69f-6bea-44c9-9994-52d10e7a4875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:04:40.080770 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-56ffd69f-6bea-44c9-9994-52d10e7a4875 None None] MFA Rules not processed for user `76db57106a684c7592dc8cba4bc0a9d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:04:40.081952 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-56ffd69f-6bea-44c9-9994-52d10e7a4875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:04:40.088770 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1283/2560] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:04:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:04:48.766715 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=77,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:04:50.074710 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:04:52.449429 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603e0d4-2999-4e68-a018-c24840f66760 service nova] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:04:52.450903 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-8603e0d4-2999-4e68-a018-c24840f66760 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:04:52.465780 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603e0d4-2999-4e68-a018-c24840f66760 service nova] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:04:52.471287 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d89d2-8d0c-448f-81ae-09b79b56ae7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:04:52.471959 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d89d2-8d0c-448f-81ae-09b79b56ae7e service nova] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:04:52.472248 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d89d2-8d0c-448f-81ae-09b79b56ae7e service nova] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:04:52.472521 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d89d2-8d0c-448f-81ae-09b79b56ae7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:04:52.474896 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-8f0d89d2-8d0c-448f-81ae-09b79b56ae7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:04:52.487062 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d89d2-8d0c-448f-81ae-09b79b56ae7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:04:52.488793 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d89d2-8d0c-448f-81ae-09b79b56ae7e service nova] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:04:52.499793 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1278/2561] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:04:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:05:02.494938 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=6 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:05:52.278455 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a7b51-2290-4e1d-a0be-6621099386e5 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:05:52.279013 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a7b51-2290-4e1d-a0be-6621099386e5 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:05:52.279130 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a7b51-2290-4e1d-a0be-6621099386e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:05:52.297989 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-7e0a7b51-2290-4e1d-a0be-6621099386e5 None None] MFA Rules not processed for user `a55cbe88e78e4f3a82b8703a3b1804e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:05:52.299759 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-7e0a7b51-2290-4e1d-a0be-6621099386e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:05:52.365574 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1284/2562] 10.222.0.15 () {58 vars in 1009 bytes} [Fri Jun 3 12:05:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:05:52.412456 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d89d2-8d0c-448f-81ae-09b79b56ae7e service nova] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:05:52.413855 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-8f0d89d2-8d0c-448f-81ae-09b79b56ae7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:05:52.481216 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d89d2-8d0c-448f-81ae-09b79b56ae7e service nova] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:05:52.486041 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f770d9-44bc-405f-8bfd-07d27714102e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f52901fe535420bb0019272d4eafe72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:05:52.487185 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f770d9-44bc-405f-8bfd-07d27714102e service swift] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:05:52.487462 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f770d9-44bc-405f-8bfd-07d27714102e service swift] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:05:52.487763 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f770d9-44bc-405f-8bfd-07d27714102e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:05:52.495727 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f770d9-44bc-405f-8bfd-07d27714102e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:05:52.497310 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f770d9-44bc-405f-8bfd-07d27714102e service swift] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:05:52.505856 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1279/2563] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Jun 3 12:05:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 12:06:02.359300 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=25 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:06:02.502166 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=32 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:06:06.742853 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a7b51-2290-4e1d-a0be-6621099386e5 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:06:06.753352 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a7b51-2290-4e1d-a0be-6621099386e5 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:06:06.757716 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00541b6-e21d-42de-9e4d-7b51322ef866 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:06:06.758507 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00541b6-e21d-42de-9e4d-7b51322ef866 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:06:06.758894 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00541b6-e21d-42de-9e4d-7b51322ef866 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:06:06.759275 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00541b6-e21d-42de-9e4d-7b51322ef866 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:06:06.761517 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-a00541b6-e21d-42de-9e4d-7b51322ef866 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:06:06.774687 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00541b6-e21d-42de-9e4d-7b51322ef866 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:06:06.776149 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00541b6-e21d-42de-9e4d-7b51322ef866 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:06:06.785858 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1285/2564] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:06:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:06:08.049274 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f770d9-44bc-405f-8bfd-07d27714102e service swift] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:06:08.060084 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f770d9-44bc-405f-8bfd-07d27714102e service swift] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:06:08.063713 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b5fba-1376-4bf2-996f-b5f222e2190d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:06:08.065038 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b5fba-1376-4bf2-996f-b5f222e2190d service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:06:08.065486 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b5fba-1376-4bf2-996f-b5f222e2190d service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:06:08.065803 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b5fba-1376-4bf2-996f-b5f222e2190d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:06:08.067635 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-4e4b5fba-1376-4bf2-996f-b5f222e2190d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:06:08.131411 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4b5fba-1376-4bf2-996f-b5f222e2190d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:06:08.133087 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4b5fba-1376-4bf2-996f-b5f222e2190d service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:06:08.143367 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1280/2565] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:06:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:06:08.924951 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876f3ea-8176-4fc2-bd1e-3dddb498582c None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:06:08.925439 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876f3ea-8176-4fc2-bd1e-3dddb498582c None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:06:08.925650 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876f3ea-8176-4fc2-bd1e-3dddb498582c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:06:08.946300 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-4876f3ea-8176-4fc2-bd1e-3dddb498582c None None] MFA Rules not processed for user `a55cbe88e78e4f3a82b8703a3b1804e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:06:08.947697 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-4876f3ea-8176-4fc2-bd1e-3dddb498582c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:06:08.958024 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1286/2566] 10.222.0.15 () {58 vars in 1009 bytes} [Fri Jun 3 12:06:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:06:08.970584 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b5fba-1376-4bf2-996f-b5f222e2190d service neutron] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:06:08.983712 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b5fba-1376-4bf2-996f-b5f222e2190d service neutron] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:06:08.989667 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc4649-ce1e-4c81-a895-d7b8bf7d2aae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f52901fe535420bb0019272d4eafe72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:06:08.990328 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc4649-ce1e-4c81-a895-d7b8bf7d2aae service swift] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:06:08.990929 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc4649-ce1e-4c81-a895-d7b8bf7d2aae service swift] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:06:08.990929 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc4649-ce1e-4c81-a895-d7b8bf7d2aae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:06:09.000809 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccc4649-ce1e-4c81-a895-d7b8bf7d2aae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:06:09.003153 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccc4649-ce1e-4c81-a895-d7b8bf7d2aae service swift] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:06:09.036335 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1281/2567] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Jun 3 12:06:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 12:06:18.940651 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=9 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:06:19.009940 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=34 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:06:26.032485 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876f3ea-8176-4fc2-bd1e-3dddb498582c None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:06:26.034414 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-4876f3ea-8176-4fc2-bd1e-3dddb498582c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:06:26.045961 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876f3ea-8176-4fc2-bd1e-3dddb498582c None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:06:26.050355 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f76d8c-3ea2-4879-998d-1affae02b794 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:06:26.050985 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f76d8c-3ea2-4879-998d-1affae02b794 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:06:26.051268 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f76d8c-3ea2-4879-998d-1affae02b794 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:06:26.051568 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f76d8c-3ea2-4879-998d-1affae02b794 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:06:26.053271 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-95f76d8c-3ea2-4879-998d-1affae02b794 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:06:26.064814 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f76d8c-3ea2-4879-998d-1affae02b794 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:06:26.066336 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f76d8c-3ea2-4879-998d-1affae02b794 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:06:26.077242 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1287/2568] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:06:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:06:29.488183 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc4649-ce1e-4c81-a895-d7b8bf7d2aae service swift] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:06:29.489757 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-dccc4649-ce1e-4c81-a895-d7b8bf7d2aae service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:06:29.590944 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc4649-ce1e-4c81-a895-d7b8bf7d2aae service swift] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:06:29.596260 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87484c40-e4c2-4280-856f-1216d6be65c3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5a91437dd64e2491ce41b4d12d4835', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:06:29.596956 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87484c40-e4c2-4280-856f-1216d6be65c3 service placement] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:06:29.597246 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87484c40-e4c2-4280-856f-1216d6be65c3 service placement] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:06:29.597720 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87484c40-e4c2-4280-856f-1216d6be65c3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:06:29.600319 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-87484c40-e4c2-4280-856f-1216d6be65c3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:06:29.613195 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87484c40-e4c2-4280-856f-1216d6be65c3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:06:29.614808 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87484c40-e4c2-4280-856f-1216d6be65c3 service placement] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:06:29.625455 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1282/2569] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:06:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:06:29.671348 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07ad27-ec2f-4fc8-a6de-6e705eda6763 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:06:29.671845 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07ad27-ec2f-4fc8-a6de-6e705eda6763 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:06:29.671980 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07ad27-ec2f-4fc8-a6de-6e705eda6763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:06:29.691257 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-1c07ad27-ec2f-4fc8-a6de-6e705eda6763 None None] MFA Rules not processed for user `a55cbe88e78e4f3a82b8703a3b1804e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:06:29.692732 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-1c07ad27-ec2f-4fc8-a6de-6e705eda6763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:06:29.700665 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1288/2570] 10.222.0.15 () {58 vars in 967 bytes} [Fri Jun 3 12:06:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:06:29.712804 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87484c40-e4c2-4280-856f-1216d6be65c3 service placement] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:06:29.724712 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87484c40-e4c2-4280-856f-1216d6be65c3 service placement] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:06:29.730187 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccd509-d3d1-4fb4-936c-9f7638f67c26 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f52901fe535420bb0019272d4eafe72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:06:29.730838 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccd509-d3d1-4fb4-936c-9f7638f67c26 service swift] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:06:29.731122 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccd509-d3d1-4fb4-936c-9f7638f67c26 service swift] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:06:29.731392 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccd509-d3d1-4fb4-936c-9f7638f67c26 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:06:29.743093 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dccd509-d3d1-4fb4-936c-9f7638f67c26 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:06:29.744724 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dccd509-d3d1-4fb4-936c-9f7638f67c26 service swift] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:06:29.753741 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1283/2571] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Jun 3 12:06:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 12:06:32.923016 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c07ad27-ec2f-4fc8-a6de-6e705eda6763 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:06:32.925357 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-1c07ad27-ec2f-4fc8-a6de-6e705eda6763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:06:32.943774 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c07ad27-ec2f-4fc8-a6de-6e705eda6763 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:06:32.948559 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497fc88-cf4f-42b4-82d4-8dea3cc2493e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:06:32.949639 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497fc88-cf4f-42b4-82d4-8dea3cc2493e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:06:32.949916 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497fc88-cf4f-42b4-82d4-8dea3cc2493e admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:06:32.950184 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497fc88-cf4f-42b4-82d4-8dea3cc2493e admin admin] PATH_INFO: `/v3/users/7d2bcfc5842e4faaa5369a19fce82d26` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:06:32.951415 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b497fc88-cf4f-42b4-82d4-8dea3cc2493e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d2bcfc5842e4faaa5369a19fce82d26)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:06:32.953365 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b497fc88-cf4f-42b4-82d4-8dea3cc2493e admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:06:33.002399 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-b497fc88-cf4f-42b4-82d4-8dea3cc2493e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d2bcfc5842e4faaa5369a19fce82d26'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:06:33.010437 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-b497fc88-cf4f-42b4-82d4-8dea3cc2493e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d2bcfc5842e4faaa5369a19fce82d26'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:06:33.011130 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-b497fc88-cf4f-42b4-82d4-8dea3cc2493e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d2bcfc5842e4faaa5369a19fce82d26'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:06:33.024591 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-b497fc88-cf4f-42b4-82d4-8dea3cc2493e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d2bcfc5842e4faaa5369a19fce82d26'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:06:33.032782 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-b497fc88-cf4f-42b4-82d4-8dea3cc2493e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d2bcfc5842e4faaa5369a19fce82d26'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:06:33.039596 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1289/2572] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:06:32 2022] DELETE /identity/v3/users/7d2bcfc5842e4faaa5369a19fce82d26 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:06:33.235792 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccd509-d3d1-4fb4-936c-9f7638f67c26 service swift] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:06:33.250285 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccd509-d3d1-4fb4-936c-9f7638f67c26 service swift] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:06:33.315041 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57872d06-8da8-4123-946d-c28325b839aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:06:33.315968 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57872d06-8da8-4123-946d-c28325b839aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:06:33.316251 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57872d06-8da8-4123-946d-c28325b839aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:06:33.316523 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57872d06-8da8-4123-946d-c28325b839aa admin admin] PATH_INFO: `/v3/projects/a7c800014a3349c5aeac57178984e4c8` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:06:33.317710 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57872d06-8da8-4123-946d-c28325b839aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7c800014a3349c5aeac57178984e4c8)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:06:33.319683 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57872d06-8da8-4123-946d-c28325b839aa admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:06:33.370972 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-57872d06-8da8-4123-946d-c28325b839aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7c800014a3349c5aeac57178984e4c8', 'request_id': 'req-57872d06-8da8-4123-946d-c28325b839aa'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:06:33.377098 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-57872d06-8da8-4123-946d-c28325b839aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7c800014a3349c5aeac57178984e4c8', 'request_id': 'req-57872d06-8da8-4123-946d-c28325b839aa'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:06:33.384165 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-57872d06-8da8-4123-946d-c28325b839aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7c800014a3349c5aeac57178984e4c8', 'request_id': 'req-57872d06-8da8-4123-946d-c28325b839aa'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:06:33.395870 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-57872d06-8da8-4123-946d-c28325b839aa admin admin] The token cache is being invalidate because project a7c800014a3349c5aeac57178984e4c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:06:33.396156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-57872d06-8da8-4123-946d-c28325b839aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:06:33.397033 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-57872d06-8da8-4123-946d-c28325b839aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:06:33.398600 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1284/2573] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:06:33 2022] DELETE /identity/v3/projects/a7c800014a3349c5aeac57178984e4c8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 12:06:33.402883 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497fc88-cf4f-42b4-82d4-8dea3cc2493e admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:06:33.404297 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-b497fc88-cf4f-42b4-82d4-8dea3cc2493e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:06:33.417931 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497fc88-cf4f-42b4-82d4-8dea3cc2493e admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:06:33.474428 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6220cf11-c015-4548-bed3-be284f443fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:06:33.475280 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220cf11-c015-4548-bed3-be284f443fc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:06:33.475588 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220cf11-c015-4548-bed3-be284f443fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:06:33.475866 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220cf11-c015-4548-bed3-be284f443fc1 admin admin] PATH_INFO: `/v3/users/f7f121785c4848b4a049e709f9402b01` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:06:33.477064 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6220cf11-c015-4548-bed3-be284f443fc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7f121785c4848b4a049e709f9402b01)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:06:33.478981 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6220cf11-c015-4548-bed3-be284f443fc1 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:06:33.523641 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-6220cf11-c015-4548-bed3-be284f443fc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7f121785c4848b4a049e709f9402b01'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:06:33.528840 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:06:33.530932 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-6220cf11-c015-4548-bed3-be284f443fc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7f121785c4848b4a049e709f9402b01'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:06:33.531691 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-6220cf11-c015-4548-bed3-be284f443fc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7f121785c4848b4a049e709f9402b01'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:06:33.545119 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-6220cf11-c015-4548-bed3-be284f443fc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7f121785c4848b4a049e709f9402b01'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:06:33.552021 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-6220cf11-c015-4548-bed3-be284f443fc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7f121785c4848b4a049e709f9402b01'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:06:33.557954 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1290/2574] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:06:33 2022] DELETE /identity/v3/users/f7f121785c4848b4a049e709f9402b01 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:06:33.727983 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57872d06-8da8-4123-946d-c28325b839aa admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:06:33.729790 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-57872d06-8da8-4123-946d-c28325b839aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:06:33.743739 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57872d06-8da8-4123-946d-c28325b839aa admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:06:33.747603 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:06:33.805833 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77019ccd-f300-49ac-b068-476216094005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:06:33.807111 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77019ccd-f300-49ac-b068-476216094005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:06:33.807402 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77019ccd-f300-49ac-b068-476216094005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:06:33.807713 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77019ccd-f300-49ac-b068-476216094005 admin admin] PATH_INFO: `/v3/projects/4c0418da93e7465c82e4d1733e1d9871` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:06:33.808924 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77019ccd-f300-49ac-b068-476216094005 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c0418da93e7465c82e4d1733e1d9871)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:06:33.810844 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77019ccd-f300-49ac-b068-476216094005 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:06:33.856856 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-77019ccd-f300-49ac-b068-476216094005 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c0418da93e7465c82e4d1733e1d9871', 'request_id': 'req-77019ccd-f300-49ac-b068-476216094005'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:06:33.862513 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-77019ccd-f300-49ac-b068-476216094005 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c0418da93e7465c82e4d1733e1d9871', 'request_id': 'req-77019ccd-f300-49ac-b068-476216094005'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:06:33.869688 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-77019ccd-f300-49ac-b068-476216094005 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c0418da93e7465c82e4d1733e1d9871', 'request_id': 'req-77019ccd-f300-49ac-b068-476216094005'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:06:33.880687 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-77019ccd-f300-49ac-b068-476216094005 admin admin] The token cache is being invalidate because project 4c0418da93e7465c82e4d1733e1d9871 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:06:33.880977 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-77019ccd-f300-49ac-b068-476216094005 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:06:33.881605 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-77019ccd-f300-49ac-b068-476216094005 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:06:33.883127 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1285/2575] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:06:33 2022] DELETE /identity/v3/projects/4c0418da93e7465c82e4d1733e1d9871 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:06:33.888032 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef753446-2787-434a-9e74-aa433a026e61 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:06:33.888324 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef753446-2787-434a-9e74-aa433a026e61 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:06:33.888605 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef753446-2787-434a-9e74-aa433a026e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:06:33.907558 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-ef753446-2787-434a-9e74-aa433a026e61 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:06:33.909293 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-ef753446-2787-434a-9e74-aa433a026e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:06:33.966753 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1291/2576] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:06:33.975608 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120096d-aa83-413e-9b4f-a0cef202908f None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:06:33.975898 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120096d-aa83-413e-9b4f-a0cef202908f None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:06:33.976172 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120096d-aa83-413e-9b4f-a0cef202908f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:06:33.994186 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-9120096d-aa83-413e-9b4f-a0cef202908f None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:06:33.995363 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-9120096d-aa83-413e-9b4f-a0cef202908f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:06:34.003152 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1286/2577] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:06:34.008371 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef753446-2787-434a-9e74-aa433a026e61 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:06:34.018655 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef753446-2787-434a-9e74-aa433a026e61 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:06:34.023552 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078265c2-0b1e-4ed5-8f1c-ca1b3e46b059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:06:34.024199 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078265c2-0b1e-4ed5-8f1c-ca1b3e46b059 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:06:34.024735 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078265c2-0b1e-4ed5-8f1c-ca1b3e46b059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:06:34.025017 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078265c2-0b1e-4ed5-8f1c-ca1b3e46b059 admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:06:34.025740 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078265c2-0b1e-4ed5-8f1c-ca1b3e46b059 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:06:34.026049 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078265c2-0b1e-4ed5-8f1c-ca1b3e46b059 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:06:34.027677 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078265c2-0b1e-4ed5-8f1c-ca1b3e46b059 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:06:34.039832 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1292/2578] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 12:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:06:34.043934 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120096d-aa83-413e-9b4f-a0cef202908f None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:06:34.052981 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120096d-aa83-413e-9b4f-a0cef202908f None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:06:34.057581 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323fd29-648a-4db5-8696-f0bf6c343f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:06:34.058216 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323fd29-648a-4db5-8696-f0bf6c343f69 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:06:34.058519 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323fd29-648a-4db5-8696-f0bf6c343f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:06:34.058792 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323fd29-648a-4db5-8696-f0bf6c343f69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:06:34.059465 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5323fd29-648a-4db5-8696-f0bf6c343f69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:06:34.061370 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5323fd29-648a-4db5-8696-f0bf6c343f69 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:06:34.097138 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1287/2579] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 12:06:34 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:06:34.101431 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078265c2-0b1e-4ed5-8f1c-ca1b3e46b059 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:06:34.112099 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078265c2-0b1e-4ed5-8f1c-ca1b3e46b059 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:06:34.167151 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53285c6d-1849-4ee4-98cc-68240de8d063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:06:34.167772 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53285c6d-1849-4ee4-98cc-68240de8d063 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:06:34.168082 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53285c6d-1849-4ee4-98cc-68240de8d063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:06:34.168359 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53285c6d-1849-4ee4-98cc-68240de8d063 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:06:34.169034 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53285c6d-1849-4ee4-98cc-68240de8d063 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:06:34.170968 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53285c6d-1849-4ee4-98cc-68240de8d063 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:06:34.190691 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1293/2580] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 12:06:34 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:06:34.194736 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323fd29-648a-4db5-8696-f0bf6c343f69 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:06:34.205780 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323fd29-648a-4db5-8696-f0bf6c343f69 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:06:34.211087 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d718b0e-da45-469e-a182-7d69e58ad952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:06:34.211777 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d718b0e-da45-469e-a182-7d69e58ad952 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:06:34.212057 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d718b0e-da45-469e-a182-7d69e58ad952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:06:34.212326 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d718b0e-da45-469e-a182-7d69e58ad952 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:06:34.213043 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d718b0e-da45-469e-a182-7d69e58ad952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:06:34.214620 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d718b0e-da45-469e-a182-7d69e58ad952 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:06:34.224554 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1288/2581] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:06:34.228382 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53285c6d-1849-4ee4-98cc-68240de8d063 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:06:34.238276 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53285c6d-1849-4ee4-98cc-68240de8d063 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:06:34.242815 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e69f0-17e5-4aa7-9628-ec8331ca1ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:06:34.243451 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e69f0-17e5-4aa7-9628-ec8331ca1ffb admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:06:34.243785 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e69f0-17e5-4aa7-9628-ec8331ca1ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:06:34.244062 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e69f0-17e5-4aa7-9628-ec8331ca1ffb admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:06:34.244773 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e69f0-17e5-4aa7-9628-ec8331ca1ffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:06:34.246342 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e69f0-17e5-4aa7-9628-ec8331ca1ffb admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:06:34.256610 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1294/2582] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:06:34.260396 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d718b0e-da45-469e-a182-7d69e58ad952 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:06:34.270311 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d718b0e-da45-469e-a182-7d69e58ad952 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:06:34.275296 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2130a7-bd16-488d-9e8e-6af9a8f5f877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:06:34.276200 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2130a7-bd16-488d-9e8e-6af9a8f5f877 admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:06:34.276481 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2130a7-bd16-488d-9e8e-6af9a8f5f877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:06:34.276748 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2130a7-bd16-488d-9e8e-6af9a8f5f877 admin admin] PATH_INFO: `/v3/projects/adff32783b7a479d89e34cd1e5a118d6/users/79c5b9ec7d2248918e884cd01adb84c6/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:06:34.291524 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2130a7-bd16-488d-9e8e-6af9a8f5f877 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adff32783b7a479d89e34cd1e5a118d6, user_id=79c5b9ec7d2248918e884cd01adb84c6, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:06:34.294159 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2130a7-bd16-488d-9e8e-6af9a8f5f877 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:06:34.307836 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1289/2583] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:06:34 2022] PUT /identity/v3/projects/adff32783b7a479d89e34cd1e5a118d6/users/79c5b9ec7d2248918e884cd01adb84c6/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:06:34.312708 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7137c-13b3-424c-8e98-d1cb0977221d None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:06:34.313069 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7137c-13b3-424c-8e98-d1cb0977221d None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:06:34.313415 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7137c-13b3-424c-8e98-d1cb0977221d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:06:34.332116 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-09f7137c-13b3-424c-8e98-d1cb0977221d None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:06:34.333303 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-09f7137c-13b3-424c-8e98-d1cb0977221d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:06:34.365569 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:06:34.395802 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1295/2584] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:06:34.405449 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2130a7-bd16-488d-9e8e-6af9a8f5f877 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:06:34.407124 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-fc2130a7-bd16-488d-9e8e-6af9a8f5f877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:06:34.435355 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:06:34.468539 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2130a7-bd16-488d-9e8e-6af9a8f5f877 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:06:34.472868 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49e23a-f531-46ba-83f3-cd0146cf59a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:06:34.473524 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49e23a-f531-46ba-83f3-cd0146cf59a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:06:34.473809 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49e23a-f531-46ba-83f3-cd0146cf59a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:06:34.474086 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49e23a-f531-46ba-83f3-cd0146cf59a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:06:34.483469 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c49e23a-f531-46ba-83f3-cd0146cf59a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:06:34.485070 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c49e23a-f531-46ba-83f3-cd0146cf59a7 service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:06:34.494629 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1290/2585] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:06:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:06:39.036787 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893223e-74fd-4260-9612-8c44978cbc2b None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:06:39.037324 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893223e-74fd-4260-9612-8c44978cbc2b None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:06:39.037420 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893223e-74fd-4260-9612-8c44978cbc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:06:39.068351 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-b893223e-74fd-4260-9612-8c44978cbc2b None None] MFA Rules not processed for user `79c5b9ec7d2248918e884cd01adb84c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:06:39.070860 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-b893223e-74fd-4260-9612-8c44978cbc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:06:39.152317 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1296/2586] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:06:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:06:39.156821 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49e23a-f531-46ba-83f3-cd0146cf59a7 service neutron] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:06:39.167315 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49e23a-f531-46ba-83f3-cd0146cf59a7 service neutron] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:06:39.172188 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36764df-2837-491d-a826-1ad9c5bf8ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:06:39.172849 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36764df-2837-491d-a826-1ad9c5bf8ad7 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:06:39.173963 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36764df-2837-491d-a826-1ad9c5bf8ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:06:39.174244 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36764df-2837-491d-a826-1ad9c5bf8ad7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:06:39.174983 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36764df-2837-491d-a826-1ad9c5bf8ad7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:06:39.176937 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36764df-2837-491d-a826-1ad9c5bf8ad7 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:06:39.209222 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1291/2587] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 12:06:39 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:06:39.213199 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893223e-74fd-4260-9612-8c44978cbc2b None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:06:39.228142 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893223e-74fd-4260-9612-8c44978cbc2b None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:06:39.311787 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654cf29e-2e9b-4421-86ed-a63afd0a5ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:06:39.312759 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654cf29e-2e9b-4421-86ed-a63afd0a5ea8 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:06:39.312909 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654cf29e-2e9b-4421-86ed-a63afd0a5ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:06:39.313167 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654cf29e-2e9b-4421-86ed-a63afd0a5ea8 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:06:39.314491 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654cf29e-2e9b-4421-86ed-a63afd0a5ea8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:06:39.317206 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654cf29e-2e9b-4421-86ed-a63afd0a5ea8 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:06:39.340754 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1297/2588] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 12:06:39 2022] POST /identity/v3/users => generated 296 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:06:39.345922 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36764df-2837-491d-a826-1ad9c5bf8ad7 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:06:39.356995 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36764df-2837-491d-a826-1ad9c5bf8ad7 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:06:39.362435 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373cc839-b794-4360-b6fb-c670c565c4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:06:39.363103 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cc839-b794-4360-b6fb-c670c565c4b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:06:39.363558 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cc839-b794-4360-b6fb-c670c565c4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:06:39.363765 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cc839-b794-4360-b6fb-c670c565c4b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:06:39.364443 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373cc839-b794-4360-b6fb-c670c565c4b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:06:39.366080 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373cc839-b794-4360-b6fb-c670c565c4b6 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:06:39.384079 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1292/2589] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:06:39.385522 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654cf29e-2e9b-4421-86ed-a63afd0a5ea8 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:06:39.400925 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654cf29e-2e9b-4421-86ed-a63afd0a5ea8 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:06:39.409677 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb970db-5051-49e4-8248-e5677688f7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:06:39.410825 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb970db-5051-49e4-8248-e5677688f7c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:06:39.411117 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb970db-5051-49e4-8248-e5677688f7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:06:39.411616 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb970db-5051-49e4-8248-e5677688f7c9 admin admin] PATH_INFO: `/v3/projects/698bf9ceeb3944f6b4c209a5cfaa5cb6/users/8bba183bb7bb462a9802276dd320297e/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:06:39.432480 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373cc839-b794-4360-b6fb-c670c565c4b6 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:06:39.435252 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-373cc839-b794-4360-b6fb-c670c565c4b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:06:39.435470 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb970db-5051-49e4-8248-e5677688f7c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=698bf9ceeb3944f6b4c209a5cfaa5cb6, user_id=8bba183bb7bb462a9802276dd320297e, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:06:39.440131 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb970db-5051-49e4-8248-e5677688f7c9 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:06:39.457571 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1298/2590] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:06:39 2022] PUT /identity/v3/projects/698bf9ceeb3944f6b4c209a5cfaa5cb6/users/8bba183bb7bb462a9802276dd320297e/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:06:39.462091 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb970db-5051-49e4-8248-e5677688f7c9 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:06:39.518266 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:06:39.531579 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373cc839-b794-4360-b6fb-c670c565c4b6 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:06:39.550950 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb970db-5051-49e4-8248-e5677688f7c9 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:06:39.555708 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700e6f8-0966-42bb-9b84-5f2f15ea992b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:06:39.556376 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700e6f8-0966-42bb-9b84-5f2f15ea992b admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:06:39.556655 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700e6f8-0966-42bb-9b84-5f2f15ea992b admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:06:39.556929 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700e6f8-0966-42bb-9b84-5f2f15ea992b admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:06:39.557659 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5700e6f8-0966-42bb-9b84-5f2f15ea992b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:06:39.559227 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5700e6f8-0966-42bb-9b84-5f2f15ea992b admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:06:39.569237 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1299/2591] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:06:39.573327 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700e6f8-0966-42bb-9b84-5f2f15ea992b admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:06:39.582853 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700e6f8-0966-42bb-9b84-5f2f15ea992b admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:06:39.587411 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16504612-9364-4efb-a01b-bcd26f8f97fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:06:39.588398 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16504612-9364-4efb-a01b-bcd26f8f97fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:06:39.588677 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16504612-9364-4efb-a01b-bcd26f8f97fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:06:39.588949 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16504612-9364-4efb-a01b-bcd26f8f97fb admin admin] PATH_INFO: `/v3/projects/698bf9ceeb3944f6b4c209a5cfaa5cb6/users/8bba183bb7bb462a9802276dd320297e/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:06:39.590892 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16504612-9364-4efb-a01b-bcd26f8f97fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=698bf9ceeb3944f6b4c209a5cfaa5cb6, user_id=8bba183bb7bb462a9802276dd320297e, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:06:39.593240 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee8848-df12-4654-9e94-90c6d46a961a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5a91437dd64e2491ce41b4d12d4835', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:06:39.593518 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16504612-9364-4efb-a01b-bcd26f8f97fb admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:06:39.593926 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee8848-df12-4654-9e94-90c6d46a961a service placement] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:06:39.594180 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee8848-df12-4654-9e94-90c6d46a961a service placement] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:06:39.594458 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee8848-df12-4654-9e94-90c6d46a961a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:06:39.596997 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-edee8848-df12-4654-9e94-90c6d46a961a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:06:39.604695 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1300/2592] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:06:39 2022] PUT /identity/v3/projects/698bf9ceeb3944f6b4c209a5cfaa5cb6/users/8bba183bb7bb462a9802276dd320297e/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 12:06:39.612556 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee8848-df12-4654-9e94-90c6d46a961a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:06:39.614252 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee8848-df12-4654-9e94-90c6d46a961a service placement] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:06:39.625190 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1293/2593] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:06:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 12:06:44.374209 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fbe870-94b3-4c3b-980f-ebed82a0e214 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:06:44.374669 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fbe870-94b3-4c3b-980f-ebed82a0e214 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:06:44.374786 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fbe870-94b3-4c3b-980f-ebed82a0e214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:06:44.406309 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-f9fbe870-94b3-4c3b-980f-ebed82a0e214 None None] MFA Rules not processed for user `8bba183bb7bb462a9802276dd320297e`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:06:44.408330 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-f9fbe870-94b3-4c3b-980f-ebed82a0e214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:06:44.491670 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1301/2594] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:06:44 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:06:44.502916 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee8848-df12-4654-9e94-90c6d46a961a service placement] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:06:44.504430 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-edee8848-df12-4654-9e94-90c6d46a961a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:06:44.547207 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:06:44.603688 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee8848-df12-4654-9e94-90c6d46a961a service placement] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:06:44.671045 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc6e4c-965b-4d40-a37a-a7d8894ed5d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:06:44.671745 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc6e4c-965b-4d40-a37a-a7d8894ed5d6 service nova] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:06:44.672034 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc6e4c-965b-4d40-a37a-a7d8894ed5d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:06:44.672311 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc6e4c-965b-4d40-a37a-a7d8894ed5d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:06:44.739022 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcc6e4c-965b-4d40-a37a-a7d8894ed5d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:06:44.741942 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcc6e4c-965b-4d40-a37a-a7d8894ed5d6 service nova] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:06:44.753172 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1294/2595] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:06:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:06:54.484694 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=53,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:06:54.747741 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=72 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:07:07.192416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef4dd2-df17-40e6-991a-a71354204bc8 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:07:07.192936 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef4dd2-df17-40e6-991a-a71354204bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:07:07.193035 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef4dd2-df17-40e6-991a-a71354204bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:07:07.211644 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-4fef4dd2-df17-40e6-991a-a71354204bc8 None None] MFA Rules not processed for user `79c5b9ec7d2248918e884cd01adb84c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:07:07.212834 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-4fef4dd2-df17-40e6-991a-a71354204bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:07:07.219554 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1302/2596] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:07:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:07:17.205884 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:07:24.795326 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc6e4c-965b-4d40-a37a-a7d8894ed5d6 service nova] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:07:24.796770 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-5bcc6e4c-965b-4d40-a37a-a7d8894ed5d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:07:24.852023 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc6e4c-965b-4d40-a37a-a7d8894ed5d6 service nova] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:07:24.855570 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c65e1a-bf2c-4986-a967-47cf5826118d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:07:24.856209 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c65e1a-bf2c-4986-a967-47cf5826118d service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:07:24.856493 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c65e1a-bf2c-4986-a967-47cf5826118d service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:07:24.856769 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c65e1a-bf2c-4986-a967-47cf5826118d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:07:24.865499 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c65e1a-bf2c-4986-a967-47cf5826118d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:07:24.866925 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c65e1a-bf2c-4986-a967-47cf5826118d service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:07:24.876225 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1295/2597] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:07:24 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:07:34.872060 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=26 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:07:37.112597 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef4dd2-df17-40e6-991a-a71354204bc8 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:07:37.122293 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef4dd2-df17-40e6-991a-a71354204bc8 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:07:37.125872 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a53af-59dc-4e50-9a18-c4876eaa5b39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:07:37.126516 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a53af-59dc-4e50-9a18-c4876eaa5b39 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:07:37.126784 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a53af-59dc-4e50-9a18-c4876eaa5b39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:07:37.127062 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a53af-59dc-4e50-9a18-c4876eaa5b39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:07:37.128855 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-692a53af-59dc-4e50-9a18-c4876eaa5b39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:07:37.193816 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a53af-59dc-4e50-9a18-c4876eaa5b39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:07:37.196197 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a53af-59dc-4e50-9a18-c4876eaa5b39 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:07:37.206151 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1303/2598] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:07:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 12:07:40.210127 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c65e1a-bf2c-4986-a967-47cf5826118d service neutron] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:07:40.211785 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-36c65e1a-bf2c-4986-a967-47cf5826118d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:07:40.231345 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c65e1a-bf2c-4986-a967-47cf5826118d service neutron] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:07:40.236419 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47255c79-ace5-4f58-bf78-ccc32534dd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:07:40.237352 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47255c79-ace5-4f58-bf78-ccc32534dd6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:07:40.237642 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47255c79-ace5-4f58-bf78-ccc32534dd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:07:40.237917 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47255c79-ace5-4f58-bf78-ccc32534dd6d admin admin] PATH_INFO: `/v3/users/b76f9ea7268a4e70a402f3c9ea6220e7` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:07:40.239165 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47255c79-ace5-4f58-bf78-ccc32534dd6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b76f9ea7268a4e70a402f3c9ea6220e7)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:07:40.241811 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47255c79-ace5-4f58-bf78-ccc32534dd6d admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:07:40.294846 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-47255c79-ace5-4f58-bf78-ccc32534dd6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b76f9ea7268a4e70a402f3c9ea6220e7'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:07:40.295492 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-47255c79-ace5-4f58-bf78-ccc32534dd6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b76f9ea7268a4e70a402f3c9ea6220e7'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:07:40.308020 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-47255c79-ace5-4f58-bf78-ccc32534dd6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b76f9ea7268a4e70a402f3c9ea6220e7'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:07:40.314964 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-47255c79-ace5-4f58-bf78-ccc32534dd6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b76f9ea7268a4e70a402f3c9ea6220e7'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:07:40.322409 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-47255c79-ace5-4f58-bf78-ccc32534dd6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b76f9ea7268a4e70a402f3c9ea6220e7'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:07:40.328403 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1296/2599] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:07:40 2022] DELETE /identity/v3/users/b76f9ea7268a4e70a402f3c9ea6220e7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:07:40.495560 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a53af-59dc-4e50-9a18-c4876eaa5b39 service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:07:40.506248 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a53af-59dc-4e50-9a18-c4876eaa5b39 service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:07:40.563235 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6129e-e151-4939-a08c-b0bd162053cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:07:40.564064 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6129e-e151-4939-a08c-b0bd162053cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:07:40.564350 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6129e-e151-4939-a08c-b0bd162053cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:07:40.564627 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6129e-e151-4939-a08c-b0bd162053cd admin admin] PATH_INFO: `/v3/projects/89467b1c15334264bf384b711292808b` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:07:40.565792 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6129e-e151-4939-a08c-b0bd162053cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=89467b1c15334264bf384b711292808b)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:07:40.567712 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6129e-e151-4939-a08c-b0bd162053cd admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:07:40.612384 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e3e6129e-e151-4939-a08c-b0bd162053cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89467b1c15334264bf384b711292808b', 'request_id': 'req-e3e6129e-e151-4939-a08c-b0bd162053cd'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:07:40.618472 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e3e6129e-e151-4939-a08c-b0bd162053cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89467b1c15334264bf384b711292808b', 'request_id': 'req-e3e6129e-e151-4939-a08c-b0bd162053cd'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:07:40.625665 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e3e6129e-e151-4939-a08c-b0bd162053cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89467b1c15334264bf384b711292808b', 'request_id': 'req-e3e6129e-e151-4939-a08c-b0bd162053cd'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:07:40.637141 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e3e6129e-e151-4939-a08c-b0bd162053cd admin admin] The token cache is being invalidate because project 89467b1c15334264bf384b711292808b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:07:40.637413 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e3e6129e-e151-4939-a08c-b0bd162053cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:07:40.638026 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-e3e6129e-e151-4939-a08c-b0bd162053cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:07:40.639553 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1304/2600] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:07:40 2022] DELETE /identity/v3/projects/89467b1c15334264bf384b711292808b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:07:40.644441 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095325c6-c306-4dd2-8fd0-50520cf6c061 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:07:40.644741 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095325c6-c306-4dd2-8fd0-50520cf6c061 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:07:40.645027 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095325c6-c306-4dd2-8fd0-50520cf6c061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:07:40.662814 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-095325c6-c306-4dd2-8fd0-50520cf6c061 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:07:40.664044 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-095325c6-c306-4dd2-8fd0-50520cf6c061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:07:40.723606 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1297/2601] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:07:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:07:40.731733 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996999f-25d8-4f44-87b6-98872ce155b3 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:07:40.732040 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996999f-25d8-4f44-87b6-98872ce155b3 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:07:40.732323 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996999f-25d8-4f44-87b6-98872ce155b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:07:40.751613 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-d996999f-25d8-4f44-87b6-98872ce155b3 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:07:40.752822 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-d996999f-25d8-4f44-87b6-98872ce155b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:07:40.760861 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1305/2602] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:07:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:07:40.765246 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095325c6-c306-4dd2-8fd0-50520cf6c061 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:07:40.775660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095325c6-c306-4dd2-8fd0-50520cf6c061 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:07:40.781853 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b660b-b844-4232-be81-cdc277b4e344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:07:40.782531 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b660b-b844-4232-be81-cdc277b4e344 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:07:40.782818 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b660b-b844-4232-be81-cdc277b4e344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:07:40.783101 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b660b-b844-4232-be81-cdc277b4e344 admin admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:07:40.783878 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8b660b-b844-4232-be81-cdc277b4e344 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:07:40.784193 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8b660b-b844-4232-be81-cdc277b4e344 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:07:40.785842 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8b660b-b844-4232-be81-cdc277b4e344 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:07:40.799904 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1298/2603] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 12:07:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:07:40.804967 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996999f-25d8-4f44-87b6-98872ce155b3 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:07:40.814001 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996999f-25d8-4f44-87b6-98872ce155b3 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:07:40.818703 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da4c28-bbe5-4f4c-a908-ace0e77121f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:07:40.819348 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da4c28-bbe5-4f4c-a908-ace0e77121f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:07:40.819671 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da4c28-bbe5-4f4c-a908-ace0e77121f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:07:40.819942 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da4c28-bbe5-4f4c-a908-ace0e77121f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:07:40.820631 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da4c28-bbe5-4f4c-a908-ace0e77121f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:07:40.822504 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da4c28-bbe5-4f4c-a908-ace0e77121f0 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:07:40.836326 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:07:40.854710 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1306/2604] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 12:07:40 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:07:40.855900 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b660b-b844-4232-be81-cdc277b4e344 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:07:40.866655 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b660b-b844-4232-be81-cdc277b4e344 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:07:40.923315 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b652b-d108-4ead-93c5-6e63543a4c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:07:40.924018 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b652b-d108-4ead-93c5-6e63543a4c5b admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:07:40.924305 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b652b-d108-4ead-93c5-6e63543a4c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:07:40.924582 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b652b-d108-4ead-93c5-6e63543a4c5b admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:07:40.925266 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b652b-d108-4ead-93c5-6e63543a4c5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:07:40.927240 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b652b-d108-4ead-93c5-6e63543a4c5b admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:07:40.934343 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:07:40.948486 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1299/2605] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 12:07:40 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 12:07:40.952637 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da4c28-bbe5-4f4c-a908-ace0e77121f0 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:07:40.962812 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da4c28-bbe5-4f4c-a908-ace0e77121f0 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:07:40.967319 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ccb63-275a-467e-b275-5fd7cd089639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:07:40.967990 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ccb63-275a-467e-b275-5fd7cd089639 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:07:40.968273 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ccb63-275a-467e-b275-5fd7cd089639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:07:40.968546 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ccb63-275a-467e-b275-5fd7cd089639 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:07:40.969255 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ccb63-275a-467e-b275-5fd7cd089639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:07:40.970822 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ccb63-275a-467e-b275-5fd7cd089639 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:07:40.981562 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1307/2606] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:07:40.985384 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b652b-d108-4ead-93c5-6e63543a4c5b admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:07:40.996253 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b652b-d108-4ead-93c5-6e63543a4c5b admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:07:41.000906 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8f847-9706-473a-8700-051d27ced94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:07:41.001544 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8f847-9706-473a-8700-051d27ced94f admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:07:41.001834 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8f847-9706-473a-8700-051d27ced94f admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:07:41.002114 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8f847-9706-473a-8700-051d27ced94f admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:07:41.002837 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a8f847-9706-473a-8700-051d27ced94f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:07:41.004466 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a8f847-9706-473a-8700-051d27ced94f admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:07:41.014338 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1300/2607] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:07:41.018321 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ccb63-275a-467e-b275-5fd7cd089639 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:07:41.029012 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ccb63-275a-467e-b275-5fd7cd089639 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:07:41.033509 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377abfdc-2d10-486a-9cf0-07bf28c7a7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:07:41.034366 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377abfdc-2d10-486a-9cf0-07bf28c7a7c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:07:41.034648 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377abfdc-2d10-486a-9cf0-07bf28c7a7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:07:41.034923 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377abfdc-2d10-486a-9cf0-07bf28c7a7c4 admin admin] PATH_INFO: `/v3/projects/6f92333085e341938aaf258c0921cd5c/users/0c93102a757d4a2cbf7f515c4b67db2c/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:07:41.049553 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377abfdc-2d10-486a-9cf0-07bf28c7a7c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f92333085e341938aaf258c0921cd5c, user_id=0c93102a757d4a2cbf7f515c4b67db2c, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:07:41.052838 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377abfdc-2d10-486a-9cf0-07bf28c7a7c4 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:07:41.065908 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1308/2608] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:07:41 2022] PUT /identity/v3/projects/6f92333085e341938aaf258c0921cd5c/users/0c93102a757d4a2cbf7f515c4b67db2c/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:07:41.070849 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9815e-babc-4860-b23f-3f2c90e5640c None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:07:41.071169 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9815e-babc-4860-b23f-3f2c90e5640c None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:07:41.071454 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9815e-babc-4860-b23f-3f2c90e5640c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:07:41.089063 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-c6a9815e-babc-4860-b23f-3f2c90e5640c None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:07:41.090262 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-c6a9815e-babc-4860-b23f-3f2c90e5640c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:07:41.149277 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1301/2609] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:07:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:07:41.158655 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377abfdc-2d10-486a-9cf0-07bf28c7a7c4 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:07:41.160382 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-377abfdc-2d10-486a-9cf0-07bf28c7a7c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:07:41.215631 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377abfdc-2d10-486a-9cf0-07bf28c7a7c4 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:07:41.219196 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6ab72-82ca-4d6a-b5aa-c554e3714d3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:07:41.219866 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6ab72-82ca-4d6a-b5aa-c554e3714d3c service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:07:41.220150 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6ab72-82ca-4d6a-b5aa-c554e3714d3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:07:41.220424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6ab72-82ca-4d6a-b5aa-c554e3714d3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:07:41.230424 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b6ab72-82ca-4d6a-b5aa-c554e3714d3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:07:41.231881 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b6ab72-82ca-4d6a-b5aa-c554e3714d3c service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:07:41.241197 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1309/2610] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:07:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:07:45.147803 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e270926-1254-4816-97ae-271cb9bc9778 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:07:45.148303 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e270926-1254-4816-97ae-271cb9bc9778 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:07:45.148403 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e270926-1254-4816-97ae-271cb9bc9778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:07:45.199149 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-8e270926-1254-4816-97ae-271cb9bc9778 None None] MFA Rules not processed for user `0c93102a757d4a2cbf7f515c4b67db2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:07:45.203899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-8e270926-1254-4816-97ae-271cb9bc9778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:07:45.280386 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1302/2611] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:07:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:07:45.294857 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6ab72-82ca-4d6a-b5aa-c554e3714d3c service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:07:45.296221 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-d9b6ab72-82ca-4d6a-b5aa-c554e3714d3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:07:45.375685 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6ab72-82ca-4d6a-b5aa-c554e3714d3c service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:07:45.382394 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c411acc-feca-4f89-9291-0f4dc006db23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:07:45.383078 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c411acc-feca-4f89-9291-0f4dc006db23 service nova] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:07:45.383357 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c411acc-feca-4f89-9291-0f4dc006db23 service nova] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:07:45.383661 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c411acc-feca-4f89-9291-0f4dc006db23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:07:45.392133 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c411acc-feca-4f89-9291-0f4dc006db23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:07:45.393716 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c411acc-feca-4f89-9291-0f4dc006db23 service nova] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:07:45.403834 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1310/2612] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:07:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:07:46.704337 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbbf27c-62e4-4765-93cf-c2ee6cfb81fa None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:07:46.704893 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbbf27c-62e4-4765-93cf-c2ee6cfb81fa None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:07:46.704893 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbbf27c-62e4-4765-93cf-c2ee6cfb81fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:07:46.722714 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-acbbf27c-62e4-4765-93cf-c2ee6cfb81fa None None] MFA Rules not processed for user `0c93102a757d4a2cbf7f515c4b67db2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:07:46.724673 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-acbbf27c-62e4-4765-93cf-c2ee6cfb81fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:07:46.732468 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1303/2613] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:07:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:07:55.399570 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=77,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:07:56.717231 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:09:06.024796 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c411acc-feca-4f89-9291-0f4dc006db23 service nova] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:09:06.034206 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c411acc-feca-4f89-9291-0f4dc006db23 service nova] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:09:06.038321 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7ccaa-20e7-4c89-90cf-877747b7d290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:09:06.038943 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7ccaa-20e7-4c89-90cf-877747b7d290 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:09:06.039222 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7ccaa-20e7-4c89-90cf-877747b7d290 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:09:06.039493 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7ccaa-20e7-4c89-90cf-877747b7d290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:09:06.041271 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-cbc7ccaa-20e7-4c89-90cf-877747b7d290 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:09:06.054787 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc7ccaa-20e7-4c89-90cf-877747b7d290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:09:06.056233 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc7ccaa-20e7-4c89-90cf-877747b7d290 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:09:06.067207 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1311/2614] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:09:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:09:07.235534 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbbf27c-62e4-4765-93cf-c2ee6cfb81fa None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:09:07.236950 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-acbbf27c-62e4-4765-93cf-c2ee6cfb81fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:09:07.249280 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbbf27c-62e4-4765-93cf-c2ee6cfb81fa None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:09:07.252829 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e6d21-b663-47dc-8ef2-9d1bb1753e9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:09:07.253456 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e6d21-b663-47dc-8ef2-9d1bb1753e9f service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:09:07.253736 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e6d21-b663-47dc-8ef2-9d1bb1753e9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:09:07.254010 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e6d21-b663-47dc-8ef2-9d1bb1753e9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:09:07.255736 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-3b4e6d21-b663-47dc-8ef2-9d1bb1753e9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:09:07.268556 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e6d21-b663-47dc-8ef2-9d1bb1753e9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:09:07.270175 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e6d21-b663-47dc-8ef2-9d1bb1753e9f service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:09:07.281978 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1304/2615] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:09:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:09:09.077274 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7ccaa-20e7-4c89-90cf-877747b7d290 service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:09:09.078818 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-cbc7ccaa-20e7-4c89-90cf-877747b7d290 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:09:09.094808 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7ccaa-20e7-4c89-90cf-877747b7d290 service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:09:09.101494 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b825444-57b0-4661-983d-616d4459dba4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:09:09.102146 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b825444-57b0-4661-983d-616d4459dba4 service nova] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:09:09.102493 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b825444-57b0-4661-983d-616d4459dba4 service nova] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:09:09.102771 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b825444-57b0-4661-983d-616d4459dba4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:09:09.104611 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-6b825444-57b0-4661-983d-616d4459dba4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:09:09.119836 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b825444-57b0-4661-983d-616d4459dba4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:09:09.121458 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b825444-57b0-4661-983d-616d4459dba4 service nova] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:09:09.133909 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1312/2616] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:09:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:09:12.775814 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81bb15-7fbd-42a1-8851-4c554e14d899 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:09:12.776283 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81bb15-7fbd-42a1-8851-4c554e14d899 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:09:12.776283 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81bb15-7fbd-42a1-8851-4c554e14d899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:09:12.793833 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-fb81bb15-7fbd-42a1-8851-4c554e14d899 None None] MFA Rules not processed for user `76db57106a684c7592dc8cba4bc0a9d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:09:12.795016 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-fb81bb15-7fbd-42a1-8851-4c554e14d899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:09:12.847729 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1305/2617] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:09:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:09:13.454058 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b825444-57b0-4661-983d-616d4459dba4 service nova] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:09:13.456243 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-6b825444-57b0-4661-983d-616d4459dba4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:09:13.533452 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b825444-57b0-4661-983d-616d4459dba4 service nova] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:09:13.539131 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc3535-a88d-4eb6-8e9c-0bdf95317069 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5a91437dd64e2491ce41b4d12d4835', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:09:13.539805 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc3535-a88d-4eb6-8e9c-0bdf95317069 service placement] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:09:13.540093 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc3535-a88d-4eb6-8e9c-0bdf95317069 service placement] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:09:13.540380 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc3535-a88d-4eb6-8e9c-0bdf95317069 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:09:13.542196 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-d6dc3535-a88d-4eb6-8e9c-0bdf95317069 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:09:13.553603 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc3535-a88d-4eb6-8e9c-0bdf95317069 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:09:13.555165 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc3535-a88d-4eb6-8e9c-0bdf95317069 service placement] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:09:13.564993 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1313/2618] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:09:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:09:15.601929 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81bb15-7fbd-42a1-8851-4c554e14d899 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:09:15.612915 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81bb15-7fbd-42a1-8851-4c554e14d899 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:09:15.618655 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3217bccf-2d11-4fb2-a828-70783569799b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:09:15.619697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217bccf-2d11-4fb2-a828-70783569799b service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:09:15.620199 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217bccf-2d11-4fb2-a828-70783569799b service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:09:15.620673 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217bccf-2d11-4fb2-a828-70783569799b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:09:15.623385 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-3217bccf-2d11-4fb2-a828-70783569799b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:09:15.635619 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3217bccf-2d11-4fb2-a828-70783569799b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:09:15.637482 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3217bccf-2d11-4fb2-a828-70783569799b service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:09:15.648896 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1306/2619] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:09:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:09:22.274908 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc3535-a88d-4eb6-8e9c-0bdf95317069 service placement] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:09:22.288462 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc3535-a88d-4eb6-8e9c-0bdf95317069 service placement] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:09:22.293889 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f1dd01-141c-4633-b0fb-a97d74c86b08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:09:22.294525 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1dd01-141c-4633-b0fb-a97d74c86b08 service nova] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:09:22.294805 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1dd01-141c-4633-b0fb-a97d74c86b08 service nova] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:09:22.295079 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1dd01-141c-4633-b0fb-a97d74c86b08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:09:22.296847 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-d4f1dd01-141c-4633-b0fb-a97d74c86b08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:09:22.309604 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f1dd01-141c-4633-b0fb-a97d74c86b08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:09:22.311200 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f1dd01-141c-4633-b0fb-a97d74c86b08 service nova] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:09:22.322559 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1314/2620] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:09:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:09:24.571332 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33abd9-b9cd-4e2a-9855-039add42544a None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:09:24.571887 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33abd9-b9cd-4e2a-9855-039add42544a None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:09:24.571990 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33abd9-b9cd-4e2a-9855-039add42544a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:09:24.589854 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-ee33abd9-b9cd-4e2a-9855-039add42544a None None] MFA Rules not processed for user `0c93102a757d4a2cbf7f515c4b67db2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:09:24.591039 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-ee33abd9-b9cd-4e2a-9855-039add42544a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:09:24.597843 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1307/2621] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:09:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:09:32.317449 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=50 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:09:34.584862 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=40 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:09:48.381762 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d801b-1eb2-4903-b8cc-13f03961d378 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:09:48.382227 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d801b-1eb2-4903-b8cc-13f03961d378 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:09:48.382327 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d801b-1eb2-4903-b8cc-13f03961d378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:09:48.399755 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-dd5d801b-1eb2-4903-b8cc-13f03961d378 None None] MFA Rules not processed for user `79c5b9ec7d2248918e884cd01adb84c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:09:48.400924 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-dd5d801b-1eb2-4903-b8cc-13f03961d378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:09:48.454488 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1315/2622] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:09:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:09:58.447964 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=25 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:10:41.616289 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee33abd9-b9cd-4e2a-9855-039add42544a None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:10:41.633169 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee33abd9-b9cd-4e2a-9855-039add42544a None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:10:41.640445 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887af378-abdc-42a6-b6cd-a7ad20b85363 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:10:41.641226 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887af378-abdc-42a6-b6cd-a7ad20b85363 service nova] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:10:41.641667 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887af378-abdc-42a6-b6cd-a7ad20b85363 service nova] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:10:41.642026 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887af378-abdc-42a6-b6cd-a7ad20b85363 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:10:41.644406 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-887af378-abdc-42a6-b6cd-a7ad20b85363 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:10:41.659631 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887af378-abdc-42a6-b6cd-a7ad20b85363 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:10:41.661757 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887af378-abdc-42a6-b6cd-a7ad20b85363 service nova] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:10:41.672891 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1308/2623] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:10:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:10:51.668726 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=6 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:11:09.765434 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12459aba-b9cc-4b8e-b81b-f0b67c3c1ee9 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:09.765957 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12459aba-b9cc-4b8e-b81b-f0b67c3c1ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:09.766052 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12459aba-b9cc-4b8e-b81b-f0b67c3c1ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:09.795074 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-12459aba-b9cc-4b8e-b81b-f0b67c3c1ee9 None None] MFA Rules not processed for user `0c93102a757d4a2cbf7f515c4b67db2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:11:09.796487 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-12459aba-b9cc-4b8e-b81b-f0b67c3c1ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:11:09.831326 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1316/2624] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:11:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:11:10.159996 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887af378-abdc-42a6-b6cd-a7ad20b85363 service nova] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:10.207831 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887af378-abdc-42a6-b6cd-a7ad20b85363 service nova] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:10.212920 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08565d-03b9-46ec-893a-dce9651f51d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:10.214019 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08565d-03b9-46ec-893a-dce9651f51d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:10.214169 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08565d-03b9-46ec-893a-dce9651f51d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:10.214807 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08565d-03b9-46ec-893a-dce9651f51d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:10.216856 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-fb08565d-03b9-46ec-893a-dce9651f51d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:11:10.245169 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08565d-03b9-46ec-893a-dce9651f51d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:10.246957 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08565d-03b9-46ec-893a-dce9651f51d0 service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:10.258490 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1309/2625] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:11:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:11:16.060837 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12459aba-b9cc-4b8e-b81b-f0b67c3c1ee9 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:16.071063 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12459aba-b9cc-4b8e-b81b-f0b67c3c1ee9 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:16.075880 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e321f-cbac-4ce8-8e47-3d82c0527b27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:16.076616 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e321f-cbac-4ce8-8e47-3d82c0527b27 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:16.076972 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e321f-cbac-4ce8-8e47-3d82c0527b27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:16.077438 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e321f-cbac-4ce8-8e47-3d82c0527b27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:16.081646 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-015e321f-cbac-4ce8-8e47-3d82c0527b27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:11:16.136089 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e321f-cbac-4ce8-8e47-3d82c0527b27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:16.137529 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e321f-cbac-4ce8-8e47-3d82c0527b27 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:16.158705 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1317/2626] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:11:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:11:19.717830 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08565d-03b9-46ec-893a-dce9651f51d0 service neutron] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:19.722202 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-fb08565d-03b9-46ec-893a-dce9651f51d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:11:19.738045 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08565d-03b9-46ec-893a-dce9651f51d0 service neutron] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:19.742657 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fb0ab-0cc6-4326-9863-7756cef011db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:19.743464 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fb0ab-0cc6-4326-9863-7756cef011db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:19.743780 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fb0ab-0cc6-4326-9863-7756cef011db admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:19.744051 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fb0ab-0cc6-4326-9863-7756cef011db admin admin] PATH_INFO: `/v3/users/76db57106a684c7592dc8cba4bc0a9d7` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:19.745247 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56fb0ab-0cc6-4326-9863-7756cef011db admin admin] RBAC: Authorizing `identity:delete_user(user_id=76db57106a684c7592dc8cba4bc0a9d7)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:19.747169 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56fb0ab-0cc6-4326-9863-7756cef011db admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:19.798794 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-e56fb0ab-0cc6-4326-9863-7756cef011db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76db57106a684c7592dc8cba4bc0a9d7'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:19.799449 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-e56fb0ab-0cc6-4326-9863-7756cef011db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76db57106a684c7592dc8cba4bc0a9d7'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:19.814722 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-e56fb0ab-0cc6-4326-9863-7756cef011db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76db57106a684c7592dc8cba4bc0a9d7'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:19.821686 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-e56fb0ab-0cc6-4326-9863-7756cef011db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76db57106a684c7592dc8cba4bc0a9d7'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:19.830130 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-e56fb0ab-0cc6-4326-9863-7756cef011db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76db57106a684c7592dc8cba4bc0a9d7'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:19.836694 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1310/2627] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:11:19 2022] DELETE /identity/v3/users/76db57106a684c7592dc8cba4bc0a9d7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:11:20.020916 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e321f-cbac-4ce8-8e47-3d82c0527b27 service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:20.033101 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e321f-cbac-4ce8-8e47-3d82c0527b27 service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:20.092812 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f513533-f9f7-4b57-8bc2-957a8af495cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:20.093666 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f513533-f9f7-4b57-8bc2-957a8af495cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:20.093994 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f513533-f9f7-4b57-8bc2-957a8af495cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:20.094263 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f513533-f9f7-4b57-8bc2-957a8af495cc admin admin] PATH_INFO: `/v3/projects/db41a74c9582485b9def49d558170121` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:20.095459 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f513533-f9f7-4b57-8bc2-957a8af495cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=db41a74c9582485b9def49d558170121)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:20.097414 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f513533-f9f7-4b57-8bc2-957a8af495cc admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:20.145286 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-8f513533-f9f7-4b57-8bc2-957a8af495cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db41a74c9582485b9def49d558170121', 'request_id': 'req-8f513533-f9f7-4b57-8bc2-957a8af495cc'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:20.151186 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-8f513533-f9f7-4b57-8bc2-957a8af495cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db41a74c9582485b9def49d558170121', 'request_id': 'req-8f513533-f9f7-4b57-8bc2-957a8af495cc'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:20.161440 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-8f513533-f9f7-4b57-8bc2-957a8af495cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db41a74c9582485b9def49d558170121', 'request_id': 'req-8f513533-f9f7-4b57-8bc2-957a8af495cc'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:20.179050 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-8f513533-f9f7-4b57-8bc2-957a8af495cc admin admin] The token cache is being invalidate because project db41a74c9582485b9def49d558170121 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:11:20.179334 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-8f513533-f9f7-4b57-8bc2-957a8af495cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:20.180015 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-8f513533-f9f7-4b57-8bc2-957a8af495cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:20.181578 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1318/2628] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:11:20 2022] DELETE /identity/v3/projects/db41a74c9582485b9def49d558170121 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:11:20.186712 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259dde7-8f26-4df3-854e-563b2c043065 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:20.187008 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259dde7-8f26-4df3-854e-563b2c043065 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:20.187296 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259dde7-8f26-4df3-854e-563b2c043065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:20.238158 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-e259dde7-8f26-4df3-854e-563b2c043065 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:11:20.239383 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-e259dde7-8f26-4df3-854e-563b2c043065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:11:20.294373 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:11:20.304796 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1311/2629] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:11:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 12:11:20.313456 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a93f8b-9ad5-4623-b005-f609da901f4a None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:20.313782 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a93f8b-9ad5-4623-b005-f609da901f4a None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:20.314058 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a93f8b-9ad5-4623-b005-f609da901f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:20.332986 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-f5a93f8b-9ad5-4623-b005-f609da901f4a None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:11:20.334199 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-f5a93f8b-9ad5-4623-b005-f609da901f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:11:20.344400 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1319/2630] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:11:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:11:20.348244 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259dde7-8f26-4df3-854e-563b2c043065 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:20.358094 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259dde7-8f26-4df3-854e-563b2c043065 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:20.374661 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3d70d-a5ce-421d-8576-e535005bbbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:20.375391 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3d70d-a5ce-421d-8576-e535005bbbea admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:20.375697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3d70d-a5ce-421d-8576-e535005bbbea admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:20.375999 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3d70d-a5ce-421d-8576-e535005bbbea admin admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:20.376924 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d3d70d-a5ce-421d-8576-e535005bbbea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:11:20.377236 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d3d70d-a5ce-421d-8576-e535005bbbea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:20.379281 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d3d70d-a5ce-421d-8576-e535005bbbea admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:20.391554 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1312/2631] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 12:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:11:20.395891 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a93f8b-9ad5-4623-b005-f609da901f4a None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:20.400739 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:11:20.407728 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a93f8b-9ad5-4623-b005-f609da901f4a None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:20.413797 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3483dc-0600-4686-aec5-278212343b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:20.414561 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3483dc-0600-4686-aec5-278212343b59 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:20.415089 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3483dc-0600-4686-aec5-278212343b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:20.415433 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3483dc-0600-4686-aec5-278212343b59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:20.416953 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3483dc-0600-4686-aec5-278212343b59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:20.419086 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3483dc-0600-4686-aec5-278212343b59 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:20.450685 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1320/2632] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 12:11:20 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:11:20.455100 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3d70d-a5ce-421d-8576-e535005bbbea admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:20.469505 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3d70d-a5ce-421d-8576-e535005bbbea admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:20.536163 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823926e2-c204-4135-8387-5e63e1b2a9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:20.536843 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823926e2-c204-4135-8387-5e63e1b2a9db admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:20.537180 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823926e2-c204-4135-8387-5e63e1b2a9db admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:20.537401 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823926e2-c204-4135-8387-5e63e1b2a9db admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:20.538104 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823926e2-c204-4135-8387-5e63e1b2a9db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:20.540060 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823926e2-c204-4135-8387-5e63e1b2a9db admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:20.562466 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1313/2633] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 12:11:20 2022] POST /identity/v3/users => generated 283 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:11:20.572050 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3483dc-0600-4686-aec5-278212343b59 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:20.584672 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3483dc-0600-4686-aec5-278212343b59 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:20.590514 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0627ea-dc76-4b2a-9237-596c894b953c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:20.591186 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0627ea-dc76-4b2a-9237-596c894b953c admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:20.591471 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0627ea-dc76-4b2a-9237-596c894b953c admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:20.591773 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0627ea-dc76-4b2a-9237-596c894b953c admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:20.592501 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0627ea-dc76-4b2a-9237-596c894b953c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:20.594966 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0627ea-dc76-4b2a-9237-596c894b953c admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:20.606360 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1321/2634] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:11:20.611256 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823926e2-c204-4135-8387-5e63e1b2a9db admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:20.621592 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823926e2-c204-4135-8387-5e63e1b2a9db admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:20.626627 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566755e9-53ac-430a-a8bc-38b17b54b8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:20.627308 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566755e9-53ac-430a-a8bc-38b17b54b8e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:20.627628 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566755e9-53ac-430a-a8bc-38b17b54b8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:20.627902 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566755e9-53ac-430a-a8bc-38b17b54b8e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:20.628637 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566755e9-53ac-430a-a8bc-38b17b54b8e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:20.630247 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566755e9-53ac-430a-a8bc-38b17b54b8e4 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:20.643171 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1314/2635] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 12:11:20.647416 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0627ea-dc76-4b2a-9237-596c894b953c admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:20.658398 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0627ea-dc76-4b2a-9237-596c894b953c admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:20.663046 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6feaa-817c-40ab-8163-0b11e7fcab17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:20.663958 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6feaa-817c-40ab-8163-0b11e7fcab17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:20.664230 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6feaa-817c-40ab-8163-0b11e7fcab17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:20.664501 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6feaa-817c-40ab-8163-0b11e7fcab17 admin admin] PATH_INFO: `/v3/projects/064d0d5119a9422390c29683e3abdd83/users/c2ea9989855d4405897533e341a0b92f/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:20.681517 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e6feaa-817c-40ab-8163-0b11e7fcab17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=064d0d5119a9422390c29683e3abdd83, user_id=c2ea9989855d4405897533e341a0b92f, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:20.684197 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e6feaa-817c-40ab-8163-0b11e7fcab17 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:20.697715 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1322/2636] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:11:20 2022] PUT /identity/v3/projects/064d0d5119a9422390c29683e3abdd83/users/c2ea9989855d4405897533e341a0b92f/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:11:20.708524 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24486a5a-992d-407a-a1b6-0511f1a6f296 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:20.708814 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24486a5a-992d-407a-a1b6-0511f1a6f296 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:20.709090 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24486a5a-992d-407a-a1b6-0511f1a6f296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:20.736464 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-24486a5a-992d-407a-a1b6-0511f1a6f296 None None] MFA Rules not processed for user `c2ea9989855d4405897533e341a0b92f`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:11:20.737683 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-24486a5a-992d-407a-a1b6-0511f1a6f296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:11:20.805368 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1315/2637] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:11:20 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 12:11:20.809797 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6feaa-817c-40ab-8163-0b11e7fcab17 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:20.882974 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6feaa-817c-40ab-8163-0b11e7fcab17 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:20.888150 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a0bec-4e23-4d79-98c9-4196a8bd9f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:20.888949 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a0bec-4e23-4d79-98c9-4196a8bd9f14 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:20.889237 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a0bec-4e23-4d79-98c9-4196a8bd9f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:20.889518 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a0bec-4e23-4d79-98c9-4196a8bd9f14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:20.890259 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23a0bec-4e23-4d79-98c9-4196a8bd9f14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:20.892799 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23a0bec-4e23-4d79-98c9-4196a8bd9f14 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:20.929463 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1323/2638] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 12:11:20 2022] POST /identity/v3/projects => generated 361 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:11:20.931266 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24486a5a-992d-407a-a1b6-0511f1a6f296 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:20.943553 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24486a5a-992d-407a-a1b6-0511f1a6f296 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:20.997492 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:11:21.005534 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583dfc5-adef-4714-a869-99bc7179f7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:21.006532 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583dfc5-adef-4714-a869-99bc7179f7d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:21.006820 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583dfc5-adef-4714-a869-99bc7179f7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:21.007095 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583dfc5-adef-4714-a869-99bc7179f7d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:21.007823 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2583dfc5-adef-4714-a869-99bc7179f7d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:21.009845 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2583dfc5-adef-4714-a869-99bc7179f7d6 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:21.032187 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1316/2639] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 12:11:20 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:11:21.036341 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a0bec-4e23-4d79-98c9-4196a8bd9f14 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:21.046730 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a0bec-4e23-4d79-98c9-4196a8bd9f14 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:21.051864 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f7f2b-8ec5-4c67-a891-2389a7b6e1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:21.052566 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f7f2b-8ec5-4c67-a891-2389a7b6e1f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:21.052848 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f7f2b-8ec5-4c67-a891-2389a7b6e1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:21.053151 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f7f2b-8ec5-4c67-a891-2389a7b6e1f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:21.053882 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f7f2b-8ec5-4c67-a891-2389a7b6e1f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:21.055588 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f7f2b-8ec5-4c67-a891-2389a7b6e1f1 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:21.068903 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1324/2640] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:11:21.072522 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583dfc5-adef-4714-a869-99bc7179f7d6 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:21.083229 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583dfc5-adef-4714-a869-99bc7179f7d6 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:21.088067 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d18d9-7b5c-4101-9ce5-a10d87843a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:21.088958 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d18d9-7b5c-4101-9ce5-a10d87843a11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:21.089243 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d18d9-7b5c-4101-9ce5-a10d87843a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:21.089517 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d18d9-7b5c-4101-9ce5-a10d87843a11 admin admin] PATH_INFO: `/v3/projects/426f2a00dec74e33a60977a00f0357cf/users/c499562d95444ce3ae8a9be180d2a30d/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:21.104857 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d18d9-7b5c-4101-9ce5-a10d87843a11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=426f2a00dec74e33a60977a00f0357cf, user_id=c499562d95444ce3ae8a9be180d2a30d, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:21.107568 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d18d9-7b5c-4101-9ce5-a10d87843a11 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:21.122461 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1317/2641] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:11:21 2022] PUT /identity/v3/projects/426f2a00dec74e33a60977a00f0357cf/users/c499562d95444ce3ae8a9be180d2a30d/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:11:21.131972 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f7f2b-8ec5-4c67-a891-2389a7b6e1f1 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:21.143893 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f7f2b-8ec5-4c67-a891-2389a7b6e1f1 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:21.201809 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b1dea0-a68b-404c-b36d-a7802d1495b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:21.202475 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1dea0-a68b-404c-b36d-a7802d1495b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:21.202758 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1dea0-a68b-404c-b36d-a7802d1495b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:21.203067 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1dea0-a68b-404c-b36d-a7802d1495b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:21.203792 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b1dea0-a68b-404c-b36d-a7802d1495b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:21.205377 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b1dea0-a68b-404c-b36d-a7802d1495b6 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:21.215859 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1325/2642] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:11:21.220720 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d18d9-7b5c-4101-9ce5-a10d87843a11 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:21.231080 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d18d9-7b5c-4101-9ce5-a10d87843a11 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:21.236386 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317bf2e0-f6d4-40a1-949a-53c9882a8518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:21.237271 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bf2e0-f6d4-40a1-949a-53c9882a8518 admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:21.237556 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bf2e0-f6d4-40a1-949a-53c9882a8518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:21.237834 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bf2e0-f6d4-40a1-949a-53c9882a8518 admin admin] PATH_INFO: `/v3/projects/426f2a00dec74e33a60977a00f0357cf/users/c499562d95444ce3ae8a9be180d2a30d/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:21.239842 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317bf2e0-f6d4-40a1-949a-53c9882a8518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=426f2a00dec74e33a60977a00f0357cf, user_id=c499562d95444ce3ae8a9be180d2a30d, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:21.242492 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317bf2e0-f6d4-40a1-949a-53c9882a8518 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:21.256479 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1318/2643] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:11:21 2022] PUT /identity/v3/projects/426f2a00dec74e33a60977a00f0357cf/users/c499562d95444ce3ae8a9be180d2a30d/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:11:21.266885 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329bd17-1fcc-4240-be4f-a60b9299b0cf None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:21.267202 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329bd17-1fcc-4240-be4f-a60b9299b0cf None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:21.267480 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329bd17-1fcc-4240-be4f-a60b9299b0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:21.297177 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-9329bd17-1fcc-4240-be4f-a60b9299b0cf None None] MFA Rules not processed for user `c499562d95444ce3ae8a9be180d2a30d`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:11:21.298403 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-9329bd17-1fcc-4240-be4f-a60b9299b0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:11:21.302629 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:11:21.377195 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1326/2644] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:11:21 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:11:21.388550 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317bf2e0-f6d4-40a1-949a-53c9882a8518 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:21.390286 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-317bf2e0-f6d4-40a1-949a-53c9882a8518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:11:21.449239 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317bf2e0-f6d4-40a1-949a-53c9882a8518 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:21.452883 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a06a80-970f-4ce8-a6be-7856cafea188 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:21.454047 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a06a80-970f-4ce8-a6be-7856cafea188 service cinder] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:21.454328 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a06a80-970f-4ce8-a6be-7856cafea188 service cinder] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:21.454601 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a06a80-970f-4ce8-a6be-7856cafea188 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:21.464153 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a06a80-970f-4ce8-a6be-7856cafea188 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:21.465585 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a06a80-970f-4ce8-a6be-7856cafea188 service cinder] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:21.476460 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1319/2645] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:11:21 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:11:21.567391 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9329bd17-1fcc-4240-be4f-a60b9299b0cf None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:21.582735 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9329bd17-1fcc-4240-be4f-a60b9299b0cf None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:21.586639 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b21f00-3ed6-4598-af3e-9c4d36db90c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:21.587292 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b21f00-3ed6-4598-af3e-9c4d36db90c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:21.587609 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b21f00-3ed6-4598-af3e-9c4d36db90c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:21.587890 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b21f00-3ed6-4598-af3e-9c4d36db90c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:21.664598 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b21f00-3ed6-4598-af3e-9c4d36db90c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:21.666211 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b21f00-3ed6-4598-af3e-9c4d36db90c2 service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:21.677419 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1327/2646] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:11:21 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:11:31.476852 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=45,keystone:INSERT=5 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:11:31.671708 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=55 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:11:33.240467 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a06a80-970f-4ce8-a6be-7856cafea188 service cinder] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:33.302673 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a06a80-970f-4ce8-a6be-7856cafea188 service cinder] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:33.307150 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d14a87-c452-4480-a371-cca3837ced5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:33.308072 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d14a87-c452-4480-a371-cca3837ced5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:33.308354 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d14a87-c452-4480-a371-cca3837ced5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:33.308626 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d14a87-c452-4480-a371-cca3837ced5b admin admin] PATH_INFO: `/v3/users/c2ea9989855d4405897533e341a0b92f` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:33.309811 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d14a87-c452-4480-a371-cca3837ced5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2ea9989855d4405897533e341a0b92f)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:33.311768 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d14a87-c452-4480-a371-cca3837ced5b admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:33.359913 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-18d14a87-c452-4480-a371-cca3837ced5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2ea9989855d4405897533e341a0b92f'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:33.360602 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-18d14a87-c452-4480-a371-cca3837ced5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2ea9989855d4405897533e341a0b92f'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:33.372581 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-18d14a87-c452-4480-a371-cca3837ced5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2ea9989855d4405897533e341a0b92f'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:33.380065 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-18d14a87-c452-4480-a371-cca3837ced5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2ea9989855d4405897533e341a0b92f'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:33.387779 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-18d14a87-c452-4480-a371-cca3837ced5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2ea9989855d4405897533e341a0b92f'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:33.393921 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1320/2647] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:11:33 2022] DELETE /identity/v3/users/c2ea9989855d4405897533e341a0b92f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:11:33.398543 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952f2ab-0675-43a0-b23b-b226433f6945 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:33.399085 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952f2ab-0675-43a0-b23b-b226433f6945 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:33.399085 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952f2ab-0675-43a0-b23b-b226433f6945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:33.421334 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-0952f2ab-0675-43a0-b23b-b226433f6945 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:11:33.423062 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-0952f2ab-0675-43a0-b23b-b226433f6945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:11:33.493039 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1328/2648] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:11:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:11:33.503537 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d14a87-c452-4480-a371-cca3837ced5b admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:33.504939 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-18d14a87-c452-4480-a371-cca3837ced5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:11:33.561190 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d14a87-c452-4480-a371-cca3837ced5b admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:33.565418 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002f7bb-07c8-4340-b821-a055200c6a64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:33.566061 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002f7bb-07c8-4340-b821-a055200c6a64 service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:33.566346 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002f7bb-07c8-4340-b821-a055200c6a64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:33.566622 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002f7bb-07c8-4340-b821-a055200c6a64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:33.576163 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7002f7bb-07c8-4340-b821-a055200c6a64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:33.577661 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7002f7bb-07c8-4340-b821-a055200c6a64 service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:33.587387 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1321/2649] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:11:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:11:33.862370 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952f2ab-0675-43a0-b23b-b226433f6945 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:33.864067 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-0952f2ab-0675-43a0-b23b-b226433f6945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:11:33.876371 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952f2ab-0675-43a0-b23b-b226433f6945 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:33.881074 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707fa254-ef67-4558-99a1-487fc6d08843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:33.881954 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fa254-ef67-4558-99a1-487fc6d08843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:33.882236 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fa254-ef67-4558-99a1-487fc6d08843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:33.882515 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fa254-ef67-4558-99a1-487fc6d08843 admin admin] PATH_INFO: `/v3/projects/064d0d5119a9422390c29683e3abdd83` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:33.883914 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707fa254-ef67-4558-99a1-487fc6d08843 admin admin] RBAC: Authorizing `identity:delete_project(project_id=064d0d5119a9422390c29683e3abdd83)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:33.885826 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707fa254-ef67-4558-99a1-487fc6d08843 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:33.935956 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-707fa254-ef67-4558-99a1-487fc6d08843 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '064d0d5119a9422390c29683e3abdd83', 'request_id': 'req-707fa254-ef67-4558-99a1-487fc6d08843'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:33.941474 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-707fa254-ef67-4558-99a1-487fc6d08843 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '064d0d5119a9422390c29683e3abdd83', 'request_id': 'req-707fa254-ef67-4558-99a1-487fc6d08843'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:33.948923 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-707fa254-ef67-4558-99a1-487fc6d08843 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '064d0d5119a9422390c29683e3abdd83', 'request_id': 'req-707fa254-ef67-4558-99a1-487fc6d08843'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:33.960049 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-707fa254-ef67-4558-99a1-487fc6d08843 admin admin] The token cache is being invalidate because project 064d0d5119a9422390c29683e3abdd83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:11:33.960340 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-707fa254-ef67-4558-99a1-487fc6d08843 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:33.960999 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-707fa254-ef67-4558-99a1-487fc6d08843 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:33.962557 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1329/2650] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:11:33 2022] DELETE /identity/v3/projects/064d0d5119a9422390c29683e3abdd83 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:11:33.966594 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002f7bb-07c8-4340-b821-a055200c6a64 service neutron] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:33.977300 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7002f7bb-07c8-4340-b821-a055200c6a64 service neutron] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:33.996200 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:11:34.037084 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b4209-d187-4b13-a4cc-48b07b3e24e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:34.038217 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b4209-d187-4b13-a4cc-48b07b3e24e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:34.038500 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b4209-d187-4b13-a4cc-48b07b3e24e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:34.038778 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b4209-d187-4b13-a4cc-48b07b3e24e9 admin admin] PATH_INFO: `/v3/users/c499562d95444ce3ae8a9be180d2a30d` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:34.040047 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b4209-d187-4b13-a4cc-48b07b3e24e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c499562d95444ce3ae8a9be180d2a30d)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:34.042433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b4209-d187-4b13-a4cc-48b07b3e24e9 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:34.090279 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-4b7b4209-d187-4b13-a4cc-48b07b3e24e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c499562d95444ce3ae8a9be180d2a30d'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:34.090981 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-4b7b4209-d187-4b13-a4cc-48b07b3e24e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c499562d95444ce3ae8a9be180d2a30d'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:34.103738 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-4b7b4209-d187-4b13-a4cc-48b07b3e24e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c499562d95444ce3ae8a9be180d2a30d'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:34.111149 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-4b7b4209-d187-4b13-a4cc-48b07b3e24e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c499562d95444ce3ae8a9be180d2a30d'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:34.118531 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-4b7b4209-d187-4b13-a4cc-48b07b3e24e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c499562d95444ce3ae8a9be180d2a30d'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:34.124543 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1322/2651] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:11:33 2022] DELETE /identity/v3/users/c499562d95444ce3ae8a9be180d2a30d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:11:34.401104 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707fa254-ef67-4558-99a1-487fc6d08843 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:34.402874 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-707fa254-ef67-4558-99a1-487fc6d08843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:11:34.416539 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707fa254-ef67-4558-99a1-487fc6d08843 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:34.474567 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31719149-665c-4b62-b224-ffd24f5ce9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:34.475431 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31719149-665c-4b62-b224-ffd24f5ce9a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:34.475744 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31719149-665c-4b62-b224-ffd24f5ce9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:34.476023 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31719149-665c-4b62-b224-ffd24f5ce9a0 admin admin] PATH_INFO: `/v3/projects/426f2a00dec74e33a60977a00f0357cf` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:34.477201 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31719149-665c-4b62-b224-ffd24f5ce9a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=426f2a00dec74e33a60977a00f0357cf)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:34.479088 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31719149-665c-4b62-b224-ffd24f5ce9a0 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:34.510525 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:11:34.529266 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-31719149-665c-4b62-b224-ffd24f5ce9a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '426f2a00dec74e33a60977a00f0357cf', 'request_id': 'req-31719149-665c-4b62-b224-ffd24f5ce9a0'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:34.534791 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-31719149-665c-4b62-b224-ffd24f5ce9a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '426f2a00dec74e33a60977a00f0357cf', 'request_id': 'req-31719149-665c-4b62-b224-ffd24f5ce9a0'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:34.541421 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-31719149-665c-4b62-b224-ffd24f5ce9a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '426f2a00dec74e33a60977a00f0357cf', 'request_id': 'req-31719149-665c-4b62-b224-ffd24f5ce9a0'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:34.552795 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-31719149-665c-4b62-b224-ffd24f5ce9a0 admin admin] The token cache is being invalidate because project 426f2a00dec74e33a60977a00f0357cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:11:34.553083 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-31719149-665c-4b62-b224-ffd24f5ce9a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:34.553717 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-31719149-665c-4b62-b224-ffd24f5ce9a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:34.555230 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1330/2652] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:11:34 2022] DELETE /identity/v3/projects/426f2a00dec74e33a60977a00f0357cf => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:11:34.560095 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58096bd9-4270-4b18-8273-bbd48426635a None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:34.560593 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58096bd9-4270-4b18-8273-bbd48426635a None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:34.560593 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58096bd9-4270-4b18-8273-bbd48426635a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:34.589508 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-58096bd9-4270-4b18-8273-bbd48426635a None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:11:34.590704 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-58096bd9-4270-4b18-8273-bbd48426635a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:11:34.651802 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1323/2653] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:11:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:11:34.661079 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705119ff-1402-42fb-974d-a52f3f25bc75 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:34.661372 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705119ff-1402-42fb-974d-a52f3f25bc75 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:34.661656 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705119ff-1402-42fb-974d-a52f3f25bc75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:34.680776 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-705119ff-1402-42fb-974d-a52f3f25bc75 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:11:34.682046 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-705119ff-1402-42fb-974d-a52f3f25bc75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:11:34.690866 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1331/2654] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:11:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:11:34.695587 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58096bd9-4270-4b18-8273-bbd48426635a None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:34.706151 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58096bd9-4270-4b18-8273-bbd48426635a None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:34.710711 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b6176-a3c4-485f-ac02-31c618dd16d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:34.711366 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b6176-a3c4-485f-ac02-31c618dd16d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:34.711682 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b6176-a3c4-485f-ac02-31c618dd16d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:34.711956 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b6176-a3c4-485f-ac02-31c618dd16d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:34.712678 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b6176-a3c4-485f-ac02-31c618dd16d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:11:34.712986 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b6176-a3c4-485f-ac02-31c618dd16d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:34.714582 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b6176-a3c4-485f-ac02-31c618dd16d1 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:34.726346 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1324/2655] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 12:11:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:11:34.730707 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705119ff-1402-42fb-974d-a52f3f25bc75 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:34.740855 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705119ff-1402-42fb-974d-a52f3f25bc75 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:34.745693 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6013bedc-8d85-4f57-8408-b3d31c15e8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:34.746338 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013bedc-8d85-4f57-8408-b3d31c15e8fd admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:34.746619 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013bedc-8d85-4f57-8408-b3d31c15e8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:34.746940 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013bedc-8d85-4f57-8408-b3d31c15e8fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:34.747642 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6013bedc-8d85-4f57-8408-b3d31c15e8fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:34.749537 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6013bedc-8d85-4f57-8408-b3d31c15e8fd admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:34.774943 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1332/2656] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 12:11:34 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:11:34.779227 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b6176-a3c4-485f-ac02-31c618dd16d1 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:34.789076 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b6176-a3c4-485f-ac02-31c618dd16d1 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:34.805974 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:11:34.846905 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d40fa-e9f8-454f-9bfd-d0ccb5c61254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:34.847614 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d40fa-e9f8-454f-9bfd-d0ccb5c61254 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:34.847941 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d40fa-e9f8-454f-9bfd-d0ccb5c61254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:34.848207 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d40fa-e9f8-454f-9bfd-d0ccb5c61254 admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:34.848886 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d40fa-e9f8-454f-9bfd-d0ccb5c61254 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:34.850864 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d40fa-e9f8-454f-9bfd-d0ccb5c61254 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:34.870008 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1325/2657] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 12:11:34 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 12:11:34.873825 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6013bedc-8d85-4f57-8408-b3d31c15e8fd admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:34.884465 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6013bedc-8d85-4f57-8408-b3d31c15e8fd admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:34.888976 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b5211-b50b-408d-b4d8-c5cef9d14671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:34.889627 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b5211-b50b-408d-b4d8-c5cef9d14671 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:34.889927 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b5211-b50b-408d-b4d8-c5cef9d14671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:34.890204 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b5211-b50b-408d-b4d8-c5cef9d14671 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:34.890919 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b5211-b50b-408d-b4d8-c5cef9d14671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:34.892537 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b5211-b50b-408d-b4d8-c5cef9d14671 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:34.903257 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1333/2658] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:11:34.907031 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d40fa-e9f8-454f-9bfd-d0ccb5c61254 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:34.917155 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d40fa-e9f8-454f-9bfd-d0ccb5c61254 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:34.922328 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801945b-e1dc-4bb2-b829-dd76a4a06704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:34.923001 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801945b-e1dc-4bb2-b829-dd76a4a06704 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:34.923283 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801945b-e1dc-4bb2-b829-dd76a4a06704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:34.923596 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801945b-e1dc-4bb2-b829-dd76a4a06704 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:34.924325 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801945b-e1dc-4bb2-b829-dd76a4a06704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:34.925942 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801945b-e1dc-4bb2-b829-dd76a4a06704 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:34.935732 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1326/2659] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:11:34.940442 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b5211-b50b-408d-b4d8-c5cef9d14671 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:34.950604 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b5211-b50b-408d-b4d8-c5cef9d14671 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:34.955213 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56977ee-90cc-420e-80cb-d0969273184b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:34.956113 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56977ee-90cc-420e-80cb-d0969273184b admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:34.956392 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56977ee-90cc-420e-80cb-d0969273184b admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:34.956663 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56977ee-90cc-420e-80cb-d0969273184b admin admin] PATH_INFO: `/v3/projects/7ba001ba0068488b8197ea3a7e01b9c2/users/5e20b804c58c413c8ce558f0ee59b647/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:34.971816 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56977ee-90cc-420e-80cb-d0969273184b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ba001ba0068488b8197ea3a7e01b9c2, user_id=5e20b804c58c413c8ce558f0ee59b647, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:34.974430 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56977ee-90cc-420e-80cb-d0969273184b admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:34.987402 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1334/2660] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:11:34 2022] PUT /identity/v3/projects/7ba001ba0068488b8197ea3a7e01b9c2/users/5e20b804c58c413c8ce558f0ee59b647/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:11:34.992420 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86120ce7-1fa2-4626-aef6-fc0a6febf721 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:34.992743 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86120ce7-1fa2-4626-aef6-fc0a6febf721 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:34.993054 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86120ce7-1fa2-4626-aef6-fc0a6febf721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:35.012421 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-86120ce7-1fa2-4626-aef6-fc0a6febf721 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:11:35.013597 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-86120ce7-1fa2-4626-aef6-fc0a6febf721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:11:35.071608 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1327/2661] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:11:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:11:35.080950 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56977ee-90cc-420e-80cb-d0969273184b admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:35.082624 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-b56977ee-90cc-420e-80cb-d0969273184b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:11:35.139162 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56977ee-90cc-420e-80cb-d0969273184b admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:35.142842 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3810a-9561-4895-8ac4-d73f91395787 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:35.143470 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3810a-9561-4895-8ac4-d73f91395787 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:35.143783 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3810a-9561-4895-8ac4-d73f91395787 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:35.144052 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3810a-9561-4895-8ac4-d73f91395787 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:35.154097 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a3810a-9561-4895-8ac4-d73f91395787 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:35.155472 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a3810a-9561-4895-8ac4-d73f91395787 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:35.165479 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1335/2662] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:11:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:11:35.796393 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ede15-e96d-4a23-a30a-514f30182287 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:35.796947 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ede15-e96d-4a23-a30a-514f30182287 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:35.796947 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ede15-e96d-4a23-a30a-514f30182287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:35.825547 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-c84ede15-e96d-4a23-a30a-514f30182287 None None] MFA Rules not processed for user `5e20b804c58c413c8ce558f0ee59b647`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:11:35.826823 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-c84ede15-e96d-4a23-a30a-514f30182287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:11:35.905322 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1328/2663] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:11:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:11:35.909540 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3810a-9561-4895-8ac4-d73f91395787 service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:35.919445 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3810a-9561-4895-8ac4-d73f91395787 service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:35.924070 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745360a-0b23-466d-9cf7-b0eca0087f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:35.924751 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745360a-0b23-466d-9cf7-b0eca0087f61 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:35.925058 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745360a-0b23-466d-9cf7-b0eca0087f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:35.925334 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745360a-0b23-466d-9cf7-b0eca0087f61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:35.926017 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1745360a-0b23-466d-9cf7-b0eca0087f61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:35.928387 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1745360a-0b23-466d-9cf7-b0eca0087f61 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:35.966724 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1336/2664] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 12:11:35 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:11:35.970609 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ede15-e96d-4a23-a30a-514f30182287 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:35.982154 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ede15-e96d-4a23-a30a-514f30182287 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:36.008829 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:11:36.041776 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b89e9e6-2623-4891-9218-4ecc9e912af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:36.042458 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89e9e6-2623-4891-9218-4ecc9e912af9 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:36.042747 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89e9e6-2623-4891-9218-4ecc9e912af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:36.043027 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89e9e6-2623-4891-9218-4ecc9e912af9 admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:36.043758 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b89e9e6-2623-4891-9218-4ecc9e912af9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:36.045720 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b89e9e6-2623-4891-9218-4ecc9e912af9 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:36.066438 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1329/2665] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 12:11:35 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 12:11:36.070177 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745360a-0b23-466d-9cf7-b0eca0087f61 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:36.081258 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745360a-0b23-466d-9cf7-b0eca0087f61 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:36.086079 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf24c5-27f6-49c1-8f96-4664749aff0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:36.086759 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf24c5-27f6-49c1-8f96-4664749aff0c admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:36.087045 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf24c5-27f6-49c1-8f96-4664749aff0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:36.087323 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf24c5-27f6-49c1-8f96-4664749aff0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:36.088240 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bf24c5-27f6-49c1-8f96-4664749aff0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:36.089863 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bf24c5-27f6-49c1-8f96-4664749aff0c admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:36.101934 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1337/2666] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 12:11:36.106919 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b89e9e6-2623-4891-9218-4ecc9e912af9 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:36.119415 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b89e9e6-2623-4891-9218-4ecc9e912af9 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:36.126427 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd842b-6c98-42c6-b34f-b2b16c464c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:36.127330 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd842b-6c98-42c6-b34f-b2b16c464c40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:36.127665 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd842b-6c98-42c6-b34f-b2b16c464c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:36.127946 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd842b-6c98-42c6-b34f-b2b16c464c40 admin admin] PATH_INFO: `/v3/projects/1cf5ce8dbb434da5adedc2574c5d5ad4/users/d42d0803e13049b0801d7b9c3941a396/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:36.144091 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd842b-6c98-42c6-b34f-b2b16c464c40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cf5ce8dbb434da5adedc2574c5d5ad4, user_id=d42d0803e13049b0801d7b9c3941a396, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:36.146768 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd842b-6c98-42c6-b34f-b2b16c464c40 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:36.160123 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1330/2667] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:11:36 2022] PUT /identity/v3/projects/1cf5ce8dbb434da5adedc2574c5d5ad4/users/d42d0803e13049b0801d7b9c3941a396/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:11:36.164086 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf24c5-27f6-49c1-8f96-4664749aff0c admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:36.174264 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf24c5-27f6-49c1-8f96-4664749aff0c admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:36.191211 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:11:36.233585 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb7b767-dca7-4c39-afc2-9a831394c0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:36.234764 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7b767-dca7-4c39-afc2-9a831394c0ec admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:36.235093 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7b767-dca7-4c39-afc2-9a831394c0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:36.235390 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7b767-dca7-4c39-afc2-9a831394c0ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:36.236156 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb7b767-dca7-4c39-afc2-9a831394c0ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:36.237745 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb7b767-dca7-4c39-afc2-9a831394c0ec admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:36.247542 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1338/2668] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:11:36.252520 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd842b-6c98-42c6-b34f-b2b16c464c40 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:36.262701 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd842b-6c98-42c6-b34f-b2b16c464c40 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:36.268125 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e9af3-d79c-4795-952e-91aa480fa877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:36.269008 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e9af3-d79c-4795-952e-91aa480fa877 admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:36.269293 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e9af3-d79c-4795-952e-91aa480fa877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:36.269569 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e9af3-d79c-4795-952e-91aa480fa877 admin admin] PATH_INFO: `/v3/projects/1cf5ce8dbb434da5adedc2574c5d5ad4/users/d42d0803e13049b0801d7b9c3941a396/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:36.271530 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e9af3-d79c-4795-952e-91aa480fa877 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cf5ce8dbb434da5adedc2574c5d5ad4, user_id=d42d0803e13049b0801d7b9c3941a396, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:36.274420 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e9af3-d79c-4795-952e-91aa480fa877 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:36.285319 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1331/2669] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:11:36 2022] PUT /identity/v3/projects/1cf5ce8dbb434da5adedc2574c5d5ad4/users/d42d0803e13049b0801d7b9c3941a396/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:11:36.935392 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c946c3e-6212-43cc-a23e-812b15afa05d None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:36.935974 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c946c3e-6212-43cc-a23e-812b15afa05d None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:36.936093 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c946c3e-6212-43cc-a23e-812b15afa05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:36.964735 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-5c946c3e-6212-43cc-a23e-812b15afa05d None None] MFA Rules not processed for user `d42d0803e13049b0801d7b9c3941a396`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:11:36.965965 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-5c946c3e-6212-43cc-a23e-812b15afa05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:11:37.038205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1339/2670] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:11:36 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:11:37.050865 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e9af3-d79c-4795-952e-91aa480fa877 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:37.052819 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-610e9af3-d79c-4795-952e-91aa480fa877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:11:37.135691 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e9af3-d79c-4795-952e-91aa480fa877 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:37.139342 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a747df8c-83d9-4089-8ac6-bb95827f778b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:37.140032 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747df8c-83d9-4089-8ac6-bb95827f778b service cinder] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:37.140493 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747df8c-83d9-4089-8ac6-bb95827f778b service cinder] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:37.141025 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747df8c-83d9-4089-8ac6-bb95827f778b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:37.201154 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a747df8c-83d9-4089-8ac6-bb95827f778b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:37.202741 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a747df8c-83d9-4089-8ac6-bb95827f778b service cinder] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:37.212373 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1332/2671] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:11:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:11:38.557610 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c946c3e-6212-43cc-a23e-812b15afa05d None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:38.559002 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-5c946c3e-6212-43cc-a23e-812b15afa05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:11:38.570922 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c946c3e-6212-43cc-a23e-812b15afa05d None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:38.574520 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062175b5-c23a-417f-8791-3e833907feec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:38.575158 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062175b5-c23a-417f-8791-3e833907feec service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:38.575448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062175b5-c23a-417f-8791-3e833907feec service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:38.575748 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062175b5-c23a-417f-8791-3e833907feec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:38.585262 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062175b5-c23a-417f-8791-3e833907feec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:38.586695 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062175b5-c23a-417f-8791-3e833907feec service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:38.596830 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1340/2672] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:11:38 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:11:45.405174 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a747df8c-83d9-4089-8ac6-bb95827f778b service cinder] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:45.406621 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-a747df8c-83d9-4089-8ac6-bb95827f778b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:11:45.426137 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:11:45.498648 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a747df8c-83d9-4089-8ac6-bb95827f778b service cinder] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:45.504500 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aaa05a-8adb-4ef6-8f57-a713f9a9bd81 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5a91437dd64e2491ce41b4d12d4835', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:45.505186 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aaa05a-8adb-4ef6-8f57-a713f9a9bd81 service placement] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:45.505472 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aaa05a-8adb-4ef6-8f57-a713f9a9bd81 service placement] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:45.505752 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aaa05a-8adb-4ef6-8f57-a713f9a9bd81 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:45.507650 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-30aaa05a-8adb-4ef6-8f57-a713f9a9bd81 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:11:45.519698 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aaa05a-8adb-4ef6-8f57-a713f9a9bd81 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:45.521326 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aaa05a-8adb-4ef6-8f57-a713f9a9bd81 service placement] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:45.531957 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1333/2673] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:11:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:11:48.591916 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=60 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:11:50.959646 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062175b5-c23a-417f-8791-3e833907feec service cinder] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:50.961109 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-062175b5-c23a-417f-8791-3e833907feec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:11:50.975558 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062175b5-c23a-417f-8791-3e833907feec service cinder] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:50.980630 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c20268-b1d2-4abf-890e-bf9fda2d546c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5a91437dd64e2491ce41b4d12d4835', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:50.981275 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c20268-b1d2-4abf-890e-bf9fda2d546c service placement] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:50.981563 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c20268-b1d2-4abf-890e-bf9fda2d546c service placement] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:50.981839 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c20268-b1d2-4abf-890e-bf9fda2d546c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:50.983663 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-68c20268-b1d2-4abf-890e-bf9fda2d546c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:11:50.995535 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c20268-b1d2-4abf-890e-bf9fda2d546c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:50.997152 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c20268-b1d2-4abf-890e-bf9fda2d546c service placement] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:51.009181 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1341/2674] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:11:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:11:51.466969 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aaa05a-8adb-4ef6-8f57-a713f9a9bd81 service placement] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:51.477707 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aaa05a-8adb-4ef6-8f57-a713f9a9bd81 service placement] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:51.482910 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbae039-30a9-4edb-ade0-17c9582e8f56 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5a91437dd64e2491ce41b4d12d4835', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:51.483597 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbae039-30a9-4edb-ade0-17c9582e8f56 service placement] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:51.483888 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbae039-30a9-4edb-ade0-17c9582e8f56 service placement] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:51.484168 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbae039-30a9-4edb-ade0-17c9582e8f56 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:51.486462 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-4cbae039-30a9-4edb-ade0-17c9582e8f56 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:11:51.501929 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbae039-30a9-4edb-ade0-17c9582e8f56 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:51.503572 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbae039-30a9-4edb-ade0-17c9582e8f56 service placement] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:51.514870 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1334/2675] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:11:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:11:51.529523 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c20268-b1d2-4abf-890e-bf9fda2d546c service placement] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:51.598513 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c20268-b1d2-4abf-890e-bf9fda2d546c service placement] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:51.602995 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d05617-4108-4d5b-9dab-c590b91ecbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:51.603924 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d05617-4108-4d5b-9dab-c590b91ecbbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:51.604203 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d05617-4108-4d5b-9dab-c590b91ecbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:51.604473 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d05617-4108-4d5b-9dab-c590b91ecbbb admin admin] PATH_INFO: `/v3/users/5e20b804c58c413c8ce558f0ee59b647` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:51.605670 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d05617-4108-4d5b-9dab-c590b91ecbbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e20b804c58c413c8ce558f0ee59b647)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:51.607604 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d05617-4108-4d5b-9dab-c590b91ecbbb admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:51.653772 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-81d05617-4108-4d5b-9dab-c590b91ecbbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e20b804c58c413c8ce558f0ee59b647'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:51.661266 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-81d05617-4108-4d5b-9dab-c590b91ecbbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e20b804c58c413c8ce558f0ee59b647'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:51.661962 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-81d05617-4108-4d5b-9dab-c590b91ecbbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e20b804c58c413c8ce558f0ee59b647'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:51.674299 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-81d05617-4108-4d5b-9dab-c590b91ecbbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e20b804c58c413c8ce558f0ee59b647'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:51.680746 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-81d05617-4108-4d5b-9dab-c590b91ecbbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e20b804c58c413c8ce558f0ee59b647'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:51.687010 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1342/2676] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:11:51 2022] DELETE /identity/v3/users/5e20b804c58c413c8ce558f0ee59b647 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:11:51.864396 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbae039-30a9-4edb-ade0-17c9582e8f56 service placement] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:51.875341 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbae039-30a9-4edb-ade0-17c9582e8f56 service placement] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:51.939652 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd9216-5136-4a67-9c6e-89664b7c1805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:51.940562 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd9216-5136-4a67-9c6e-89664b7c1805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:51.940850 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd9216-5136-4a67-9c6e-89664b7c1805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:51.941129 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd9216-5136-4a67-9c6e-89664b7c1805 admin admin] PATH_INFO: `/v3/projects/7ba001ba0068488b8197ea3a7e01b9c2` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:51.942349 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fd9216-5136-4a67-9c6e-89664b7c1805 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ba001ba0068488b8197ea3a7e01b9c2)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:51.944329 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fd9216-5136-4a67-9c6e-89664b7c1805 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:51.990771 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-94fd9216-5136-4a67-9c6e-89664b7c1805 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ba001ba0068488b8197ea3a7e01b9c2', 'request_id': 'req-94fd9216-5136-4a67-9c6e-89664b7c1805'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:51.996238 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-94fd9216-5136-4a67-9c6e-89664b7c1805 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ba001ba0068488b8197ea3a7e01b9c2', 'request_id': 'req-94fd9216-5136-4a67-9c6e-89664b7c1805'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:52.003480 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-94fd9216-5136-4a67-9c6e-89664b7c1805 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ba001ba0068488b8197ea3a7e01b9c2', 'request_id': 'req-94fd9216-5136-4a67-9c6e-89664b7c1805'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:52.014784 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-94fd9216-5136-4a67-9c6e-89664b7c1805 admin admin] The token cache is being invalidate because project 7ba001ba0068488b8197ea3a7e01b9c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:11:52.015074 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-94fd9216-5136-4a67-9c6e-89664b7c1805 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:52.015770 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-94fd9216-5136-4a67-9c6e-89664b7c1805 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:52.017864 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1335/2677] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:11:51 2022] DELETE /identity/v3/projects/7ba001ba0068488b8197ea3a7e01b9c2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:11:52.021801 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d05617-4108-4d5b-9dab-c590b91ecbbb admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:52.023284 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-81d05617-4108-4d5b-9dab-c590b91ecbbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:11:52.037172 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d05617-4108-4d5b-9dab-c590b91ecbbb admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:52.093735 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbc22d-7e43-49ba-8223-b3381c6b9bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:52.095206 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbc22d-7e43-49ba-8223-b3381c6b9bda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:52.095495 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbc22d-7e43-49ba-8223-b3381c6b9bda admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:52.095798 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbc22d-7e43-49ba-8223-b3381c6b9bda admin admin] PATH_INFO: `/v3/users/d42d0803e13049b0801d7b9c3941a396` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:52.097003 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edbc22d-7e43-49ba-8223-b3381c6b9bda admin admin] RBAC: Authorizing `identity:delete_user(user_id=d42d0803e13049b0801d7b9c3941a396)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:52.098922 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edbc22d-7e43-49ba-8223-b3381c6b9bda admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:52.104502 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:11:52.146684 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-8edbc22d-7e43-49ba-8223-b3381c6b9bda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd42d0803e13049b0801d7b9c3941a396'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:52.153888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-8edbc22d-7e43-49ba-8223-b3381c6b9bda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd42d0803e13049b0801d7b9c3941a396'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:52.154566 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-8edbc22d-7e43-49ba-8223-b3381c6b9bda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd42d0803e13049b0801d7b9c3941a396'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:52.166830 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-8edbc22d-7e43-49ba-8223-b3381c6b9bda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd42d0803e13049b0801d7b9c3941a396'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:52.174104 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-8edbc22d-7e43-49ba-8223-b3381c6b9bda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd42d0803e13049b0801d7b9c3941a396'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:52.180384 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1343/2678] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:11:52 2022] DELETE /identity/v3/users/d42d0803e13049b0801d7b9c3941a396 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:11:52.355391 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd9216-5136-4a67-9c6e-89664b7c1805 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:52.356868 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-94fd9216-5136-4a67-9c6e-89664b7c1805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:11:52.364976 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:11:52.371936 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd9216-5136-4a67-9c6e-89664b7c1805 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:52.434087 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c5520-14f2-43be-b156-5754d2aaa065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:52.434973 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c5520-14f2-43be-b156-5754d2aaa065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:52.435261 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c5520-14f2-43be-b156-5754d2aaa065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:52.435570 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c5520-14f2-43be-b156-5754d2aaa065 admin admin] PATH_INFO: `/v3/projects/1cf5ce8dbb434da5adedc2574c5d5ad4` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:52.436781 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c5520-14f2-43be-b156-5754d2aaa065 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cf5ce8dbb434da5adedc2574c5d5ad4)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:52.439263 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c5520-14f2-43be-b156-5754d2aaa065 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:52.485537 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-088c5520-14f2-43be-b156-5754d2aaa065 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cf5ce8dbb434da5adedc2574c5d5ad4', 'request_id': 'req-088c5520-14f2-43be-b156-5754d2aaa065'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:52.491297 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-088c5520-14f2-43be-b156-5754d2aaa065 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cf5ce8dbb434da5adedc2574c5d5ad4', 'request_id': 'req-088c5520-14f2-43be-b156-5754d2aaa065'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:52.505555 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-088c5520-14f2-43be-b156-5754d2aaa065 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cf5ce8dbb434da5adedc2574c5d5ad4', 'request_id': 'req-088c5520-14f2-43be-b156-5754d2aaa065'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:52.517928 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-088c5520-14f2-43be-b156-5754d2aaa065 admin admin] The token cache is being invalidate because project 1cf5ce8dbb434da5adedc2574c5d5ad4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:11:52.518210 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-088c5520-14f2-43be-b156-5754d2aaa065 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:52.518839 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-088c5520-14f2-43be-b156-5754d2aaa065 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:11:52.520546 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1336/2679] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:11:52 2022] DELETE /identity/v3/projects/1cf5ce8dbb434da5adedc2574c5d5ad4 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:11:52.525822 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec9a3b-3cde-4f44-81cc-306733576aef None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:52.526053 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec9a3b-3cde-4f44-81cc-306733576aef None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:52.526330 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec9a3b-3cde-4f44-81cc-306733576aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:52.544343 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-c5ec9a3b-3cde-4f44-81cc-306733576aef None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:11:52.545542 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-c5ec9a3b-3cde-4f44-81cc-306733576aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:11:52.608273 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1344/2680] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:11:52.619976 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398b617-e4b6-4b37-b81f-1a6121ed792c None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:52.619976 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398b617-e4b6-4b37-b81f-1a6121ed792c None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:52.619976 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398b617-e4b6-4b37-b81f-1a6121ed792c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:52.636399 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-8398b617-e4b6-4b37-b81f-1a6121ed792c None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:11:52.637613 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-8398b617-e4b6-4b37-b81f-1a6121ed792c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:11:52.646281 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1337/2681] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:11:52.650989 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec9a3b-3cde-4f44-81cc-306733576aef None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:52.660767 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec9a3b-3cde-4f44-81cc-306733576aef None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:52.665539 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb4ce5-67f8-4115-887b-cc63a464df7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:52.666330 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb4ce5-67f8-4115-887b-cc63a464df7f admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:52.666623 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb4ce5-67f8-4115-887b-cc63a464df7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:52.666898 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb4ce5-67f8-4115-887b-cc63a464df7f admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:52.667672 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cb4ce5-67f8-4115-887b-cc63a464df7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:11:52.667985 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cb4ce5-67f8-4115-887b-cc63a464df7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:52.669609 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cb4ce5-67f8-4115-887b-cc63a464df7f admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:52.681356 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1345/2682] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 12:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:11:52.685775 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398b617-e4b6-4b37-b81f-1a6121ed792c None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:52.695739 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398b617-e4b6-4b37-b81f-1a6121ed792c None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:52.700357 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25b48c-edbc-47c8-8572-d557a2838328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:52.701061 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25b48c-edbc-47c8-8572-d557a2838328 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:52.701340 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25b48c-edbc-47c8-8572-d557a2838328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:52.701611 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25b48c-edbc-47c8-8572-d557a2838328 admin admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:52.702319 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25b48c-edbc-47c8-8572-d557a2838328 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:52.704778 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25b48c-edbc-47c8-8572-d557a2838328 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:52.732082 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1338/2683] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 12:11:52 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:11:52.736550 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb4ce5-67f8-4115-887b-cc63a464df7f admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:52.747009 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb4ce5-67f8-4115-887b-cc63a464df7f admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:52.806091 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d0153-a4c4-4b95-b46d-9c64ce74c8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:52.806666 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d0153-a4c4-4b95-b46d-9c64ce74c8bf admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:52.806950 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d0153-a4c4-4b95-b46d-9c64ce74c8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:52.807226 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d0153-a4c4-4b95-b46d-9c64ce74c8bf admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:52.807999 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d0153-a4c4-4b95-b46d-9c64ce74c8bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:52.810564 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d0153-a4c4-4b95-b46d-9c64ce74c8bf admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:52.831663 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1346/2684] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 12:11:52 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:11:52.835880 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25b48c-edbc-47c8-8572-d557a2838328 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:52.847379 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25b48c-edbc-47c8-8572-d557a2838328 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:52.852133 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7794a9aa-7622-45a4-8a01-be40593b35ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:52.852802 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794a9aa-7622-45a4-8a01-be40593b35ae admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:52.853086 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794a9aa-7622-45a4-8a01-be40593b35ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:52.853377 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794a9aa-7622-45a4-8a01-be40593b35ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:52.854083 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7794a9aa-7622-45a4-8a01-be40593b35ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:52.855714 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7794a9aa-7622-45a4-8a01-be40593b35ae admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:52.866984 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1339/2685] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:11:52.871104 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d0153-a4c4-4b95-b46d-9c64ce74c8bf admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:52.876960 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:11:52.882448 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d0153-a4c4-4b95-b46d-9c64ce74c8bf admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:52.888455 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b69d697-35cb-43ac-9d48-99071ed23659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:52.889359 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69d697-35cb-43ac-9d48-99071ed23659 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:52.889647 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69d697-35cb-43ac-9d48-99071ed23659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:52.889949 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69d697-35cb-43ac-9d48-99071ed23659 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:52.890679 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b69d697-35cb-43ac-9d48-99071ed23659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:52.892322 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b69d697-35cb-43ac-9d48-99071ed23659 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:52.905047 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1347/2686] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:11:52.909279 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7794a9aa-7622-45a4-8a01-be40593b35ae admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:52.919376 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7794a9aa-7622-45a4-8a01-be40593b35ae admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:52.924535 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40524d22-efdb-4086-85e4-296357c9ad33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:52.925416 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40524d22-efdb-4086-85e4-296357c9ad33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:52.925699 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40524d22-efdb-4086-85e4-296357c9ad33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:52.925975 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40524d22-efdb-4086-85e4-296357c9ad33 admin admin] PATH_INFO: `/v3/projects/c7ebc6adcc25483d8f5edc66b7941e9d/users/f93afe38962241d5b4a63a17b77d07ec/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:52.941238 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40524d22-efdb-4086-85e4-296357c9ad33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7ebc6adcc25483d8f5edc66b7941e9d, user_id=f93afe38962241d5b4a63a17b77d07ec, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:52.943946 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40524d22-efdb-4086-85e4-296357c9ad33 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:52.958287 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1340/2687] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:11:52 2022] PUT /identity/v3/projects/c7ebc6adcc25483d8f5edc66b7941e9d/users/f93afe38962241d5b4a63a17b77d07ec/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:11:52.968734 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffe1f3-730e-4640-b4de-15cbbe567908 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:52.969029 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffe1f3-730e-4640-b4de-15cbbe567908 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:52.969317 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffe1f3-730e-4640-b4de-15cbbe567908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:52.997042 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-a8ffe1f3-730e-4640-b4de-15cbbe567908 None None] MFA Rules not processed for user `f93afe38962241d5b4a63a17b77d07ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:11:52.998274 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-a8ffe1f3-730e-4640-b4de-15cbbe567908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:11:53.067157 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1348/2688] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:11:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:11:53.078523 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40524d22-efdb-4086-85e4-296357c9ad33 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:53.080266 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-40524d22-efdb-4086-85e4-296357c9ad33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:11:53.112939 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:11:53.139670 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40524d22-efdb-4086-85e4-296357c9ad33 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:53.143317 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a76618-0e59-4c46-b0d3-904735b81889 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:53.144002 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a76618-0e59-4c46-b0d3-904735b81889 service cinder] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:53.144285 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a76618-0e59-4c46-b0d3-904735b81889 service cinder] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:53.144561 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a76618-0e59-4c46-b0d3-904735b81889 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:53.153100 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a76618-0e59-4c46-b0d3-904735b81889 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:53.154534 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a76618-0e59-4c46-b0d3-904735b81889 service cinder] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:53.163822 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1341/2689] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:11:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:11:56.231948 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ffe1f3-730e-4640-b4de-15cbbe567908 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:11:56.241674 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ffe1f3-730e-4640-b4de-15cbbe567908 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:11:56.245230 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191153f-a385-4241-b534-e594b6fff4e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:11:56.245866 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191153f-a385-4241-b534-e594b6fff4e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:11:56.246144 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191153f-a385-4241-b534-e594b6fff4e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:11:56.246418 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191153f-a385-4241-b534-e594b6fff4e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:11:56.248206 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-a191153f-a385-4241-b534-e594b6fff4e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:11:56.306316 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a191153f-a385-4241-b534-e594b6fff4e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:11:56.307784 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a191153f-a385-4241-b534-e594b6fff4e8 service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:11:56.317208 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1349/2690] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:11:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:12:03.159978 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=13 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:12:06.312725 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=64 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:12:12.493980 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6fb969-0191-4e52-a129-af4e31a737d7 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:12:12.494515 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6fb969-0191-4e52-a129-af4e31a737d7 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:12:12.494515 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6fb969-0191-4e52-a129-af4e31a737d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:12:12.512250 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-bb6fb969-0191-4e52-a129-af4e31a737d7 None None] MFA Rules not processed for user `79c5b9ec7d2248918e884cd01adb84c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:12:12.513508 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-bb6fb969-0191-4e52-a129-af4e31a737d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:12:12.521062 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1342/2691] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:12:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:12:12.832467 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191153f-a385-4241-b534-e594b6fff4e8 service cinder] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:12:12.833870 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-a191153f-a385-4241-b534-e594b6fff4e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:12:12.891264 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191153f-a385-4241-b534-e594b6fff4e8 service cinder] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:12:12.895354 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c2456-a8c2-457b-8dd7-826e5baff107 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:12:12.896093 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c2456-a8c2-457b-8dd7-826e5baff107 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:12:12.896371 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c2456-a8c2-457b-8dd7-826e5baff107 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:12:12.896642 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c2456-a8c2-457b-8dd7-826e5baff107 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:12:12.898378 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-404c2456-a8c2-457b-8dd7-826e5baff107 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:12:12.908828 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404c2456-a8c2-457b-8dd7-826e5baff107 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:12:12.910612 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404c2456-a8c2-457b-8dd7-826e5baff107 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:12:12.919352 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1350/2692] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:12:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:12:22.507323 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=3 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:12:22.915172 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=26 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:12:24.227939 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6fb969-0191-4e52-a129-af4e31a737d7 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:12:24.293597 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6fb969-0191-4e52-a129-af4e31a737d7 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:12:24.298751 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b9b93-4bfa-44be-a5fa-87caa9546e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:12:24.299664 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b9b93-4bfa-44be-a5fa-87caa9546e5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:12:24.299952 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b9b93-4bfa-44be-a5fa-87caa9546e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:12:24.300237 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b9b93-4bfa-44be-a5fa-87caa9546e5b admin admin] PATH_INFO: `/v3/users/f93afe38962241d5b4a63a17b77d07ec` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:12:24.301443 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b9b93-4bfa-44be-a5fa-87caa9546e5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f93afe38962241d5b4a63a17b77d07ec)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:12:24.303398 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b9b93-4bfa-44be-a5fa-87caa9546e5b admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:12:24.349866 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-032b9b93-4bfa-44be-a5fa-87caa9546e5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f93afe38962241d5b4a63a17b77d07ec'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:12:24.350527 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-032b9b93-4bfa-44be-a5fa-87caa9546e5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f93afe38962241d5b4a63a17b77d07ec'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:12:24.363004 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-032b9b93-4bfa-44be-a5fa-87caa9546e5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f93afe38962241d5b4a63a17b77d07ec'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:12:24.369811 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-032b9b93-4bfa-44be-a5fa-87caa9546e5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f93afe38962241d5b4a63a17b77d07ec'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:12:24.378706 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-032b9b93-4bfa-44be-a5fa-87caa9546e5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f93afe38962241d5b4a63a17b77d07ec'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:12:24.385209 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1343/2693] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:12:24 2022] DELETE /identity/v3/users/f93afe38962241d5b4a63a17b77d07ec => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:12:24.389837 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1628b-1acb-4934-a0aa-d0a43b7172ac None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:12:24.390359 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1628b-1acb-4934-a0aa-d0a43b7172ac None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:12:24.390490 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1628b-1acb-4934-a0aa-d0a43b7172ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:12:24.408680 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-23c1628b-1acb-4934-a0aa-d0a43b7172ac None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:12:24.409912 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-23c1628b-1acb-4934-a0aa-d0a43b7172ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:12:24.468636 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1351/2694] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:12:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:12:24.478187 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b9b93-4bfa-44be-a5fa-87caa9546e5b admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:12:24.479623 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-032b9b93-4bfa-44be-a5fa-87caa9546e5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:12:24.536402 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b9b93-4bfa-44be-a5fa-87caa9546e5b admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:12:24.540285 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeaed88-bb6a-4fe2-a636-107233673b7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:12:24.540947 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeaed88-bb6a-4fe2-a636-107233673b7a service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:12:24.541244 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeaed88-bb6a-4fe2-a636-107233673b7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:12:24.541526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeaed88-bb6a-4fe2-a636-107233673b7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:12:24.553365 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeaed88-bb6a-4fe2-a636-107233673b7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:12:24.554749 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeaed88-bb6a-4fe2-a636-107233673b7a service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:12:24.565220 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1344/2695] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:12:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:12:24.833863 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1628b-1acb-4934-a0aa-d0a43b7172ac None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:12:24.835537 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-23c1628b-1acb-4934-a0aa-d0a43b7172ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:12:24.850600 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1628b-1acb-4934-a0aa-d0a43b7172ac None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:12:24.855896 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864632b-30ba-42bf-98ea-d85780be9709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:12:24.856916 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864632b-30ba-42bf-98ea-d85780be9709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:12:24.857179 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864632b-30ba-42bf-98ea-d85780be9709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:12:24.857577 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864632b-30ba-42bf-98ea-d85780be9709 admin admin] PATH_INFO: `/v3/projects/c7ebc6adcc25483d8f5edc66b7941e9d` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:12:24.858649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1864632b-30ba-42bf-98ea-d85780be9709 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7ebc6adcc25483d8f5edc66b7941e9d)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:12:24.860604 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1864632b-30ba-42bf-98ea-d85780be9709 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:12:24.908878 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1864632b-30ba-42bf-98ea-d85780be9709 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7ebc6adcc25483d8f5edc66b7941e9d', 'request_id': 'req-1864632b-30ba-42bf-98ea-d85780be9709'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:12:24.914760 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1864632b-30ba-42bf-98ea-d85780be9709 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7ebc6adcc25483d8f5edc66b7941e9d', 'request_id': 'req-1864632b-30ba-42bf-98ea-d85780be9709'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:12:24.930314 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1864632b-30ba-42bf-98ea-d85780be9709 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7ebc6adcc25483d8f5edc66b7941e9d', 'request_id': 'req-1864632b-30ba-42bf-98ea-d85780be9709'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:12:24.943973 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1864632b-30ba-42bf-98ea-d85780be9709 admin admin] The token cache is being invalidate because project c7ebc6adcc25483d8f5edc66b7941e9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:12:24.944256 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1864632b-30ba-42bf-98ea-d85780be9709 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:12:24.944951 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1864632b-30ba-42bf-98ea-d85780be9709 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:12:24.946621 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1352/2696] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:12:24 2022] DELETE /identity/v3/projects/c7ebc6adcc25483d8f5edc66b7941e9d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:12:24.951710 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91290a-194a-4f11-8f94-a269647a109a None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:12:24.951998 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91290a-194a-4f11-8f94-a269647a109a None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:12:24.952273 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91290a-194a-4f11-8f94-a269647a109a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:12:24.971543 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-5f91290a-194a-4f11-8f94-a269647a109a None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:12:24.972812 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-5f91290a-194a-4f11-8f94-a269647a109a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:12:24.992666 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:12:25.043051 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1345/2697] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:12:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:12:25.104597 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f3e0d-4926-493e-bb0b-8004f27e5854 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:12:25.104868 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f3e0d-4926-493e-bb0b-8004f27e5854 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:12:25.105193 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f3e0d-4926-493e-bb0b-8004f27e5854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:12:25.126551 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-409f3e0d-4926-493e-bb0b-8004f27e5854 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:12:25.127879 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-409f3e0d-4926-493e-bb0b-8004f27e5854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:12:25.136602 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1353/2698] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:12:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 12:12:25.140838 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91290a-194a-4f11-8f94-a269647a109a None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:12:25.150515 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91290a-194a-4f11-8f94-a269647a109a None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:12:25.155131 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad39862-403d-44ec-94d6-023cb3c47c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:12:25.155832 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad39862-403d-44ec-94d6-023cb3c47c3c admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:12:25.156114 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad39862-403d-44ec-94d6-023cb3c47c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:12:25.156386 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad39862-403d-44ec-94d6-023cb3c47c3c admin admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:12:25.157108 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad39862-403d-44ec-94d6-023cb3c47c3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:12:25.157412 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad39862-403d-44ec-94d6-023cb3c47c3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:12:25.159000 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad39862-403d-44ec-94d6-023cb3c47c3c admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:12:25.170802 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1346/2699] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 12:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:12:25.175713 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f3e0d-4926-493e-bb0b-8004f27e5854 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:12:25.184874 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f3e0d-4926-493e-bb0b-8004f27e5854 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:12:25.190106 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69560f30-19af-44a9-adb5-f944ca35cde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:12:25.190741 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69560f30-19af-44a9-adb5-f944ca35cde5 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:12:25.191017 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69560f30-19af-44a9-adb5-f944ca35cde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:12:25.191287 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69560f30-19af-44a9-adb5-f944ca35cde5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:12:25.192022 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69560f30-19af-44a9-adb5-f944ca35cde5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:12:25.193887 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69560f30-19af-44a9-adb5-f944ca35cde5 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:12:25.219293 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1354/2700] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 12:12:25 2022] POST /identity/v3/projects => generated 369 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:12:25.223484 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad39862-403d-44ec-94d6-023cb3c47c3c admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:12:25.233218 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad39862-403d-44ec-94d6-023cb3c47c3c admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:12:25.288297 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a65c20-7a3f-40d8-b991-a21eb18285d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:12:25.288929 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a65c20-7a3f-40d8-b991-a21eb18285d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:12:25.289211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a65c20-7a3f-40d8-b991-a21eb18285d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:12:25.289485 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a65c20-7a3f-40d8-b991-a21eb18285d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:12:25.290157 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a65c20-7a3f-40d8-b991-a21eb18285d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:12:25.292100 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a65c20-7a3f-40d8-b991-a21eb18285d0 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:12:25.313300 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1347/2701] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 12:12:25 2022] POST /identity/v3/users => generated 285 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:12:25.317480 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69560f30-19af-44a9-adb5-f944ca35cde5 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:12:25.327550 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69560f30-19af-44a9-adb5-f944ca35cde5 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:12:25.332019 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac5f71-aa6c-4a31-a3ae-09ebfff3ee9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:12:25.332661 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac5f71-aa6c-4a31-a3ae-09ebfff3ee9a admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:12:25.332941 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac5f71-aa6c-4a31-a3ae-09ebfff3ee9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:12:25.333221 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac5f71-aa6c-4a31-a3ae-09ebfff3ee9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:12:25.333933 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac5f71-aa6c-4a31-a3ae-09ebfff3ee9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:12:25.335510 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac5f71-aa6c-4a31-a3ae-09ebfff3ee9a admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:12:25.346152 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1355/2702] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:12:25.349822 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a65c20-7a3f-40d8-b991-a21eb18285d0 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:12:25.360600 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a65c20-7a3f-40d8-b991-a21eb18285d0 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:12:25.366177 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be8ca5-526f-4012-a45b-b1a2ec573f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:12:25.366829 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be8ca5-526f-4012-a45b-b1a2ec573f44 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:12:25.367113 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be8ca5-526f-4012-a45b-b1a2ec573f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:12:25.367388 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be8ca5-526f-4012-a45b-b1a2ec573f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:12:25.368174 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be8ca5-526f-4012-a45b-b1a2ec573f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:12:25.369767 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be8ca5-526f-4012-a45b-b1a2ec573f44 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:12:25.379764 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1348/2703] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:12:25.383421 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac5f71-aa6c-4a31-a3ae-09ebfff3ee9a admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:12:25.393355 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac5f71-aa6c-4a31-a3ae-09ebfff3ee9a admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:12:25.397964 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188427f-2f43-4332-ac57-4fb177771c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:12:25.398919 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188427f-2f43-4332-ac57-4fb177771c19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:12:25.399206 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188427f-2f43-4332-ac57-4fb177771c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:12:25.399487 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188427f-2f43-4332-ac57-4fb177771c19 admin admin] PATH_INFO: `/v3/projects/84317714d9774f6baf2830d37a78578a/users/245fd4671e6b4da0b43eed091332e22b/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:12:25.415105 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d188427f-2f43-4332-ac57-4fb177771c19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84317714d9774f6baf2830d37a78578a, user_id=245fd4671e6b4da0b43eed091332e22b, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:12:25.417776 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d188427f-2f43-4332-ac57-4fb177771c19 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:12:25.431308 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1356/2704] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:12:25 2022] PUT /identity/v3/projects/84317714d9774f6baf2830d37a78578a/users/245fd4671e6b4da0b43eed091332e22b/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 12:12:25.441296 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8047f1-f2f2-4baa-b7b5-f0dd9bbef630 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:12:25.441591 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8047f1-f2f2-4baa-b7b5-f0dd9bbef630 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:12:25.441874 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8047f1-f2f2-4baa-b7b5-f0dd9bbef630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:12:25.467855 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-4f8047f1-f2f2-4baa-b7b5-f0dd9bbef630 None None] MFA Rules not processed for user `245fd4671e6b4da0b43eed091332e22b`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:12:25.469586 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-4f8047f1-f2f2-4baa-b7b5-f0dd9bbef630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:12:25.533366 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1349/2705] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:12:25 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:12:25.545161 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188427f-2f43-4332-ac57-4fb177771c19 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:12:25.547487 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-d188427f-2f43-4332-ac57-4fb177771c19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:12:25.570371 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:12:25.631146 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188427f-2f43-4332-ac57-4fb177771c19 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:12:25.634856 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671a0bd-235a-4cb2-b4d9-25d34e89854f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aa048aec48b4755ac13eae997bff2fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:12:25.635554 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671a0bd-235a-4cb2-b4d9-25d34e89854f service glance] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:12:25.635844 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671a0bd-235a-4cb2-b4d9-25d34e89854f service glance] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:12:25.636123 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671a0bd-235a-4cb2-b4d9-25d34e89854f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:12:25.644602 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4671a0bd-235a-4cb2-b4d9-25d34e89854f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:12:25.646035 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4671a0bd-235a-4cb2-b4d9-25d34e89854f service glance] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:12:25.655408 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1357/2706] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:12:25 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:12:35.529962 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:12:35.652192 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=26 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:12:35.937978 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8047f1-f2f2-4baa-b7b5-f0dd9bbef630 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:12:35.939373 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-4f8047f1-f2f2-4baa-b7b5-f0dd9bbef630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:12:36.000205 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8047f1-f2f2-4baa-b7b5-f0dd9bbef630 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:12:36.004529 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95dec2-7538-45e0-8025-91f0e47fe347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:12:36.005425 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95dec2-7538-45e0-8025-91f0e47fe347 service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:12:36.005844 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95dec2-7538-45e0-8025-91f0e47fe347 service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:12:36.006201 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95dec2-7538-45e0-8025-91f0e47fe347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:12:36.008132 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-df95dec2-7538-45e0-8025-91f0e47fe347 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:12:36.072956 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95dec2-7538-45e0-8025-91f0e47fe347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:12:36.074475 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95dec2-7538-45e0-8025-91f0e47fe347 service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:12:36.086072 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1350/2707] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:12:35 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:12:46.081115 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=50 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:13:01.678468 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671a0bd-235a-4cb2-b4d9-25d34e89854f service glance] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:13:01.741714 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671a0bd-235a-4cb2-b4d9-25d34e89854f service glance] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:13:01.746328 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c94b68-707a-4f03-a9d4-678af459120f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:13:01.747199 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c94b68-707a-4f03-a9d4-678af459120f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:13:01.747484 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c94b68-707a-4f03-a9d4-678af459120f admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:13:01.747799 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c94b68-707a-4f03-a9d4-678af459120f admin admin] PATH_INFO: `/v3/users/245fd4671e6b4da0b43eed091332e22b` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:13:01.748992 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c94b68-707a-4f03-a9d4-678af459120f admin admin] RBAC: Authorizing `identity:delete_user(user_id=245fd4671e6b4da0b43eed091332e22b)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:13:01.750903 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c94b68-707a-4f03-a9d4-678af459120f admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:13:01.796825 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-23c94b68-707a-4f03-a9d4-678af459120f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '245fd4671e6b4da0b43eed091332e22b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:13:01.804193 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-23c94b68-707a-4f03-a9d4-678af459120f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '245fd4671e6b4da0b43eed091332e22b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:13:01.804865 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-23c94b68-707a-4f03-a9d4-678af459120f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '245fd4671e6b4da0b43eed091332e22b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:13:01.818641 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-23c94b68-707a-4f03-a9d4-678af459120f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '245fd4671e6b4da0b43eed091332e22b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:13:01.825721 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-23c94b68-707a-4f03-a9d4-678af459120f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '245fd4671e6b4da0b43eed091332e22b'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:13:01.832943 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1358/2708] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:13:01 2022] DELETE /identity/v3/users/245fd4671e6b4da0b43eed091332e22b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:13:01.837666 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4490f-83c8-4cde-a04f-c9f3e21ce2ae None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:13:01.838170 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4490f-83c8-4cde-a04f-c9f3e21ce2ae None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:13:01.838281 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4490f-83c8-4cde-a04f-c9f3e21ce2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:13:01.855739 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-44a4490f-83c8-4cde-a04f-c9f3e21ce2ae None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:13:01.856931 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-44a4490f-83c8-4cde-a04f-c9f3e21ce2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:13:01.918597 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1351/2709] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 12:13:01.929297 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c94b68-707a-4f03-a9d4-678af459120f admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:13:01.930681 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-23c94b68-707a-4f03-a9d4-678af459120f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:13:01.988006 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c94b68-707a-4f03-a9d4-678af459120f admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:13:01.991588 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ef7ea-8125-4c26-afa0-256405a14e21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:13:01.992219 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ef7ea-8125-4c26-afa0-256405a14e21 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:13:01.992495 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ef7ea-8125-4c26-afa0-256405a14e21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:13:01.992764 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ef7ea-8125-4c26-afa0-256405a14e21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:13:02.003112 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ef7ea-8125-4c26-afa0-256405a14e21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:13:02.005097 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ef7ea-8125-4c26-afa0-256405a14e21 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:13:02.017314 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1359/2710] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:13:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:13:02.288717 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4490f-83c8-4cde-a04f-c9f3e21ce2ae None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:13:02.290382 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-44a4490f-83c8-4cde-a04f-c9f3e21ce2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:13:02.306860 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4490f-83c8-4cde-a04f-c9f3e21ce2ae None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:13:02.311881 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe69158-03b7-4eef-bed4-f92224017c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:13:02.312727 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe69158-03b7-4eef-bed4-f92224017c07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:13:02.313005 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe69158-03b7-4eef-bed4-f92224017c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:13:02.313325 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe69158-03b7-4eef-bed4-f92224017c07 admin admin] PATH_INFO: `/v3/projects/84317714d9774f6baf2830d37a78578a` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:13:02.314733 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe69158-03b7-4eef-bed4-f92224017c07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84317714d9774f6baf2830d37a78578a)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:13:02.317111 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe69158-03b7-4eef-bed4-f92224017c07 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:13:02.366677 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-bfe69158-03b7-4eef-bed4-f92224017c07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84317714d9774f6baf2830d37a78578a', 'request_id': 'req-bfe69158-03b7-4eef-bed4-f92224017c07'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:13:02.372217 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-bfe69158-03b7-4eef-bed4-f92224017c07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84317714d9774f6baf2830d37a78578a', 'request_id': 'req-bfe69158-03b7-4eef-bed4-f92224017c07'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:13:02.379295 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-bfe69158-03b7-4eef-bed4-f92224017c07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84317714d9774f6baf2830d37a78578a', 'request_id': 'req-bfe69158-03b7-4eef-bed4-f92224017c07'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:13:02.390176 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-bfe69158-03b7-4eef-bed4-f92224017c07 admin admin] The token cache is being invalidate because project 84317714d9774f6baf2830d37a78578a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:13:02.390464 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-bfe69158-03b7-4eef-bed4-f92224017c07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:13:02.391080 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-bfe69158-03b7-4eef-bed4-f92224017c07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:13:02.393142 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1352/2711] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:13:02 2022] DELETE /identity/v3/projects/84317714d9774f6baf2830d37a78578a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:13:02.397996 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e163295-76c2-4dea-9e3a-50fc2036b521 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:13:02.398319 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e163295-76c2-4dea-9e3a-50fc2036b521 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:13:02.398603 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e163295-76c2-4dea-9e3a-50fc2036b521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:13:02.417761 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-4e163295-76c2-4dea-9e3a-50fc2036b521 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:13:02.418970 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-4e163295-76c2-4dea-9e3a-50fc2036b521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:13:02.436434 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:13:02.483811 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1360/2712] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:13:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:13:02.492393 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37613312-0d8e-4d79-a2bb-ebdcb23c1ca1 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:13:02.492685 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37613312-0d8e-4d79-a2bb-ebdcb23c1ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:13:02.492969 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37613312-0d8e-4d79-a2bb-ebdcb23c1ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:13:02.511179 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-37613312-0d8e-4d79-a2bb-ebdcb23c1ca1 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:13:02.512396 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-37613312-0d8e-4d79-a2bb-ebdcb23c1ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:13:02.520850 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1353/2713] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:13:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:13:02.525196 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e163295-76c2-4dea-9e3a-50fc2036b521 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:13:02.535991 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e163295-76c2-4dea-9e3a-50fc2036b521 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:13:02.540660 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f52c9-bd76-4f6b-b1fa-c1bfc286b838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:13:02.541311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f52c9-bd76-4f6b-b1fa-c1bfc286b838 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:13:02.541591 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f52c9-bd76-4f6b-b1fa-c1bfc286b838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:13:02.541888 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f52c9-bd76-4f6b-b1fa-c1bfc286b838 admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:13:02.542615 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256f52c9-bd76-4f6b-b1fa-c1bfc286b838 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:13:02.542921 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256f52c9-bd76-4f6b-b1fa-c1bfc286b838 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:13:02.544550 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256f52c9-bd76-4f6b-b1fa-c1bfc286b838 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:13:02.555940 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1361/2714] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 12:13:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:13:02.560049 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37613312-0d8e-4d79-a2bb-ebdcb23c1ca1 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:13:02.569234 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37613312-0d8e-4d79-a2bb-ebdcb23c1ca1 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:13:02.573913 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1d81e-430c-4622-a95e-fd806910b309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:13:02.574560 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1d81e-430c-4622-a95e-fd806910b309 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:13:02.574842 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1d81e-430c-4622-a95e-fd806910b309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:13:02.575119 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1d81e-430c-4622-a95e-fd806910b309 admin admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:13:02.575843 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f1d81e-430c-4622-a95e-fd806910b309 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:13:02.577746 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f1d81e-430c-4622-a95e-fd806910b309 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:13:02.602988 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1354/2715] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 12:13:02 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:13:02.607149 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f52c9-bd76-4f6b-b1fa-c1bfc286b838 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:13:02.617282 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f52c9-bd76-4f6b-b1fa-c1bfc286b838 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:13:02.673371 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716fb0be-775d-4498-a02a-8c92690f468a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:13:02.674070 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716fb0be-775d-4498-a02a-8c92690f468a admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:13:02.674353 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716fb0be-775d-4498-a02a-8c92690f468a admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:13:02.674624 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716fb0be-775d-4498-a02a-8c92690f468a admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:13:02.675308 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716fb0be-775d-4498-a02a-8c92690f468a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:13:02.677237 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716fb0be-775d-4498-a02a-8c92690f468a admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:13:02.696949 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1362/2716] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 12:13:02 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:13:02.701252 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1d81e-430c-4622-a95e-fd806910b309 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:13:02.713058 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1d81e-430c-4622-a95e-fd806910b309 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:13:02.718252 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05eba1a-c7ab-481f-93cc-86af12800390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:13:02.718992 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05eba1a-c7ab-481f-93cc-86af12800390 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:13:02.719344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05eba1a-c7ab-481f-93cc-86af12800390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:13:02.719743 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05eba1a-c7ab-481f-93cc-86af12800390 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:13:02.721087 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05eba1a-c7ab-481f-93cc-86af12800390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:13:02.722807 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05eba1a-c7ab-481f-93cc-86af12800390 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:13:02.733956 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1355/2717] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:13:02.738058 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716fb0be-775d-4498-a02a-8c92690f468a admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:13:02.748018 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716fb0be-775d-4498-a02a-8c92690f468a admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:13:02.753143 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383191f5-6d95-481b-a80b-3ad8df34985b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:13:02.753788 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383191f5-6d95-481b-a80b-3ad8df34985b admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:13:02.754070 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383191f5-6d95-481b-a80b-3ad8df34985b admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:13:02.754345 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383191f5-6d95-481b-a80b-3ad8df34985b admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:13:02.755061 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383191f5-6d95-481b-a80b-3ad8df34985b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:13:02.756679 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383191f5-6d95-481b-a80b-3ad8df34985b admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:13:02.766437 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1363/2718] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 12:13:02.771194 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05eba1a-c7ab-481f-93cc-86af12800390 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:13:02.781194 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05eba1a-c7ab-481f-93cc-86af12800390 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:13:02.785690 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8c76c-93a6-416b-8390-bab13699d7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:13:02.786552 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8c76c-93a6-416b-8390-bab13699d7c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:13:02.786836 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8c76c-93a6-416b-8390-bab13699d7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:13:02.787108 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8c76c-93a6-416b-8390-bab13699d7c5 admin admin] PATH_INFO: `/v3/projects/2b3e9e81b5924866b87e4060942a7307/users/f91132e529c34b6e8a4eef81a5d5c99f/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:13:02.801364 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b8c76c-93a6-416b-8390-bab13699d7c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b3e9e81b5924866b87e4060942a7307, user_id=f91132e529c34b6e8a4eef81a5d5c99f, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:13:02.804028 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b8c76c-93a6-416b-8390-bab13699d7c5 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:13:02.819867 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1356/2719] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:13:02 2022] PUT /identity/v3/projects/2b3e9e81b5924866b87e4060942a7307/users/f91132e529c34b6e8a4eef81a5d5c99f/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 12:13:02.832034 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63f87d-bf0f-4cae-b368-9d9175c88736 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:13:02.832328 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63f87d-bf0f-4cae-b368-9d9175c88736 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:13:02.832617 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63f87d-bf0f-4cae-b368-9d9175c88736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:13:02.859259 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-bf63f87d-bf0f-4cae-b368-9d9175c88736 None None] MFA Rules not processed for user `f91132e529c34b6e8a4eef81a5d5c99f`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:13:02.860533 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-bf63f87d-bf0f-4cae-b368-9d9175c88736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:13:02.927936 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1364/2720] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:13:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:13:02.940221 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8c76c-93a6-416b-8390-bab13699d7c5 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:13:02.942022 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-a0b8c76c-93a6-416b-8390-bab13699d7c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:13:02.963917 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:13:02.998896 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8c76c-93a6-416b-8390-bab13699d7c5 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:13:03.003029 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93cc267-7d32-4f2c-9162-bd7fcdee4b3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:13:03.003704 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cc267-7d32-4f2c-9162-bd7fcdee4b3f service cinder] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:13:03.003989 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cc267-7d32-4f2c-9162-bd7fcdee4b3f service cinder] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:13:03.004266 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cc267-7d32-4f2c-9162-bd7fcdee4b3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:13:03.012866 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93cc267-7d32-4f2c-9162-bd7fcdee4b3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:13:03.014298 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93cc267-7d32-4f2c-9162-bd7fcdee4b3f service cinder] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:13:03.023848 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1357/2721] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:13:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:13:03.047577 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63f87d-bf0f-4cae-b368-9d9175c88736 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:13:03.066996 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:13:03.111316 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63f87d-bf0f-4cae-b368-9d9175c88736 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:13:03.115962 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c144a56-4f5e-4172-a065-e2b4de0ee71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:13:03.116824 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c144a56-4f5e-4172-a065-e2b4de0ee71b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:13:03.117115 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c144a56-4f5e-4172-a065-e2b4de0ee71b admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:13:03.117392 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c144a56-4f5e-4172-a065-e2b4de0ee71b admin admin] PATH_INFO: `/v3/users/f91132e529c34b6e8a4eef81a5d5c99f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:13:03.118593 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c144a56-4f5e-4172-a065-e2b4de0ee71b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f91132e529c34b6e8a4eef81a5d5c99f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:13:03.120580 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c144a56-4f5e-4172-a065-e2b4de0ee71b admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:13:03.166123 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-0c144a56-4f5e-4172-a065-e2b4de0ee71b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f91132e529c34b6e8a4eef81a5d5c99f'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:13:03.172985 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-0c144a56-4f5e-4172-a065-e2b4de0ee71b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f91132e529c34b6e8a4eef81a5d5c99f'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:13:03.174177 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-0c144a56-4f5e-4172-a065-e2b4de0ee71b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f91132e529c34b6e8a4eef81a5d5c99f'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:13:03.185844 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-0c144a56-4f5e-4172-a065-e2b4de0ee71b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f91132e529c34b6e8a4eef81a5d5c99f'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:13:03.192921 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-0c144a56-4f5e-4172-a065-e2b4de0ee71b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f91132e529c34b6e8a4eef81a5d5c99f'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:13:03.199102 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1365/2722] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:13:03 2022] DELETE /identity/v3/users/f91132e529c34b6e8a4eef81a5d5c99f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:13:03.203714 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06168144-8f7e-4422-84ea-5c4765f572e7 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:13:03.204008 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06168144-8f7e-4422-84ea-5c4765f572e7 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:13:03.204291 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06168144-8f7e-4422-84ea-5c4765f572e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:13:03.221094 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-06168144-8f7e-4422-84ea-5c4765f572e7 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:13:03.222495 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-06168144-8f7e-4422-84ea-5c4765f572e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:13:03.279584 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1358/2723] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:13:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:13:03.289218 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c144a56-4f5e-4172-a065-e2b4de0ee71b admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:13:03.290614 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-0c144a56-4f5e-4172-a065-e2b4de0ee71b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:13:03.347977 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c144a56-4f5e-4172-a065-e2b4de0ee71b admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:13:03.351666 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd00c3c-6aaa-4167-b36c-1fbafa80c50d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:13:03.352309 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd00c3c-6aaa-4167-b36c-1fbafa80c50d service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:13:03.352595 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd00c3c-6aaa-4167-b36c-1fbafa80c50d service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:13:03.352876 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd00c3c-6aaa-4167-b36c-1fbafa80c50d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:13:03.362479 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd00c3c-6aaa-4167-b36c-1fbafa80c50d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:13:03.363973 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd00c3c-6aaa-4167-b36c-1fbafa80c50d service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:13:03.374432 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1366/2724] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:13:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:13:03.638873 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06168144-8f7e-4422-84ea-5c4765f572e7 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:13:03.640784 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-06168144-8f7e-4422-84ea-5c4765f572e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:13:03.661898 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06168144-8f7e-4422-84ea-5c4765f572e7 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:13:03.666918 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d7bd3-83f3-497c-bed1-0c3220ae1937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:13:03.667797 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d7bd3-83f3-497c-bed1-0c3220ae1937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:13:03.668185 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d7bd3-83f3-497c-bed1-0c3220ae1937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:13:03.668337 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d7bd3-83f3-497c-bed1-0c3220ae1937 admin admin] PATH_INFO: `/v3/projects/2b3e9e81b5924866b87e4060942a7307` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:13:03.669594 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d7bd3-83f3-497c-bed1-0c3220ae1937 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b3e9e81b5924866b87e4060942a7307)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:13:03.671524 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d7bd3-83f3-497c-bed1-0c3220ae1937 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:13:03.718960 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-924d7bd3-83f3-497c-bed1-0c3220ae1937 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b3e9e81b5924866b87e4060942a7307', 'request_id': 'req-924d7bd3-83f3-497c-bed1-0c3220ae1937'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:13:03.725646 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-924d7bd3-83f3-497c-bed1-0c3220ae1937 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b3e9e81b5924866b87e4060942a7307', 'request_id': 'req-924d7bd3-83f3-497c-bed1-0c3220ae1937'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:13:03.733097 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-924d7bd3-83f3-497c-bed1-0c3220ae1937 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b3e9e81b5924866b87e4060942a7307', 'request_id': 'req-924d7bd3-83f3-497c-bed1-0c3220ae1937'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:13:03.744682 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-924d7bd3-83f3-497c-bed1-0c3220ae1937 admin admin] The token cache is being invalidate because project 2b3e9e81b5924866b87e4060942a7307 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:13:03.744969 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-924d7bd3-83f3-497c-bed1-0c3220ae1937 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:13:03.745591 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-924d7bd3-83f3-497c-bed1-0c3220ae1937 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:13:03.747138 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1359/2725] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:13:03 2022] DELETE /identity/v3/projects/2b3e9e81b5924866b87e4060942a7307 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:13:03.751998 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca84bb-bb3e-44cd-a33a-5c103509e76d None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:13:03.752494 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca84bb-bb3e-44cd-a33a-5c103509e76d None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:13:03.752601 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca84bb-bb3e-44cd-a33a-5c103509e76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:13:03.771310 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-90ca84bb-bb3e-44cd-a33a-5c103509e76d None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:13:03.772541 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-90ca84bb-bb3e-44cd-a33a-5c103509e76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:13:03.805677 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:13:03.833006 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1367/2726] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:13:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 12:13:03.840718 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecb65f-3557-46c7-960f-6947af393056 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:13:03.841012 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecb65f-3557-46c7-960f-6947af393056 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:13:03.841296 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecb65f-3557-46c7-960f-6947af393056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:13:03.860268 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-37ecb65f-3557-46c7-960f-6947af393056 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:13:03.862298 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-37ecb65f-3557-46c7-960f-6947af393056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:13:03.870372 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1360/2727] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:13:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:13:03.874528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca84bb-bb3e-44cd-a33a-5c103509e76d None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:13:03.884479 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca84bb-bb3e-44cd-a33a-5c103509e76d None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:13:03.889158 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5a11d-0d55-4487-8794-01e52c8ed248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:13:03.889807 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5a11d-0d55-4487-8794-01e52c8ed248 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:13:03.890092 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5a11d-0d55-4487-8794-01e52c8ed248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:13:03.890371 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5a11d-0d55-4487-8794-01e52c8ed248 admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:13:03.891100 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc5a11d-0d55-4487-8794-01e52c8ed248 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:13:03.891426 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc5a11d-0d55-4487-8794-01e52c8ed248 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:13:03.893563 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc5a11d-0d55-4487-8794-01e52c8ed248 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:13:03.908912 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1368/2728] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 12:13:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:13:03.913153 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ecb65f-3557-46c7-960f-6947af393056 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:13:03.922547 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ecb65f-3557-46c7-960f-6947af393056 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:13:03.927241 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd192ad-b4b2-4236-b238-3ddb2a2e2ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:13:03.927940 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd192ad-b4b2-4236-b238-3ddb2a2e2ad0 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:13:03.928222 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd192ad-b4b2-4236-b238-3ddb2a2e2ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:13:03.928496 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd192ad-b4b2-4236-b238-3ddb2a2e2ad0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:13:03.929220 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd192ad-b4b2-4236-b238-3ddb2a2e2ad0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:13:03.931123 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd192ad-b4b2-4236-b238-3ddb2a2e2ad0 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:13:03.956543 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1361/2729] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 12:13:03 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 12:13:03.961030 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5a11d-0d55-4487-8794-01e52c8ed248 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:13:03.971677 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5a11d-0d55-4487-8794-01e52c8ed248 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:13:04.027536 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25183e2-c572-4cdd-8ea5-811e2f4f6314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:13:04.028194 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25183e2-c572-4cdd-8ea5-811e2f4f6314 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:13:04.028478 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25183e2-c572-4cdd-8ea5-811e2f4f6314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:13:04.028750 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25183e2-c572-4cdd-8ea5-811e2f4f6314 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:13:04.029441 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25183e2-c572-4cdd-8ea5-811e2f4f6314 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:13:04.031349 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25183e2-c572-4cdd-8ea5-811e2f4f6314 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:13:04.052738 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1369/2730] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 12:13:03 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:13:04.057017 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd192ad-b4b2-4236-b238-3ddb2a2e2ad0 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:13:04.067199 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd192ad-b4b2-4236-b238-3ddb2a2e2ad0 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:13:04.071998 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1f0746-6110-4862-8525-2c205bb895a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:13:04.072793 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f0746-6110-4862-8525-2c205bb895a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:13:04.073084 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f0746-6110-4862-8525-2c205bb895a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:13:04.073364 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f0746-6110-4862-8525-2c205bb895a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:13:04.074096 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1f0746-6110-4862-8525-2c205bb895a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:13:04.075755 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1f0746-6110-4862-8525-2c205bb895a2 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:13:04.087899 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1362/2731] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:13:04.091738 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25183e2-c572-4cdd-8ea5-811e2f4f6314 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:13:04.102337 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25183e2-c572-4cdd-8ea5-811e2f4f6314 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:13:04.106930 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6d0ed-e58f-4d52-ac16-85988b8f20ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:13:04.107543 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6d0ed-e58f-4d52-ac16-85988b8f20ea admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:13:04.107829 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6d0ed-e58f-4d52-ac16-85988b8f20ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:13:04.108107 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6d0ed-e58f-4d52-ac16-85988b8f20ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:13:04.108820 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c6d0ed-e58f-4d52-ac16-85988b8f20ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:13:04.110388 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c6d0ed-e58f-4d52-ac16-85988b8f20ea admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:13:04.120121 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1370/2732] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:13:04.124090 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1f0746-6110-4862-8525-2c205bb895a2 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:13:04.133971 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1f0746-6110-4862-8525-2c205bb895a2 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:13:04.138546 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d16e54-b737-49ae-8749-fe13e056603e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:13:04.139421 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d16e54-b737-49ae-8749-fe13e056603e admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:13:04.139733 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d16e54-b737-49ae-8749-fe13e056603e admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:13:04.140005 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d16e54-b737-49ae-8749-fe13e056603e admin admin] PATH_INFO: `/v3/projects/4aec940c9f514bd9923ad6d815618e44/users/4c59e1a01e9d4e3da0ea941b97cdab2c/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:13:04.142740 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:13:04.157400 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d16e54-b737-49ae-8749-fe13e056603e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aec940c9f514bd9923ad6d815618e44, user_id=4c59e1a01e9d4e3da0ea941b97cdab2c, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:13:04.160700 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d16e54-b737-49ae-8749-fe13e056603e admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:13:04.173485 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1363/2733] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:13:04 2022] PUT /identity/v3/projects/4aec940c9f514bd9923ad6d815618e44/users/4c59e1a01e9d4e3da0ea941b97cdab2c/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:13:04.178548 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841af95-4e90-447a-b636-679c315bfe9c None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:13:04.178840 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841af95-4e90-447a-b636-679c315bfe9c None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:13:04.179117 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841af95-4e90-447a-b636-679c315bfe9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:13:04.196599 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-b841af95-4e90-447a-b636-679c315bfe9c None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:13:04.197781 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-b841af95-4e90-447a-b636-679c315bfe9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:13:04.263124 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1371/2734] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:13:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:13:04.273728 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d16e54-b737-49ae-8749-fe13e056603e admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:13:04.275740 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-81d16e54-b737-49ae-8749-fe13e056603e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:13:04.332786 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d16e54-b737-49ae-8749-fe13e056603e admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:13:04.336509 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f73485-4a96-4015-8eb7-5883ccabe624 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:13:04.337151 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f73485-4a96-4015-8eb7-5883ccabe624 service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:13:04.337438 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f73485-4a96-4015-8eb7-5883ccabe624 service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:13:04.337712 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f73485-4a96-4015-8eb7-5883ccabe624 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:13:04.346741 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f73485-4a96-4015-8eb7-5883ccabe624 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:13:04.348151 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f73485-4a96-4015-8eb7-5883ccabe624 service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:13:04.357434 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1364/2735] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:13:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:13:04.981928 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c71891-8a85-45c9-be8d-a086938eacfe None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:13:04.982479 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c71891-8a85-45c9-be8d-a086938eacfe None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:13:04.982479 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c71891-8a85-45c9-be8d-a086938eacfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:13:05.010284 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-83c71891-8a85-45c9-be8d-a086938eacfe None None] MFA Rules not processed for user `4c59e1a01e9d4e3da0ea941b97cdab2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:13:05.011707 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-83c71891-8a85-45c9-be8d-a086938eacfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:13:05.047618 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:13:05.080584 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1372/2736] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:13:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:13:05.091616 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f73485-4a96-4015-8eb7-5883ccabe624 service neutron] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:13:05.093115 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-50f73485-4a96-4015-8eb7-5883ccabe624 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:13:05.153221 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f73485-4a96-4015-8eb7-5883ccabe624 service neutron] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:13:05.157268 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230b021-82c6-4460-b37f-89813a997d65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:13:05.158667 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230b021-82c6-4460-b37f-89813a997d65 service cinder] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:13:05.158952 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230b021-82c6-4460-b37f-89813a997d65 service cinder] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:13:05.159264 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230b021-82c6-4460-b37f-89813a997d65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:13:05.169284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6230b021-82c6-4460-b37f-89813a997d65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:13:05.170737 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6230b021-82c6-4460-b37f-89813a997d65 service cinder] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:13:05.180956 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1365/2737] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:13:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:13:06.521124 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7b949-2671-401f-bc8b-b1f29ba23265 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:13:06.521649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7b949-2671-401f-bc8b-b1f29ba23265 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:13:06.521768 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7b949-2671-401f-bc8b-b1f29ba23265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:13:06.540355 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-8ef7b949-2671-401f-bc8b-b1f29ba23265 None None] MFA Rules not processed for user `4c59e1a01e9d4e3da0ea941b97cdab2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:13:06.541542 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-8ef7b949-2671-401f-bc8b-b1f29ba23265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:13:06.548435 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1373/2738] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:13:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:13:15.176709 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=59,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:13:16.535273 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=14 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:13:17.035866 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230b021-82c6-4460-b37f-89813a997d65 service cinder] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:13:17.037406 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-6230b021-82c6-4460-b37f-89813a997d65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:13:17.137192 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230b021-82c6-4460-b37f-89813a997d65 service cinder] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:13:17.142618 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807db6b5-a797-4215-acd3-07359f9039c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:13:17.143264 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807db6b5-a797-4215-acd3-07359f9039c7 service nova] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:13:17.144121 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807db6b5-a797-4215-acd3-07359f9039c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:13:17.144412 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807db6b5-a797-4215-acd3-07359f9039c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:13:17.146180 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-807db6b5-a797-4215-acd3-07359f9039c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:13:17.204223 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807db6b5-a797-4215-acd3-07359f9039c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:13:17.205614 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807db6b5-a797-4215-acd3-07359f9039c7 service nova] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:13:17.215627 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1366/2739] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:13:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:13:27.211492 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=68 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:13:34.545272 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6e392-8298-4c86-8b35-98bd091ef9c4 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:13:34.545828 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6e392-8298-4c86-8b35-98bd091ef9c4 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:13:34.545947 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6e392-8298-4c86-8b35-98bd091ef9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:13:34.563773 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-39e6e392-8298-4c86-8b35-98bd091ef9c4 None None] MFA Rules not processed for user `0c93102a757d4a2cbf7f515c4b67db2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:13:34.564956 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-39e6e392-8298-4c86-8b35-98bd091ef9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:13:34.572216 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1374/2740] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:13:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:13:44.558620 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:13:47.067609 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807db6b5-a797-4215-acd3-07359f9039c7 service nova] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:13:47.069906 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-807db6b5-a797-4215-acd3-07359f9039c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:13:47.086870 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807db6b5-a797-4215-acd3-07359f9039c7 service nova] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:13:47.095136 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ef70d-d8ac-4172-8676-b7465c1bdb8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:13:47.096005 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ef70d-d8ac-4172-8676-b7465c1bdb8e service nova] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:13:47.096331 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ef70d-d8ac-4172-8676-b7465c1bdb8e service nova] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:13:47.096675 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ef70d-d8ac-4172-8676-b7465c1bdb8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:13:47.098829 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-064ef70d-d8ac-4172-8676-b7465c1bdb8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:13:47.116987 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ef70d-d8ac-4172-8676-b7465c1bdb8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:13:47.119025 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ef70d-d8ac-4172-8676-b7465c1bdb8e service nova] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:13:47.133598 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1367/2741] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:13:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 12:13:57.126993 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=6 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:14:10.733966 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6e392-8298-4c86-8b35-98bd091ef9c4 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:14:10.735364 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-39e6e392-8298-4c86-8b35-98bd091ef9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:14:10.747711 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6e392-8298-4c86-8b35-98bd091ef9c4 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:14:10.751162 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48af1ab-fcb6-4159-bca1-d8c98ef437b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:14:10.751815 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48af1ab-fcb6-4159-bca1-d8c98ef437b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:14:10.752096 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48af1ab-fcb6-4159-bca1-d8c98ef437b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:14:10.752367 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48af1ab-fcb6-4159-bca1-d8c98ef437b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:14:10.754033 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-f48af1ab-fcb6-4159-bca1-d8c98ef437b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:14:10.768131 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48af1ab-fcb6-4159-bca1-d8c98ef437b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:14:10.769551 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48af1ab-fcb6-4159-bca1-d8c98ef437b9 service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:14:10.780706 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1375/2742] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:14:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:14:14.420100 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ef70d-d8ac-4172-8676-b7465c1bdb8e service nova] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:14:14.431733 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ef70d-d8ac-4172-8676-b7465c1bdb8e service nova] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:14:14.435299 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf86ea-2398-41dd-a4d4-1a194d5e76f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:14:14.435975 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf86ea-2398-41dd-a4d4-1a194d5e76f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:14:14.436259 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf86ea-2398-41dd-a4d4-1a194d5e76f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:14:14.436533 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf86ea-2398-41dd-a4d4-1a194d5e76f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:14:14.438301 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-bdcf86ea-2398-41dd-a4d4-1a194d5e76f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:14:14.451380 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf86ea-2398-41dd-a4d4-1a194d5e76f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:14:14.452828 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf86ea-2398-41dd-a4d4-1a194d5e76f1 service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:14:14.464156 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1368/2743] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:14:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 12:14:16.380030 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48af1ab-fcb6-4159-bca1-d8c98ef437b9 service cinder] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:14:16.392024 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48af1ab-fcb6-4159-bca1-d8c98ef437b9 service cinder] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:14:16.397863 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488dc52d-0e25-41d7-919a-c2f01032fbeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:14:16.398532 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488dc52d-0e25-41d7-919a-c2f01032fbeb service nova] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:14:16.398817 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488dc52d-0e25-41d7-919a-c2f01032fbeb service nova] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:14:16.399093 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488dc52d-0e25-41d7-919a-c2f01032fbeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:14:16.401267 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-488dc52d-0e25-41d7-919a-c2f01032fbeb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:14:16.415076 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488dc52d-0e25-41d7-919a-c2f01032fbeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:14:16.417018 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488dc52d-0e25-41d7-919a-c2f01032fbeb service nova] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:14:16.427996 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1376/2744] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:14:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:14:24.458717 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=6 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:14:26.423399 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=12 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:14:30.744199 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ff667-a345-4f70-9f35-25e2c666cc95 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:14:30.744713 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ff667-a345-4f70-9f35-25e2c666cc95 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:14:30.744817 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ff667-a345-4f70-9f35-25e2c666cc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:14:30.761973 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-627ff667-a345-4f70-9f35-25e2c666cc95 None None] MFA Rules not processed for user `4c59e1a01e9d4e3da0ea941b97cdab2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:14:30.763194 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-627ff667-a345-4f70-9f35-25e2c666cc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:14:30.770003 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1369/2745] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:14:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:14:31.303630 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488dc52d-0e25-41d7-919a-c2f01032fbeb service nova] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:14:31.305796 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-488dc52d-0e25-41d7-919a-c2f01032fbeb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:14:31.387382 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488dc52d-0e25-41d7-919a-c2f01032fbeb service nova] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:14:31.392640 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee7323-a5ad-4d1f-844f-7aa5e42e90dd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5a91437dd64e2491ce41b4d12d4835', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:14:31.393318 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee7323-a5ad-4d1f-844f-7aa5e42e90dd service placement] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:14:31.393604 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee7323-a5ad-4d1f-844f-7aa5e42e90dd service placement] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:14:31.393883 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee7323-a5ad-4d1f-844f-7aa5e42e90dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:14:31.395797 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-39ee7323-a5ad-4d1f-844f-7aa5e42e90dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:14:31.408821 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee7323-a5ad-4d1f-844f-7aa5e42e90dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:14:31.410443 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee7323-a5ad-4d1f-844f-7aa5e42e90dd service placement] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:14:31.421816 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1377/2746] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:14:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:14:33.078055 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627ff667-a345-4f70-9f35-25e2c666cc95 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:14:33.087809 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627ff667-a345-4f70-9f35-25e2c666cc95 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:14:33.091330 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e721c7-1eb0-408a-8ec1-9d14afdfc26f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:14:33.092004 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e721c7-1eb0-408a-8ec1-9d14afdfc26f service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:14:33.092284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e721c7-1eb0-408a-8ec1-9d14afdfc26f service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:14:33.092554 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e721c7-1eb0-408a-8ec1-9d14afdfc26f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:14:33.094415 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-a7e721c7-1eb0-408a-8ec1-9d14afdfc26f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:14:33.104499 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e721c7-1eb0-408a-8ec1-9d14afdfc26f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:14:33.105917 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e721c7-1eb0-408a-8ec1-9d14afdfc26f service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:14:33.113898 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1370/2747] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:14:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:14:39.819554 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee7323-a5ad-4d1f-844f-7aa5e42e90dd service placement] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:14:39.834625 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee7323-a5ad-4d1f-844f-7aa5e42e90dd service placement] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:14:39.840850 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf067d8b-6df0-4f12-ade5-a5519dbb44da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:14:39.841489 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf067d8b-6df0-4f12-ade5-a5519dbb44da service nova] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:14:39.841791 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf067d8b-6df0-4f12-ade5-a5519dbb44da service nova] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:14:39.842050 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf067d8b-6df0-4f12-ade5-a5519dbb44da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:14:39.843881 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-bf067d8b-6df0-4f12-ade5-a5519dbb44da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:14:39.856603 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf067d8b-6df0-4f12-ade5-a5519dbb44da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:14:39.858170 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf067d8b-6df0-4f12-ade5-a5519dbb44da service nova] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:14:39.869022 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1378/2748] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:14:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:14:43.110247 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=9 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:14:49.865367 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=38 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:15:35.358165 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e721c7-1eb0-408a-8ec1-9d14afdfc26f service neutron] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:15:35.369841 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e721c7-1eb0-408a-8ec1-9d14afdfc26f service neutron] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:15:35.374889 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd576988-d176-4227-88b6-1cc9e330b6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:15:35.375893 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd576988-d176-4227-88b6-1cc9e330b6d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:15:35.376251 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd576988-d176-4227-88b6-1cc9e330b6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:15:35.376599 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd576988-d176-4227-88b6-1cc9e330b6d1 admin admin] PATH_INFO: `/v3/users/4c59e1a01e9d4e3da0ea941b97cdab2c` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:15:35.378839 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd576988-d176-4227-88b6-1cc9e330b6d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c59e1a01e9d4e3da0ea941b97cdab2c)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:15:35.380985 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd576988-d176-4227-88b6-1cc9e330b6d1 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:15:35.433335 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-dd576988-d176-4227-88b6-1cc9e330b6d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c59e1a01e9d4e3da0ea941b97cdab2c'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:15:35.434011 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-dd576988-d176-4227-88b6-1cc9e330b6d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c59e1a01e9d4e3da0ea941b97cdab2c'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:15:35.447174 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-dd576988-d176-4227-88b6-1cc9e330b6d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c59e1a01e9d4e3da0ea941b97cdab2c'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:15:35.454253 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-dd576988-d176-4227-88b6-1cc9e330b6d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c59e1a01e9d4e3da0ea941b97cdab2c'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:15:35.462777 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-dd576988-d176-4227-88b6-1cc9e330b6d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c59e1a01e9d4e3da0ea941b97cdab2c'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:15:35.469490 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1371/2749] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:15:35 2022] DELETE /identity/v3/users/4c59e1a01e9d4e3da0ea941b97cdab2c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:15:35.652949 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf067d8b-6df0-4f12-ade5-a5519dbb44da service nova] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:15:35.665194 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf067d8b-6df0-4f12-ade5-a5519dbb44da service nova] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:15:35.727489 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b0051-6c00-49d7-980d-567d3c81b2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:15:35.728567 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b0051-6c00-49d7-980d-567d3c81b2a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:15:35.728695 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b0051-6c00-49d7-980d-567d3c81b2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:15:35.728933 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b0051-6c00-49d7-980d-567d3c81b2a2 admin admin] PATH_INFO: `/v3/projects/4aec940c9f514bd9923ad6d815618e44` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:15:35.730133 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3b0051-6c00-49d7-980d-567d3c81b2a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4aec940c9f514bd9923ad6d815618e44)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:15:35.732075 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3b0051-6c00-49d7-980d-567d3c81b2a2 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:15:35.779876 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-be3b0051-6c00-49d7-980d-567d3c81b2a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4aec940c9f514bd9923ad6d815618e44', 'request_id': 'req-be3b0051-6c00-49d7-980d-567d3c81b2a2'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:15:35.785922 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-be3b0051-6c00-49d7-980d-567d3c81b2a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4aec940c9f514bd9923ad6d815618e44', 'request_id': 'req-be3b0051-6c00-49d7-980d-567d3c81b2a2'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:15:35.792783 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-be3b0051-6c00-49d7-980d-567d3c81b2a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4aec940c9f514bd9923ad6d815618e44', 'request_id': 'req-be3b0051-6c00-49d7-980d-567d3c81b2a2'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:15:35.804683 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-be3b0051-6c00-49d7-980d-567d3c81b2a2 admin admin] The token cache is being invalidate because project 4aec940c9f514bd9923ad6d815618e44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:15:35.804955 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-be3b0051-6c00-49d7-980d-567d3c81b2a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:15:35.805577 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-be3b0051-6c00-49d7-980d-567d3c81b2a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:15:35.807102 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1379/2750] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:15:35 2022] DELETE /identity/v3/projects/4aec940c9f514bd9923ad6d815618e44 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:15:35.812148 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45d3a8-4541-4d60-a1fe-d9a184272ec1 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:15:35.812441 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45d3a8-4541-4d60-a1fe-d9a184272ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:15:35.812722 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45d3a8-4541-4d60-a1fe-d9a184272ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:15:35.831693 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-be45d3a8-4541-4d60-a1fe-d9a184272ec1 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:15:35.833031 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-be45d3a8-4541-4d60-a1fe-d9a184272ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:15:35.895882 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1372/2751] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:15:35.904868 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3528387-0db3-4769-a74c-08ffed69b4a7 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:15:35.905177 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3528387-0db3-4769-a74c-08ffed69b4a7 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:15:35.905452 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3528387-0db3-4769-a74c-08ffed69b4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:15:35.926002 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-c3528387-0db3-4769-a74c-08ffed69b4a7 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:15:35.927223 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-c3528387-0db3-4769-a74c-08ffed69b4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:15:35.935236 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1380/2752] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:15:35.940118 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be45d3a8-4541-4d60-a1fe-d9a184272ec1 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:15:35.949930 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be45d3a8-4541-4d60-a1fe-d9a184272ec1 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:15:35.954565 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da3c45-213a-4a05-9cd1-2da54b05f106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:15:35.955322 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da3c45-213a-4a05-9cd1-2da54b05f106 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:15:35.955640 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da3c45-213a-4a05-9cd1-2da54b05f106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:15:35.955917 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da3c45-213a-4a05-9cd1-2da54b05f106 admin admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:15:35.956651 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da3c45-213a-4a05-9cd1-2da54b05f106 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:15:35.956955 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da3c45-213a-4a05-9cd1-2da54b05f106 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:15:35.958557 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da3c45-213a-4a05-9cd1-2da54b05f106 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:15:35.971338 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1373/2753] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 12:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:15:35.975709 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3528387-0db3-4769-a74c-08ffed69b4a7 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:15:35.985104 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3528387-0db3-4769-a74c-08ffed69b4a7 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:15:35.990387 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f7bf4-d8d8-42a8-bfec-642067db9120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:15:35.991116 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f7bf4-d8d8-42a8-bfec-642067db9120 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:15:35.991484 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f7bf4-d8d8-42a8-bfec-642067db9120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:15:35.991889 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f7bf4-d8d8-42a8-bfec-642067db9120 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:15:35.992640 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0f7bf4-d8d8-42a8-bfec-642067db9120 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:15:35.994619 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0f7bf4-d8d8-42a8-bfec-642067db9120 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:15:36.025244 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1381/2754] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 12:15:35 2022] POST /identity/v3/projects => generated 391 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:15:36.026897 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da3c45-213a-4a05-9cd1-2da54b05f106 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:15:36.038015 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da3c45-213a-4a05-9cd1-2da54b05f106 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:15:36.097522 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5023e26-4a2a-441b-b92f-431503418dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:15:36.098210 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5023e26-4a2a-441b-b92f-431503418dcc admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:15:36.098497 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5023e26-4a2a-441b-b92f-431503418dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:15:36.098776 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5023e26-4a2a-441b-b92f-431503418dcc admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:15:36.099467 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5023e26-4a2a-441b-b92f-431503418dcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:15:36.101571 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5023e26-4a2a-441b-b92f-431503418dcc admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:15:36.108408 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:15:36.126559 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1374/2755] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 12:15:36 2022] POST /identity/v3/users => generated 296 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:15:36.130947 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f7bf4-d8d8-42a8-bfec-642067db9120 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:15:36.141414 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f7bf4-d8d8-42a8-bfec-642067db9120 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:15:36.146683 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509b439-ba51-4eb3-9b93-587bfeba7504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:15:36.147441 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509b439-ba51-4eb3-9b93-587bfeba7504 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:15:36.147632 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509b439-ba51-4eb3-9b93-587bfeba7504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:15:36.147939 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509b439-ba51-4eb3-9b93-587bfeba7504 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:15:36.148772 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8509b439-ba51-4eb3-9b93-587bfeba7504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:15:36.150254 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8509b439-ba51-4eb3-9b93-587bfeba7504 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:15:36.161492 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1382/2756] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:15:36.165575 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5023e26-4a2a-441b-b92f-431503418dcc admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:15:36.175976 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5023e26-4a2a-441b-b92f-431503418dcc admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:15:36.180900 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba53d4f-00ca-4148-82f3-824fc303026b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:15:36.181560 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba53d4f-00ca-4148-82f3-824fc303026b admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:15:36.181844 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba53d4f-00ca-4148-82f3-824fc303026b admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:15:36.182125 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba53d4f-00ca-4148-82f3-824fc303026b admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:15:36.182852 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba53d4f-00ca-4148-82f3-824fc303026b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:15:36.184517 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba53d4f-00ca-4148-82f3-824fc303026b admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:15:36.195616 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1375/2757] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:15:36.199795 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509b439-ba51-4eb3-9b93-587bfeba7504 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:15:36.210905 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509b439-ba51-4eb3-9b93-587bfeba7504 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:15:36.216601 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca8fec-4fd6-4e29-bc56-4613f60e5e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:15:36.217515 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca8fec-4fd6-4e29-bc56-4613f60e5e41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:15:36.217796 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca8fec-4fd6-4e29-bc56-4613f60e5e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:15:36.218191 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca8fec-4fd6-4e29-bc56-4613f60e5e41 admin admin] PATH_INFO: `/v3/projects/eb569c5656924e9c888d8a5cdd0e2191/users/e48b66b479084e68ad60d15e7236920e/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:15:36.234208 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ca8fec-4fd6-4e29-bc56-4613f60e5e41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb569c5656924e9c888d8a5cdd0e2191, user_id=e48b66b479084e68ad60d15e7236920e, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:15:36.236886 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ca8fec-4fd6-4e29-bc56-4613f60e5e41 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:15:36.257785 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1383/2758] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:15:36 2022] PUT /identity/v3/projects/eb569c5656924e9c888d8a5cdd0e2191/users/e48b66b479084e68ad60d15e7236920e/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:15:36.267471 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305f1cf-39f6-45fe-975b-dbe29d26d365 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:15:36.268395 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305f1cf-39f6-45fe-975b-dbe29d26d365 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:15:36.268681 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305f1cf-39f6-45fe-975b-dbe29d26d365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:15:36.295952 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-6305f1cf-39f6-45fe-975b-dbe29d26d365 None None] MFA Rules not processed for user `e48b66b479084e68ad60d15e7236920e`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:15:36.297176 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-6305f1cf-39f6-45fe-975b-dbe29d26d365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:15:36.370992 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1376/2759] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:15:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:15:36.385262 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca8fec-4fd6-4e29-bc56-4613f60e5e41 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:15:36.385667 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-58ca8fec-4fd6-4e29-bc56-4613f60e5e41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:15:36.417075 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:15:36.451395 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca8fec-4fd6-4e29-bc56-4613f60e5e41 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:15:36.455823 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d33d46d-a781-4059-a1ea-dd8f689bcc47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:15:36.456474 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33d46d-a781-4059-a1ea-dd8f689bcc47 service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:15:36.456762 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33d46d-a781-4059-a1ea-dd8f689bcc47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:15:36.457069 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33d46d-a781-4059-a1ea-dd8f689bcc47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:15:36.465876 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d33d46d-a781-4059-a1ea-dd8f689bcc47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:15:36.467355 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d33d46d-a781-4059-a1ea-dd8f689bcc47 service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:15:36.477905 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1384/2760] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:15:36 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:15:37.726741 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305f1cf-39f6-45fe-975b-dbe29d26d365 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:15:37.728243 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-6305f1cf-39f6-45fe-975b-dbe29d26d365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:15:37.787730 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305f1cf-39f6-45fe-975b-dbe29d26d365 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:15:37.791228 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7acb1e6-d3eb-4dde-b5f7-e7b327031c66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:15:37.791915 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7acb1e6-d3eb-4dde-b5f7-e7b327031c66 service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:15:37.792406 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7acb1e6-d3eb-4dde-b5f7-e7b327031c66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:15:37.792527 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7acb1e6-d3eb-4dde-b5f7-e7b327031c66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:15:37.794329 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-e7acb1e6-d3eb-4dde-b5f7-e7b327031c66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:15:37.861544 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7acb1e6-d3eb-4dde-b5f7-e7b327031c66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:15:37.863127 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7acb1e6-d3eb-4dde-b5f7-e7b327031c66 service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:15:37.872920 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1377/2761] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:15:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:15:44.146152 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d33d46d-a781-4059-a1ea-dd8f689bcc47 service cinder] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:15:44.148614 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-4d33d46d-a781-4059-a1ea-dd8f689bcc47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:15:44.170989 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d33d46d-a781-4059-a1ea-dd8f689bcc47 service cinder] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:15:44.175650 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ef5e9-6176-4a81-b5de-552be65b1141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:15:44.176516 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ef5e9-6176-4a81-b5de-552be65b1141 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:15:44.176801 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ef5e9-6176-4a81-b5de-552be65b1141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:15:44.177079 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ef5e9-6176-4a81-b5de-552be65b1141 admin admin] PATH_INFO: `/v3/users/79c5b9ec7d2248918e884cd01adb84c6` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:15:44.178265 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9ef5e9-6176-4a81-b5de-552be65b1141 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79c5b9ec7d2248918e884cd01adb84c6)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:15:44.180228 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9ef5e9-6176-4a81-b5de-552be65b1141 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:15:44.227043 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-6a9ef5e9-6176-4a81-b5de-552be65b1141 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79c5b9ec7d2248918e884cd01adb84c6'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:15:44.234792 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-6a9ef5e9-6176-4a81-b5de-552be65b1141 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79c5b9ec7d2248918e884cd01adb84c6'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:15:44.235803 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-6a9ef5e9-6176-4a81-b5de-552be65b1141 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79c5b9ec7d2248918e884cd01adb84c6'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:15:44.249947 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-6a9ef5e9-6176-4a81-b5de-552be65b1141 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79c5b9ec7d2248918e884cd01adb84c6'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:15:44.257492 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-6a9ef5e9-6176-4a81-b5de-552be65b1141 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79c5b9ec7d2248918e884cd01adb84c6'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:15:44.263563 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1385/2762] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:15:44 2022] DELETE /identity/v3/users/79c5b9ec7d2248918e884cd01adb84c6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:15:44.443739 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7acb1e6-d3eb-4dde-b5f7-e7b327031c66 service neutron] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:15:44.456307 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7acb1e6-d3eb-4dde-b5f7-e7b327031c66 service neutron] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:15:44.470824 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:15:44.516507 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36312b9d-3184-4887-8903-e32850abecda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:15:44.517278 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36312b9d-3184-4887-8903-e32850abecda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:15:44.518142 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36312b9d-3184-4887-8903-e32850abecda admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:15:44.518433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36312b9d-3184-4887-8903-e32850abecda admin admin] PATH_INFO: `/v3/projects/adff32783b7a479d89e34cd1e5a118d6` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:15:44.519622 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36312b9d-3184-4887-8903-e32850abecda admin admin] RBAC: Authorizing `identity:delete_project(project_id=adff32783b7a479d89e34cd1e5a118d6)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:15:44.521890 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36312b9d-3184-4887-8903-e32850abecda admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:15:44.569957 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-36312b9d-3184-4887-8903-e32850abecda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adff32783b7a479d89e34cd1e5a118d6', 'request_id': 'req-36312b9d-3184-4887-8903-e32850abecda'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:15:44.575461 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-36312b9d-3184-4887-8903-e32850abecda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adff32783b7a479d89e34cd1e5a118d6', 'request_id': 'req-36312b9d-3184-4887-8903-e32850abecda'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:15:44.583136 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-36312b9d-3184-4887-8903-e32850abecda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adff32783b7a479d89e34cd1e5a118d6', 'request_id': 'req-36312b9d-3184-4887-8903-e32850abecda'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:15:44.594200 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-36312b9d-3184-4887-8903-e32850abecda admin admin] The token cache is being invalidate because project adff32783b7a479d89e34cd1e5a118d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:15:44.594481 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-36312b9d-3184-4887-8903-e32850abecda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:15:44.595098 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-36312b9d-3184-4887-8903-e32850abecda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:15:44.596660 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1378/2763] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:15:44 2022] DELETE /identity/v3/projects/adff32783b7a479d89e34cd1e5a118d6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:15:44.600630 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ef5e9-6176-4a81-b5de-552be65b1141 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:15:44.602208 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-6a9ef5e9-6176-4a81-b5de-552be65b1141 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:15:44.615244 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ef5e9-6176-4a81-b5de-552be65b1141 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:15:44.680558 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f5069-993e-4740-85fd-e6d5c23e8770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:15:44.684895 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f5069-993e-4740-85fd-e6d5c23e8770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:15:44.685193 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f5069-993e-4740-85fd-e6d5c23e8770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:15:44.685505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f5069-993e-4740-85fd-e6d5c23e8770 admin admin] PATH_INFO: `/v3/users/8bba183bb7bb462a9802276dd320297e` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:15:44.686707 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351f5069-993e-4740-85fd-e6d5c23e8770 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bba183bb7bb462a9802276dd320297e)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:15:44.688702 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351f5069-993e-4740-85fd-e6d5c23e8770 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:15:44.733212 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:15:44.736963 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-351f5069-993e-4740-85fd-e6d5c23e8770 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bba183bb7bb462a9802276dd320297e'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:15:44.745291 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-351f5069-993e-4740-85fd-e6d5c23e8770 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bba183bb7bb462a9802276dd320297e'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:15:44.745982 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-351f5069-993e-4740-85fd-e6d5c23e8770 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bba183bb7bb462a9802276dd320297e'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:15:44.758438 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-351f5069-993e-4740-85fd-e6d5c23e8770 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bba183bb7bb462a9802276dd320297e'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:15:44.765497 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-351f5069-993e-4740-85fd-e6d5c23e8770 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bba183bb7bb462a9802276dd320297e'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:15:44.771748 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1386/2764] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:15:44 2022] DELETE /identity/v3/users/8bba183bb7bb462a9802276dd320297e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:15:44.941015 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36312b9d-3184-4887-8903-e32850abecda admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:15:44.942448 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-36312b9d-3184-4887-8903-e32850abecda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:15:44.957303 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36312b9d-3184-4887-8903-e32850abecda admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:15:45.025842 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa0657-8b0e-4697-9708-1426df85bf1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:15:45.026912 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa0657-8b0e-4697-9708-1426df85bf1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:15:45.027183 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa0657-8b0e-4697-9708-1426df85bf1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:15:45.027458 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa0657-8b0e-4697-9708-1426df85bf1f admin admin] PATH_INFO: `/v3/projects/698bf9ceeb3944f6b4c209a5cfaa5cb6` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:15:45.028774 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa0657-8b0e-4697-9708-1426df85bf1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=698bf9ceeb3944f6b4c209a5cfaa5cb6)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:15:45.030689 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa0657-8b0e-4697-9708-1426df85bf1f admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:15:45.079244 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-bffa0657-8b0e-4697-9708-1426df85bf1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '698bf9ceeb3944f6b4c209a5cfaa5cb6', 'request_id': 'req-bffa0657-8b0e-4697-9708-1426df85bf1f'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:15:45.081110 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:15:45.088710 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-bffa0657-8b0e-4697-9708-1426df85bf1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '698bf9ceeb3944f6b4c209a5cfaa5cb6', 'request_id': 'req-bffa0657-8b0e-4697-9708-1426df85bf1f'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:15:45.096954 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-bffa0657-8b0e-4697-9708-1426df85bf1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '698bf9ceeb3944f6b4c209a5cfaa5cb6', 'request_id': 'req-bffa0657-8b0e-4697-9708-1426df85bf1f'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:15:45.109369 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-bffa0657-8b0e-4697-9708-1426df85bf1f admin admin] The token cache is being invalidate because project 698bf9ceeb3944f6b4c209a5cfaa5cb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:15:45.109652 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-bffa0657-8b0e-4697-9708-1426df85bf1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:15:45.110307 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-bffa0657-8b0e-4697-9708-1426df85bf1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:15:45.111893 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1379/2765] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:15:44 2022] DELETE /identity/v3/projects/698bf9ceeb3944f6b4c209a5cfaa5cb6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:15:54.768186 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:DELETE=4,keystone:SELECT=13,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:15:55.106225 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:DELETE=3,keystone:SELECT=6,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:15:58.823918 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f5069-993e-4740-85fd-e6d5c23e8770 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:15:58.825491 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-351f5069-993e-4740-85fd-e6d5c23e8770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:15:58.838652 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f5069-993e-4740-85fd-e6d5c23e8770 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:15:58.894298 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca2358b-567b-4112-92a6-f050d6eb4026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:15:58.895169 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2358b-567b-4112-92a6-f050d6eb4026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:15:58.895455 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2358b-567b-4112-92a6-f050d6eb4026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:15:58.895768 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2358b-567b-4112-92a6-f050d6eb4026 admin admin] PATH_INFO: `/v3/users/e48b66b479084e68ad60d15e7236920e` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:15:58.896993 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca2358b-567b-4112-92a6-f050d6eb4026 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e48b66b479084e68ad60d15e7236920e)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:15:58.898929 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca2358b-567b-4112-92a6-f050d6eb4026 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:15:58.947172 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-8ca2358b-567b-4112-92a6-f050d6eb4026 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e48b66b479084e68ad60d15e7236920e'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:15:58.954746 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-8ca2358b-567b-4112-92a6-f050d6eb4026 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e48b66b479084e68ad60d15e7236920e'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:15:58.955410 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-8ca2358b-567b-4112-92a6-f050d6eb4026 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e48b66b479084e68ad60d15e7236920e'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:15:58.967174 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-8ca2358b-567b-4112-92a6-f050d6eb4026 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e48b66b479084e68ad60d15e7236920e'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:15:58.974371 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-8ca2358b-567b-4112-92a6-f050d6eb4026 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e48b66b479084e68ad60d15e7236920e'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:15:58.980918 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1387/2766] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:15:58 2022] DELETE /identity/v3/users/e48b66b479084e68ad60d15e7236920e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:15:58.985084 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ad62f-e214-4e25-9632-0b7c32b4e0da None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:15:58.985513 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ad62f-e214-4e25-9632-0b7c32b4e0da None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:15:58.985621 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ad62f-e214-4e25-9632-0b7c32b4e0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:15:59.003633 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-773ad62f-e214-4e25-9632-0b7c32b4e0da None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:15:59.004812 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-773ad62f-e214-4e25-9632-0b7c32b4e0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:15:59.063249 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1380/2767] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:15:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:15:59.073355 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca2358b-567b-4112-92a6-f050d6eb4026 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:15:59.074765 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-8ca2358b-567b-4112-92a6-f050d6eb4026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:15:59.131184 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca2358b-567b-4112-92a6-f050d6eb4026 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:15:59.135478 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717b287-314b-49a9-b4ac-380e4b467ab5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:15:59.136156 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717b287-314b-49a9-b4ac-380e4b467ab5 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:15:59.136439 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717b287-314b-49a9-b4ac-380e4b467ab5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:15:59.137064 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717b287-314b-49a9-b4ac-380e4b467ab5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:15:59.146211 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4717b287-314b-49a9-b4ac-380e4b467ab5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:15:59.147698 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4717b287-314b-49a9-b4ac-380e4b467ab5 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:15:59.157736 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1388/2768] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:15:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:15:59.427748 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ad62f-e214-4e25-9632-0b7c32b4e0da None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:15:59.429182 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-773ad62f-e214-4e25-9632-0b7c32b4e0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:15:59.444140 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ad62f-e214-4e25-9632-0b7c32b4e0da None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:15:59.448783 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd195bd-dcb2-4f4e-b4a4-1bd292a4f8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:15:59.450444 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd195bd-dcb2-4f4e-b4a4-1bd292a4f8cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:15:59.450734 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd195bd-dcb2-4f4e-b4a4-1bd292a4f8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:15:59.451034 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd195bd-dcb2-4f4e-b4a4-1bd292a4f8cf admin admin] PATH_INFO: `/v3/projects/eb569c5656924e9c888d8a5cdd0e2191` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:15:59.452220 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd195bd-dcb2-4f4e-b4a4-1bd292a4f8cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb569c5656924e9c888d8a5cdd0e2191)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:15:59.454132 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd195bd-dcb2-4f4e-b4a4-1bd292a4f8cf admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:15:59.503553 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-5bd195bd-dcb2-4f4e-b4a4-1bd292a4f8cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb569c5656924e9c888d8a5cdd0e2191', 'request_id': 'req-5bd195bd-dcb2-4f4e-b4a4-1bd292a4f8cf'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:15:59.509244 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-5bd195bd-dcb2-4f4e-b4a4-1bd292a4f8cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb569c5656924e9c888d8a5cdd0e2191', 'request_id': 'req-5bd195bd-dcb2-4f4e-b4a4-1bd292a4f8cf'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:15:59.516348 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-5bd195bd-dcb2-4f4e-b4a4-1bd292a4f8cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb569c5656924e9c888d8a5cdd0e2191', 'request_id': 'req-5bd195bd-dcb2-4f4e-b4a4-1bd292a4f8cf'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:15:59.527975 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-5bd195bd-dcb2-4f4e-b4a4-1bd292a4f8cf admin admin] The token cache is being invalidate because project eb569c5656924e9c888d8a5cdd0e2191 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:15:59.528260 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-5bd195bd-dcb2-4f4e-b4a4-1bd292a4f8cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:15:59.528888 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-5bd195bd-dcb2-4f4e-b4a4-1bd292a4f8cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:15:59.530408 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1381/2769] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:15:59 2022] DELETE /identity/v3/projects/eb569c5656924e9c888d8a5cdd0e2191 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:16:09.153479 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:16:09.524500 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:16:18.617772 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717b287-314b-49a9-b4ac-380e4b467ab5 service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:16:18.627889 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717b287-314b-49a9-b4ac-380e4b467ab5 service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:16:18.677009 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abcbd63-9354-4f7f-840e-cbfbbe5697ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:16:18.677636 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abcbd63-9354-4f7f-840e-cbfbbe5697ee service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:18.677933 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abcbd63-9354-4f7f-840e-cbfbbe5697ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:18.678188 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abcbd63-9354-4f7f-840e-cbfbbe5697ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:18.679979 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-9abcbd63-9354-4f7f-840e-cbfbbe5697ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:16:18.743206 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abcbd63-9354-4f7f-840e-cbfbbe5697ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:16:18.744670 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abcbd63-9354-4f7f-840e-cbfbbe5697ee service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:16:18.754001 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1389/2770] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:16:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:16:21.806611 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd195bd-dcb2-4f4e-b4a4-1bd292a4f8cf admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:16:21.808881 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-5bd195bd-dcb2-4f4e-b4a4-1bd292a4f8cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:16:21.831952 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd195bd-dcb2-4f4e-b4a4-1bd292a4f8cf admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:16:21.836987 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d1723-8ed9-46b4-be77-45a204c6c59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:16:21.837858 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d1723-8ed9-46b4-be77-45a204c6c59a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:21.838139 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d1723-8ed9-46b4-be77-45a204c6c59a admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:21.838410 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d1723-8ed9-46b4-be77-45a204c6c59a admin admin] PATH_INFO: `/v3/users/0c93102a757d4a2cbf7f515c4b67db2c` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:21.839617 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d1723-8ed9-46b4-be77-45a204c6c59a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c93102a757d4a2cbf7f515c4b67db2c)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:16:21.841531 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d1723-8ed9-46b4-be77-45a204c6c59a admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:16:21.888914 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-f63d1723-8ed9-46b4-be77-45a204c6c59a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c93102a757d4a2cbf7f515c4b67db2c'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:16:21.889518 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-f63d1723-8ed9-46b4-be77-45a204c6c59a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c93102a757d4a2cbf7f515c4b67db2c'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:16:21.903979 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-f63d1723-8ed9-46b4-be77-45a204c6c59a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c93102a757d4a2cbf7f515c4b67db2c'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:16:21.910161 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-f63d1723-8ed9-46b4-be77-45a204c6c59a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c93102a757d4a2cbf7f515c4b67db2c'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:16:21.918947 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-f63d1723-8ed9-46b4-be77-45a204c6c59a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c93102a757d4a2cbf7f515c4b67db2c'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:16:21.926361 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1382/2771] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:16:21 2022] DELETE /identity/v3/users/0c93102a757d4a2cbf7f515c4b67db2c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:16:22.096677 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abcbd63-9354-4f7f-840e-cbfbbe5697ee service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:16:22.106515 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abcbd63-9354-4f7f-840e-cbfbbe5697ee service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:16:22.166087 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f9d17-e505-4592-8c6b-3ee1046e87fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:16:22.167019 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f9d17-e505-4592-8c6b-3ee1046e87fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:22.167318 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f9d17-e505-4592-8c6b-3ee1046e87fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:22.167633 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f9d17-e505-4592-8c6b-3ee1046e87fe admin admin] PATH_INFO: `/v3/projects/6f92333085e341938aaf258c0921cd5c` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:22.168818 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562f9d17-e505-4592-8c6b-3ee1046e87fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f92333085e341938aaf258c0921cd5c)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:16:22.170825 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562f9d17-e505-4592-8c6b-3ee1046e87fe admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:16:22.215825 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-562f9d17-e505-4592-8c6b-3ee1046e87fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f92333085e341938aaf258c0921cd5c', 'request_id': 'req-562f9d17-e505-4592-8c6b-3ee1046e87fe'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:16:22.217760 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:16:22.222218 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-562f9d17-e505-4592-8c6b-3ee1046e87fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f92333085e341938aaf258c0921cd5c', 'request_id': 'req-562f9d17-e505-4592-8c6b-3ee1046e87fe'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:16:22.229420 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-562f9d17-e505-4592-8c6b-3ee1046e87fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f92333085e341938aaf258c0921cd5c', 'request_id': 'req-562f9d17-e505-4592-8c6b-3ee1046e87fe'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:16:22.240606 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-562f9d17-e505-4592-8c6b-3ee1046e87fe admin admin] The token cache is being invalidate because project 6f92333085e341938aaf258c0921cd5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:16:22.240890 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-562f9d17-e505-4592-8c6b-3ee1046e87fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:16:22.241507 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-562f9d17-e505-4592-8c6b-3ee1046e87fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:16:22.243029 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1390/2772] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:16:22 2022] DELETE /identity/v3/projects/6f92333085e341938aaf258c0921cd5c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:16:22.248162 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a95d7-e643-47d1-93d4-f523a19bf754 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:22.248500 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a95d7-e643-47d1-93d4-f523a19bf754 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:22.248779 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a95d7-e643-47d1-93d4-f523a19bf754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:22.267030 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-231a95d7-e643-47d1-93d4-f523a19bf754 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:16:22.268240 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-231a95d7-e643-47d1-93d4-f523a19bf754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:16:22.326819 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1383/2773] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:16:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:16:22.336587 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6368c86-b518-441f-9799-e9e829123707 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:22.336912 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6368c86-b518-441f-9799-e9e829123707 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:22.337207 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6368c86-b518-441f-9799-e9e829123707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:22.355963 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-b6368c86-b518-441f-9799-e9e829123707 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:16:22.357178 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-b6368c86-b518-441f-9799-e9e829123707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:16:22.365686 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1391/2774] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:16:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 12:16:22.370090 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a95d7-e643-47d1-93d4-f523a19bf754 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:16:22.380567 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a95d7-e643-47d1-93d4-f523a19bf754 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:16:22.385316 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc77bde-759c-4643-8052-ed5467302969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:16:22.385973 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc77bde-759c-4643-8052-ed5467302969 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:22.386257 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc77bde-759c-4643-8052-ed5467302969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:22.386536 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc77bde-759c-4643-8052-ed5467302969 admin admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:22.387298 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc77bde-759c-4643-8052-ed5467302969 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:16:22.387648 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc77bde-759c-4643-8052-ed5467302969 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:16:22.389304 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc77bde-759c-4643-8052-ed5467302969 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:16:22.402837 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1384/2775] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 12:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 03 12:16:22.407633 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6368c86-b518-441f-9799-e9e829123707 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:16:22.416962 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6368c86-b518-441f-9799-e9e829123707 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:16:22.422109 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09ab5d-502f-437f-8e19-f2fcf09e82ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:16:22.422748 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09ab5d-502f-437f-8e19-f2fcf09e82ec admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:22.423025 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09ab5d-502f-437f-8e19-f2fcf09e82ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:22.423296 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09ab5d-502f-437f-8e19-f2fcf09e82ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:22.424007 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09ab5d-502f-437f-8e19-f2fcf09e82ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:16:22.425879 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09ab5d-502f-437f-8e19-f2fcf09e82ec admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:16:22.453271 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1392/2776] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 12:16:22 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:16:22.457689 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc77bde-759c-4643-8052-ed5467302969 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:16:22.467628 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc77bde-759c-4643-8052-ed5467302969 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:16:22.525051 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96829fd6-573e-4392-9148-7c84cc437860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:16:22.525740 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96829fd6-573e-4392-9148-7c84cc437860 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:22.526049 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96829fd6-573e-4392-9148-7c84cc437860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:22.526623 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96829fd6-573e-4392-9148-7c84cc437860 admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:22.527405 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96829fd6-573e-4392-9148-7c84cc437860 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:16:22.529400 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96829fd6-573e-4392-9148-7c84cc437860 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:16:22.536564 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:16:22.550930 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1385/2777] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 12:16:22 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:16:22.555020 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09ab5d-502f-437f-8e19-f2fcf09e82ec admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:16:22.566334 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09ab5d-502f-437f-8e19-f2fcf09e82ec admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:16:22.570977 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec6519-7754-4b5c-8217-4cef290f9f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:16:22.571672 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec6519-7754-4b5c-8217-4cef290f9f30 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:22.571958 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec6519-7754-4b5c-8217-4cef290f9f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:22.572239 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec6519-7754-4b5c-8217-4cef290f9f30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:22.573036 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec6519-7754-4b5c-8217-4cef290f9f30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:16:22.574563 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec6519-7754-4b5c-8217-4cef290f9f30 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:16:22.584865 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1393/2778] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:16:22.588696 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96829fd6-573e-4392-9148-7c84cc437860 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:16:22.598529 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96829fd6-573e-4392-9148-7c84cc437860 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:16:22.603059 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588200c-8b3e-412b-adca-b9df9a8fe065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:16:22.603731 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588200c-8b3e-412b-adca-b9df9a8fe065 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:22.604013 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588200c-8b3e-412b-adca-b9df9a8fe065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:22.604289 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588200c-8b3e-412b-adca-b9df9a8fe065 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:22.605004 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8588200c-8b3e-412b-adca-b9df9a8fe065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:16:22.606581 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8588200c-8b3e-412b-adca-b9df9a8fe065 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:16:22.616794 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1386/2779] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:16:22.620618 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec6519-7754-4b5c-8217-4cef290f9f30 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:16:22.630955 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec6519-7754-4b5c-8217-4cef290f9f30 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:16:22.635638 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0534e0-0c41-4715-bd23-adf1d5f43fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:16:22.636586 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0534e0-0c41-4715-bd23-adf1d5f43fad admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:22.636929 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0534e0-0c41-4715-bd23-adf1d5f43fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:22.637234 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0534e0-0c41-4715-bd23-adf1d5f43fad admin admin] PATH_INFO: `/v3/projects/bdfe285d8d5443ddbf4547fcb631fe2a/users/c8890978acc946539b3e339f46980ba5/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:22.652636 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0534e0-0c41-4715-bd23-adf1d5f43fad admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdfe285d8d5443ddbf4547fcb631fe2a, user_id=c8890978acc946539b3e339f46980ba5, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:16:22.655768 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0534e0-0c41-4715-bd23-adf1d5f43fad admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:16:22.668232 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1394/2780] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:16:22 2022] PUT /identity/v3/projects/bdfe285d8d5443ddbf4547fcb631fe2a/users/c8890978acc946539b3e339f46980ba5/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:16:22.678735 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f408b-7a05-4afb-880e-95102b615364 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:22.679025 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f408b-7a05-4afb-880e-95102b615364 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:22.679304 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f408b-7a05-4afb-880e-95102b615364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:22.704974 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-2c4f408b-7a05-4afb-880e-95102b615364 None None] MFA Rules not processed for user `c8890978acc946539b3e339f46980ba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:16:22.706151 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-2c4f408b-7a05-4afb-880e-95102b615364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:16:22.769424 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1387/2781] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:16:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:16:22.781090 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0534e0-0c41-4715-bd23-adf1d5f43fad admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:16:22.782761 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-9b0534e0-0c41-4715-bd23-adf1d5f43fad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:16:22.862301 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0534e0-0c41-4715-bd23-adf1d5f43fad admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:16:22.867815 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49401956-115d-4c11-928b-751a6dff8ea8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:16:22.868456 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49401956-115d-4c11-928b-751a6dff8ea8 service nova] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:22.868736 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49401956-115d-4c11-928b-751a6dff8ea8 service nova] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:22.869010 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49401956-115d-4c11-928b-751a6dff8ea8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:22.877289 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49401956-115d-4c11-928b-751a6dff8ea8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:16:22.878856 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49401956-115d-4c11-928b-751a6dff8ea8 service nova] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:16:22.887616 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1395/2782] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:16:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:16:25.559256 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f408b-7a05-4afb-880e-95102b615364 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:16:25.617942 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f408b-7a05-4afb-880e-95102b615364 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:16:25.622663 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f74e2c-bbb0-4ff7-b9ce-99a2d3749adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:16:25.623572 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f74e2c-bbb0-4ff7-b9ce-99a2d3749adb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:25.624422 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f74e2c-bbb0-4ff7-b9ce-99a2d3749adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:25.624706 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f74e2c-bbb0-4ff7-b9ce-99a2d3749adb admin admin] PATH_INFO: `/v3/users/c8890978acc946539b3e339f46980ba5` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:25.625923 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f74e2c-bbb0-4ff7-b9ce-99a2d3749adb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8890978acc946539b3e339f46980ba5)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:16:25.627872 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f74e2c-bbb0-4ff7-b9ce-99a2d3749adb admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:16:25.674854 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-80f74e2c-bbb0-4ff7-b9ce-99a2d3749adb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8890978acc946539b3e339f46980ba5'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:16:25.675544 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-80f74e2c-bbb0-4ff7-b9ce-99a2d3749adb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8890978acc946539b3e339f46980ba5'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:16:25.687958 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-80f74e2c-bbb0-4ff7-b9ce-99a2d3749adb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8890978acc946539b3e339f46980ba5'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:16:25.692436 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:INSERT=3,keystone:SELECT=88,keystone:DELETE=9 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:16:25.695934 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-80f74e2c-bbb0-4ff7-b9ce-99a2d3749adb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8890978acc946539b3e339f46980ba5'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:16:25.705597 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-80f74e2c-bbb0-4ff7-b9ce-99a2d3749adb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8890978acc946539b3e339f46980ba5'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:16:25.712047 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1388/2783] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:16:25 2022] DELETE /identity/v3/users/c8890978acc946539b3e339f46980ba5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:16:25.716696 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110672e0-9a9f-4863-95a1-88d52a4a3b62 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:25.717177 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110672e0-9a9f-4863-95a1-88d52a4a3b62 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:25.717299 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110672e0-9a9f-4863-95a1-88d52a4a3b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:25.737546 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-110672e0-9a9f-4863-95a1-88d52a4a3b62 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:16:25.738755 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-110672e0-9a9f-4863-95a1-88d52a4a3b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:16:25.799982 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1396/2784] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:16:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:16:25.809767 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f74e2c-bbb0-4ff7-b9ce-99a2d3749adb admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:16:25.811222 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-80f74e2c-bbb0-4ff7-b9ce-99a2d3749adb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:16:25.869314 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f74e2c-bbb0-4ff7-b9ce-99a2d3749adb admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:16:25.872990 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb50895-bc4a-4fdf-9782-1884bcfaaed6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:16:25.873638 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb50895-bc4a-4fdf-9782-1884bcfaaed6 service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:25.874455 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb50895-bc4a-4fdf-9782-1884bcfaaed6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:25.874730 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb50895-bc4a-4fdf-9782-1884bcfaaed6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:25.883837 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb50895-bc4a-4fdf-9782-1884bcfaaed6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:16:25.885270 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb50895-bc4a-4fdf-9782-1884bcfaaed6 service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:16:25.896661 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1389/2785] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:16:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:16:26.173199 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110672e0-9a9f-4863-95a1-88d52a4a3b62 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:16:26.174678 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-110672e0-9a9f-4863-95a1-88d52a4a3b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:16:26.181844 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:16:26.188642 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110672e0-9a9f-4863-95a1-88d52a4a3b62 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:16:26.195848 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c03af-5eee-495b-9b0f-6b0d3d8ef28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:16:26.196508 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c03af-5eee-495b-9b0f-6b0d3d8ef28a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:26.196975 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c03af-5eee-495b-9b0f-6b0d3d8ef28a admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:26.197426 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c03af-5eee-495b-9b0f-6b0d3d8ef28a admin admin] PATH_INFO: `/v3/projects/bdfe285d8d5443ddbf4547fcb631fe2a` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:26.198815 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c03af-5eee-495b-9b0f-6b0d3d8ef28a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdfe285d8d5443ddbf4547fcb631fe2a)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:16:26.200822 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c03af-5eee-495b-9b0f-6b0d3d8ef28a admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:16:26.250593 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-3d4c03af-5eee-495b-9b0f-6b0d3d8ef28a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdfe285d8d5443ddbf4547fcb631fe2a', 'request_id': 'req-3d4c03af-5eee-495b-9b0f-6b0d3d8ef28a'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:16:26.256128 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-3d4c03af-5eee-495b-9b0f-6b0d3d8ef28a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdfe285d8d5443ddbf4547fcb631fe2a', 'request_id': 'req-3d4c03af-5eee-495b-9b0f-6b0d3d8ef28a'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:16:26.263408 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-3d4c03af-5eee-495b-9b0f-6b0d3d8ef28a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdfe285d8d5443ddbf4547fcb631fe2a', 'request_id': 'req-3d4c03af-5eee-495b-9b0f-6b0d3d8ef28a'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:16:26.275050 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-3d4c03af-5eee-495b-9b0f-6b0d3d8ef28a admin admin] The token cache is being invalidate because project bdfe285d8d5443ddbf4547fcb631fe2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:16:26.275339 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-3d4c03af-5eee-495b-9b0f-6b0d3d8ef28a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:16:26.275985 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-3d4c03af-5eee-495b-9b0f-6b0d3d8ef28a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:16:26.277788 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1397/2786] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:16:26 2022] DELETE /identity/v3/projects/bdfe285d8d5443ddbf4547fcb631fe2a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 12:16:26.282632 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccb6af-5021-4f1a-8998-dbdfc897669c None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:26.282920 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccb6af-5021-4f1a-8998-dbdfc897669c None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:26.283200 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccb6af-5021-4f1a-8998-dbdfc897669c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:26.300920 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-5bccb6af-5021-4f1a-8998-dbdfc897669c None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:16:26.302063 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-5bccb6af-5021-4f1a-8998-dbdfc897669c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:16:26.360989 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1390/2787] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:16:26.368739 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a547920-0955-458b-8101-89fd7cd341f8 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:26.369161 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a547920-0955-458b-8101-89fd7cd341f8 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:26.369443 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a547920-0955-458b-8101-89fd7cd341f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:26.388243 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-7a547920-0955-458b-8101-89fd7cd341f8 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:16:26.389449 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-7a547920-0955-458b-8101-89fd7cd341f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:16:26.397545 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1398/2788] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:16:26.402066 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bccb6af-5021-4f1a-8998-dbdfc897669c None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:16:26.412215 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bccb6af-5021-4f1a-8998-dbdfc897669c None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:16:26.416715 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f148af-81fa-4b07-a4f3-184de2e740bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:16:26.417365 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f148af-81fa-4b07-a4f3-184de2e740bf admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:26.417651 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f148af-81fa-4b07-a4f3-184de2e740bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:26.417929 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f148af-81fa-4b07-a4f3-184de2e740bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:26.418651 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f148af-81fa-4b07-a4f3-184de2e740bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:16:26.418959 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f148af-81fa-4b07-a4f3-184de2e740bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:16:26.420585 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f148af-81fa-4b07-a4f3-184de2e740bf admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:16:26.433042 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1391/2789] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 12:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:16:26.437470 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a547920-0955-458b-8101-89fd7cd341f8 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:16:26.447122 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a547920-0955-458b-8101-89fd7cd341f8 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:16:26.451774 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef7151-20ef-4937-be74-e5eb04faa2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:16:26.452422 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef7151-20ef-4937-be74-e5eb04faa2cf admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:26.452704 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef7151-20ef-4937-be74-e5eb04faa2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:26.452979 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef7151-20ef-4937-be74-e5eb04faa2cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:26.453673 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef7151-20ef-4937-be74-e5eb04faa2cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:16:26.455591 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef7151-20ef-4937-be74-e5eb04faa2cf admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:16:26.488137 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1399/2790] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 12:16:26 2022] POST /identity/v3/projects => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:16:26.492339 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f148af-81fa-4b07-a4f3-184de2e740bf admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:16:26.502210 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f148af-81fa-4b07-a4f3-184de2e740bf admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:16:26.559325 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b0b4d-317f-446b-9cc6-4fd6b768aa05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:16:26.560066 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b0b4d-317f-446b-9cc6-4fd6b768aa05 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:26.560468 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b0b4d-317f-446b-9cc6-4fd6b768aa05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:26.560743 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b0b4d-317f-446b-9cc6-4fd6b768aa05 admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:26.561437 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b0b4d-317f-446b-9cc6-4fd6b768aa05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:16:26.563357 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b0b4d-317f-446b-9cc6-4fd6b768aa05 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:16:26.585973 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1392/2791] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 12:16:26 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 12:16:26.590539 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef7151-20ef-4937-be74-e5eb04faa2cf admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:16:26.601383 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef7151-20ef-4937-be74-e5eb04faa2cf admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:16:26.605965 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a93c4e7-e9ff-436d-9178-6a5619cf6ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:16:26.606613 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93c4e7-e9ff-436d-9178-6a5619cf6ead admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:26.606898 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93c4e7-e9ff-436d-9178-6a5619cf6ead admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:26.607176 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93c4e7-e9ff-436d-9178-6a5619cf6ead admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:26.607935 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a93c4e7-e9ff-436d-9178-6a5619cf6ead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:16:26.610114 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a93c4e7-e9ff-436d-9178-6a5619cf6ead admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:16:26.620432 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1400/2792] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:16:26.624561 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b0b4d-317f-446b-9cc6-4fd6b768aa05 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:16:26.634533 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b0b4d-317f-446b-9cc6-4fd6b768aa05 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:16:26.639076 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628620cb-b836-433d-a6bc-73486214db38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:16:26.639760 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628620cb-b836-433d-a6bc-73486214db38 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:26.640044 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628620cb-b836-433d-a6bc-73486214db38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:26.640318 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628620cb-b836-433d-a6bc-73486214db38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:26.641036 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628620cb-b836-433d-a6bc-73486214db38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:16:26.642622 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628620cb-b836-433d-a6bc-73486214db38 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:16:26.643910 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:16:26.656823 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1393/2793] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 12:16:26.661119 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a93c4e7-e9ff-436d-9178-6a5619cf6ead admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:16:26.671722 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a93c4e7-e9ff-436d-9178-6a5619cf6ead admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:16:26.679831 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d9d9c-4cd7-4f38-93c3-130cfe5880fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:16:26.680692 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d9d9c-4cd7-4f38-93c3-130cfe5880fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:26.680969 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d9d9c-4cd7-4f38-93c3-130cfe5880fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:26.681239 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d9d9c-4cd7-4f38-93c3-130cfe5880fe admin admin] PATH_INFO: `/v3/projects/2cdc52ebb9ea40e486bffbc1f613500f/users/75423ff70df84d97901e107cda537822/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:26.696643 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d9d9c-4cd7-4f38-93c3-130cfe5880fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cdc52ebb9ea40e486bffbc1f613500f, user_id=75423ff70df84d97901e107cda537822, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:16:26.699280 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d9d9c-4cd7-4f38-93c3-130cfe5880fe admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:16:26.712606 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1401/2794] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:16:26 2022] PUT /identity/v3/projects/2cdc52ebb9ea40e486bffbc1f613500f/users/75423ff70df84d97901e107cda537822/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:16:26.724870 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad523c-2a40-4685-9fff-a2a1ac0287de None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:26.725207 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad523c-2a40-4685-9fff-a2a1ac0287de None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:26.725526 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad523c-2a40-4685-9fff-a2a1ac0287de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:26.752825 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-7cad523c-2a40-4685-9fff-a2a1ac0287de None None] MFA Rules not processed for user `75423ff70df84d97901e107cda537822`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:16:26.754019 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-7cad523c-2a40-4685-9fff-a2a1ac0287de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:16:26.817476 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1394/2795] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:16:26 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:16:26.829207 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d9d9c-4cd7-4f38-93c3-130cfe5880fe admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:16:26.831467 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-2e5d9d9c-4cd7-4f38-93c3-130cfe5880fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:16:26.890926 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d9d9c-4cd7-4f38-93c3-130cfe5880fe admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:16:26.894853 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f778421-ede0-496b-8d6a-22db84c467c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:16:26.895537 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f778421-ede0-496b-8d6a-22db84c467c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:26.895828 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f778421-ede0-496b-8d6a-22db84c467c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:26.896110 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f778421-ede0-496b-8d6a-22db84c467c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:26.909437 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f778421-ede0-496b-8d6a-22db84c467c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:16:26.910875 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f778421-ede0-496b-8d6a-22db84c467c5 service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:16:26.919852 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1402/2796] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:16:26 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:16:35.284988 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad523c-2a40-4685-9fff-a2a1ac0287de None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:16:35.345541 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad523c-2a40-4685-9fff-a2a1ac0287de None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:16:35.349995 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f00a9-f5fd-4716-bd7a-d4ed92cc3c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:16:35.350900 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f00a9-f5fd-4716-bd7a-d4ed92cc3c11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:35.351177 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f00a9-f5fd-4716-bd7a-d4ed92cc3c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:35.351450 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f00a9-f5fd-4716-bd7a-d4ed92cc3c11 admin admin] PATH_INFO: `/v3/users/75423ff70df84d97901e107cda537822` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:35.352682 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f00a9-f5fd-4716-bd7a-d4ed92cc3c11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75423ff70df84d97901e107cda537822)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:16:35.354612 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f00a9-f5fd-4716-bd7a-d4ed92cc3c11 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:16:35.402804 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-0e3f00a9-f5fd-4716-bd7a-d4ed92cc3c11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75423ff70df84d97901e107cda537822'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:16:35.403541 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-0e3f00a9-f5fd-4716-bd7a-d4ed92cc3c11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75423ff70df84d97901e107cda537822'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:16:35.415957 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-0e3f00a9-f5fd-4716-bd7a-d4ed92cc3c11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75423ff70df84d97901e107cda537822'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:16:35.423480 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-0e3f00a9-f5fd-4716-bd7a-d4ed92cc3c11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75423ff70df84d97901e107cda537822'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:16:35.430876 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-0e3f00a9-f5fd-4716-bd7a-d4ed92cc3c11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75423ff70df84d97901e107cda537822'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:16:35.437042 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1395/2797] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:16:35 2022] DELETE /identity/v3/users/75423ff70df84d97901e107cda537822 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:16:35.441875 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ec70d-d398-4dca-9681-52cf9c251430 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:35.442440 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ec70d-d398-4dca-9681-52cf9c251430 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:35.442440 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ec70d-d398-4dca-9681-52cf9c251430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:35.459865 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-200ec70d-d398-4dca-9681-52cf9c251430 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:16:35.461062 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-200ec70d-d398-4dca-9681-52cf9c251430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:16:35.479833 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:16:35.522453 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1403/2798] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:16:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:16:35.532804 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f00a9-f5fd-4716-bd7a-d4ed92cc3c11 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:16:35.534298 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-0e3f00a9-f5fd-4716-bd7a-d4ed92cc3c11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:16:35.541001 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:16:35.593846 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f00a9-f5fd-4716-bd7a-d4ed92cc3c11 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:16:35.597499 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d630a0-fa7f-488d-9667-450d06f83073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:16:35.598142 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d630a0-fa7f-488d-9667-450d06f83073 service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:35.598427 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d630a0-fa7f-488d-9667-450d06f83073 service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:35.598714 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d630a0-fa7f-488d-9667-450d06f83073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:35.607657 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d630a0-fa7f-488d-9667-450d06f83073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:16:35.609725 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d630a0-fa7f-488d-9667-450d06f83073 service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:16:35.619193 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1396/2799] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:16:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 12:16:35.909071 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ec70d-d398-4dca-9681-52cf9c251430 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:16:35.911460 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-200ec70d-d398-4dca-9681-52cf9c251430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:16:35.933369 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ec70d-d398-4dca-9681-52cf9c251430 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:16:35.941899 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91ef7b-8bed-4b2e-a359-5b6a33648a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:16:35.943128 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91ef7b-8bed-4b2e-a359-5b6a33648a77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:35.943558 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91ef7b-8bed-4b2e-a359-5b6a33648a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:35.944020 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91ef7b-8bed-4b2e-a359-5b6a33648a77 admin admin] PATH_INFO: `/v3/projects/2cdc52ebb9ea40e486bffbc1f613500f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:35.946459 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de91ef7b-8bed-4b2e-a359-5b6a33648a77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cdc52ebb9ea40e486bffbc1f613500f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:16:35.949093 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de91ef7b-8bed-4b2e-a359-5b6a33648a77 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:16:36.000178 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-de91ef7b-8bed-4b2e-a359-5b6a33648a77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cdc52ebb9ea40e486bffbc1f613500f', 'request_id': 'req-de91ef7b-8bed-4b2e-a359-5b6a33648a77'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:16:36.005776 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-de91ef7b-8bed-4b2e-a359-5b6a33648a77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cdc52ebb9ea40e486bffbc1f613500f', 'request_id': 'req-de91ef7b-8bed-4b2e-a359-5b6a33648a77'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:16:36.013365 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-de91ef7b-8bed-4b2e-a359-5b6a33648a77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cdc52ebb9ea40e486bffbc1f613500f', 'request_id': 'req-de91ef7b-8bed-4b2e-a359-5b6a33648a77'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:16:36.026554 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-de91ef7b-8bed-4b2e-a359-5b6a33648a77 admin admin] The token cache is being invalidate because project 2cdc52ebb9ea40e486bffbc1f613500f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:16:36.026882 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-de91ef7b-8bed-4b2e-a359-5b6a33648a77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:16:36.027694 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-de91ef7b-8bed-4b2e-a359-5b6a33648a77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:16:36.029315 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1404/2800] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:16:35 2022] DELETE /identity/v3/projects/2cdc52ebb9ea40e486bffbc1f613500f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:16:36.034771 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba31fc-237d-4768-8982-f4ef5dda2dd6 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:36.035063 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba31fc-237d-4768-8982-f4ef5dda2dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:36.035342 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba31fc-237d-4768-8982-f4ef5dda2dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:36.052977 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-1aba31fc-237d-4768-8982-f4ef5dda2dd6 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:16:36.054190 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-1aba31fc-237d-4768-8982-f4ef5dda2dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:16:36.114601 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1397/2801] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:16:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:16:36.122478 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9027633-aac9-4af6-8174-f7fc3a524228 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:36.122895 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9027633-aac9-4af6-8174-f7fc3a524228 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:36.123296 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9027633-aac9-4af6-8174-f7fc3a524228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:36.142763 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-f9027633-aac9-4af6-8174-f7fc3a524228 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:16:36.143996 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-f9027633-aac9-4af6-8174-f7fc3a524228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:16:36.152162 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1405/2802] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:16:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 12:16:36.156276 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba31fc-237d-4768-8982-f4ef5dda2dd6 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:16:36.165702 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba31fc-237d-4768-8982-f4ef5dda2dd6 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:16:36.170331 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9e662-f790-48c7-8765-18d7c5fdfa0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:16:36.170998 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9e662-f790-48c7-8765-18d7c5fdfa0c admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:36.171278 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9e662-f790-48c7-8765-18d7c5fdfa0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:36.171581 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9e662-f790-48c7-8765-18d7c5fdfa0c admin admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:36.172312 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c9e662-f790-48c7-8765-18d7c5fdfa0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:16:36.172613 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c9e662-f790-48c7-8765-18d7c5fdfa0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:16:36.174229 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c9e662-f790-48c7-8765-18d7c5fdfa0c admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:16:36.185497 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1398/2803] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 12:16:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:16:36.190364 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9027633-aac9-4af6-8174-f7fc3a524228 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:16:36.199710 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9027633-aac9-4af6-8174-f7fc3a524228 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:16:36.204993 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add4f5f-4907-4769-a2cd-824c5702b872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:16:36.205634 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add4f5f-4907-4769-a2cd-824c5702b872 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:36.205916 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add4f5f-4907-4769-a2cd-824c5702b872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:36.206193 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add4f5f-4907-4769-a2cd-824c5702b872 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:36.206887 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0add4f5f-4907-4769-a2cd-824c5702b872 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:16:36.208833 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0add4f5f-4907-4769-a2cd-824c5702b872 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:16:36.244158 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1406/2804] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 12:16:36 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 12:16:36.248293 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9e662-f790-48c7-8765-18d7c5fdfa0c admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:16:36.258674 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9e662-f790-48c7-8765-18d7c5fdfa0c admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:16:36.316157 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b53779-10f4-4955-b5e2-93b67b76e05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:16:36.316843 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b53779-10f4-4955-b5e2-93b67b76e05d admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:36.317022 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b53779-10f4-4955-b5e2-93b67b76e05d admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:36.317272 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b53779-10f4-4955-b5e2-93b67b76e05d admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:36.317971 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b53779-10f4-4955-b5e2-93b67b76e05d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:16:36.319988 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b53779-10f4-4955-b5e2-93b67b76e05d admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:16:36.339923 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1399/2805] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 12:16:36 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:16:36.344730 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add4f5f-4907-4769-a2cd-824c5702b872 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:16:36.354989 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add4f5f-4907-4769-a2cd-824c5702b872 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:16:36.359646 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb7dd6-872f-488b-bee8-35a3ad39d53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:16:36.360295 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb7dd6-872f-488b-bee8-35a3ad39d53a admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:36.360582 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb7dd6-872f-488b-bee8-35a3ad39d53a admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:36.360857 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb7dd6-872f-488b-bee8-35a3ad39d53a admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:36.361577 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eb7dd6-872f-488b-bee8-35a3ad39d53a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:16:36.363164 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eb7dd6-872f-488b-bee8-35a3ad39d53a admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:16:36.373243 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1407/2806] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:16:36.378088 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b53779-10f4-4955-b5e2-93b67b76e05d admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:16:36.388012 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b53779-10f4-4955-b5e2-93b67b76e05d admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:16:36.393318 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b345d-b35e-49a5-8dc3-4e9be4dda634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:16:36.393974 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b345d-b35e-49a5-8dc3-4e9be4dda634 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:36.394259 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b345d-b35e-49a5-8dc3-4e9be4dda634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:36.394531 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b345d-b35e-49a5-8dc3-4e9be4dda634 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:36.395258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b345d-b35e-49a5-8dc3-4e9be4dda634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:16:36.396893 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b345d-b35e-49a5-8dc3-4e9be4dda634 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:16:36.406985 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1400/2807] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:16:36.412807 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb7dd6-872f-488b-bee8-35a3ad39d53a admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:16:36.422816 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb7dd6-872f-488b-bee8-35a3ad39d53a admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:16:36.427399 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c24e0a-cc41-4d91-b8a2-c26cf30568da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:16:36.428298 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c24e0a-cc41-4d91-b8a2-c26cf30568da admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:36.428579 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c24e0a-cc41-4d91-b8a2-c26cf30568da admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:36.428853 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c24e0a-cc41-4d91-b8a2-c26cf30568da admin admin] PATH_INFO: `/v3/projects/22b34cdfa04149139f7aa2556e1577e4/users/afa6f7afcd20405a820c03372bbf72d4/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:36.443796 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c24e0a-cc41-4d91-b8a2-c26cf30568da admin admin] RBAC: Authorizing `identity:create_grant(project_id=22b34cdfa04149139f7aa2556e1577e4, user_id=afa6f7afcd20405a820c03372bbf72d4, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:16:36.446444 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c24e0a-cc41-4d91-b8a2-c26cf30568da admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:16:36.460084 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1408/2808] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:16:36 2022] PUT /identity/v3/projects/22b34cdfa04149139f7aa2556e1577e4/users/afa6f7afcd20405a820c03372bbf72d4/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:16:36.471919 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426802e7-7d38-43d2-b4be-0af64e433ed6 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:36.472416 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426802e7-7d38-43d2-b4be-0af64e433ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:36.472745 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426802e7-7d38-43d2-b4be-0af64e433ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:36.498451 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:16:36.502426 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-426802e7-7d38-43d2-b4be-0af64e433ed6 None None] MFA Rules not processed for user `afa6f7afcd20405a820c03372bbf72d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:16:36.504194 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-426802e7-7d38-43d2-b4be-0af64e433ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:16:36.572627 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1401/2809] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:16:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:16:36.577171 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c24e0a-cc41-4d91-b8a2-c26cf30568da admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:16:36.615788 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:16:36.641207 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c24e0a-cc41-4d91-b8a2-c26cf30568da admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:16:36.645900 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe53549-6d80-4b30-914d-af8dc401f305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:16:36.646549 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe53549-6d80-4b30-914d-af8dc401f305 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:36.646838 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe53549-6d80-4b30-914d-af8dc401f305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:36.647114 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe53549-6d80-4b30-914d-af8dc401f305 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:36.647852 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe53549-6d80-4b30-914d-af8dc401f305 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:16:36.649738 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe53549-6d80-4b30-914d-af8dc401f305 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:16:36.675062 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1409/2810] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 12:16:36 2022] POST /identity/v3/projects => generated 371 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:16:36.680703 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426802e7-7d38-43d2-b4be-0af64e433ed6 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:16:36.692059 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426802e7-7d38-43d2-b4be-0af64e433ed6 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:16:36.749271 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399cdd81-6dbd-4f7e-9270-7e25ff7c84c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:16:36.749947 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399cdd81-6dbd-4f7e-9270-7e25ff7c84c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:36.750227 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399cdd81-6dbd-4f7e-9270-7e25ff7c84c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:36.750500 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399cdd81-6dbd-4f7e-9270-7e25ff7c84c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:36.751192 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399cdd81-6dbd-4f7e-9270-7e25ff7c84c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:16:36.753135 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399cdd81-6dbd-4f7e-9270-7e25ff7c84c3 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:16:36.773225 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1402/2811] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 12:16:36 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 12:16:36.777776 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe53549-6d80-4b30-914d-af8dc401f305 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:16:36.788286 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe53549-6d80-4b30-914d-af8dc401f305 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:16:36.792967 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c456cff-d2ec-4a53-ac03-3dc772495530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:16:36.793618 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c456cff-d2ec-4a53-ac03-3dc772495530 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:36.793900 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c456cff-d2ec-4a53-ac03-3dc772495530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:36.794173 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c456cff-d2ec-4a53-ac03-3dc772495530 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:36.794896 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c456cff-d2ec-4a53-ac03-3dc772495530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:16:36.797017 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c456cff-d2ec-4a53-ac03-3dc772495530 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:16:36.807407 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1410/2812] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:16:36.812309 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399cdd81-6dbd-4f7e-9270-7e25ff7c84c3 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:16:36.822221 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399cdd81-6dbd-4f7e-9270-7e25ff7c84c3 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:16:36.826799 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad9fe5-4d90-4f60-a855-d369cdb092f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:16:36.827705 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad9fe5-4d90-4f60-a855-d369cdb092f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:36.827990 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad9fe5-4d90-4f60-a855-d369cdb092f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:36.828265 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad9fe5-4d90-4f60-a855-d369cdb092f3 admin admin] PATH_INFO: `/v3/projects/6e1a67c09b3348c4be9387497a9e533c/users/63437985f2b34466a7c5ed2be9c9fd12/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:36.843673 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cad9fe5-4d90-4f60-a855-d369cdb092f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e1a67c09b3348c4be9387497a9e533c, user_id=63437985f2b34466a7c5ed2be9c9fd12, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:16:36.846323 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cad9fe5-4d90-4f60-a855-d369cdb092f3 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:16:36.859873 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1403/2813] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:16:36 2022] PUT /identity/v3/projects/6e1a67c09b3348c4be9387497a9e533c/users/63437985f2b34466a7c5ed2be9c9fd12/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 12:16:36.863834 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c456cff-d2ec-4a53-ac03-3dc772495530 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:16:36.874553 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c456cff-d2ec-4a53-ac03-3dc772495530 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:16:36.930852 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df22b1-1094-475e-aae3-a307b49a0405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:16:36.931594 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df22b1-1094-475e-aae3-a307b49a0405 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:36.931823 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df22b1-1094-475e-aae3-a307b49a0405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:36.932097 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df22b1-1094-475e-aae3-a307b49a0405 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:36.932810 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df22b1-1094-475e-aae3-a307b49a0405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:16:36.934389 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df22b1-1094-475e-aae3-a307b49a0405 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:16:36.944542 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1411/2814] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:16:36.948935 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad9fe5-4d90-4f60-a855-d369cdb092f3 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:16:36.959692 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad9fe5-4d90-4f60-a855-d369cdb092f3 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:16:36.964561 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa1914-b357-469b-a943-d0d9460f061c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:16:36.965436 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa1914-b357-469b-a943-d0d9460f061c admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:36.965750 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa1914-b357-469b-a943-d0d9460f061c admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:36.966029 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa1914-b357-469b-a943-d0d9460f061c admin admin] PATH_INFO: `/v3/projects/6e1a67c09b3348c4be9387497a9e533c/users/63437985f2b34466a7c5ed2be9c9fd12/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:36.968510 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa1914-b357-469b-a943-d0d9460f061c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e1a67c09b3348c4be9387497a9e533c, user_id=63437985f2b34466a7c5ed2be9c9fd12, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:16:36.971135 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa1914-b357-469b-a943-d0d9460f061c admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:16:36.981265 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1404/2815] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:16:36 2022] PUT /identity/v3/projects/6e1a67c09b3348c4be9387497a9e533c/users/63437985f2b34466a7c5ed2be9c9fd12/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:16:36.992109 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d784d8-bf8b-4b04-8186-1e2f89ec6ee3 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:36.992392 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d784d8-bf8b-4b04-8186-1e2f89ec6ee3 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:36.992666 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d784d8-bf8b-4b04-8186-1e2f89ec6ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:37.032442 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-36d784d8-bf8b-4b04-8186-1e2f89ec6ee3 None None] MFA Rules not processed for user `63437985f2b34466a7c5ed2be9c9fd12`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:16:37.034477 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-36d784d8-bf8b-4b04-8186-1e2f89ec6ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:16:37.111915 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1412/2816] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:16:36 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:16:37.122270 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa1914-b357-469b-a943-d0d9460f061c admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:16:37.124060 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-2dfa1914-b357-469b-a943-d0d9460f061c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:16:37.182599 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa1914-b357-469b-a943-d0d9460f061c admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:16:37.186267 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aac4fc-ba75-4fbf-ab27-d93e50f4b974 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:16:37.186910 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aac4fc-ba75-4fbf-ab27-d93e50f4b974 service cinder] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:37.187192 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aac4fc-ba75-4fbf-ab27-d93e50f4b974 service cinder] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:37.187468 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aac4fc-ba75-4fbf-ab27-d93e50f4b974 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:37.195746 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:16:37.246381 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aac4fc-ba75-4fbf-ab27-d93e50f4b974 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:16:37.247871 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aac4fc-ba75-4fbf-ab27-d93e50f4b974 service cinder] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:16:37.256811 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1405/2817] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:16:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:16:42.890101 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d784d8-bf8b-4b04-8186-1e2f89ec6ee3 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:16:42.891657 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-36d784d8-bf8b-4b04-8186-1e2f89ec6ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:16:42.905127 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d784d8-bf8b-4b04-8186-1e2f89ec6ee3 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:16:42.908631 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa7a01-2fa9-43ad-bd5f-29c79f044ec0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:16:42.909267 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa7a01-2fa9-43ad-bd5f-29c79f044ec0 service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:42.909546 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa7a01-2fa9-43ad-bd5f-29c79f044ec0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:42.909818 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa7a01-2fa9-43ad-bd5f-29c79f044ec0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:42.919278 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa7a01-2fa9-43ad-bd5f-29c79f044ec0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:16:42.921420 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa7a01-2fa9-43ad-bd5f-29c79f044ec0 service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:16:42.931013 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1413/2818] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:16:42 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:16:47.252936 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=23 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:16:52.926663 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:16:53.490698 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aac4fc-ba75-4fbf-ab27-d93e50f4b974 service cinder] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:16:53.492138 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-81aac4fc-ba75-4fbf-ab27-d93e50f4b974 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:16:53.565543 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aac4fc-ba75-4fbf-ab27-d93e50f4b974 service cinder] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:16:53.571050 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f0e614-babd-4c14-bf9b-270d92f98b5f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5a91437dd64e2491ce41b4d12d4835', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:16:53.571861 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0e614-babd-4c14-bf9b-270d92f98b5f service placement] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:16:53.572279 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0e614-babd-4c14-bf9b-270d92f98b5f service placement] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:16:53.572663 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f0e614-babd-4c14-bf9b-270d92f98b5f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:16:53.574645 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-65f0e614-babd-4c14-bf9b-270d92f98b5f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:16:53.587410 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0e614-babd-4c14-bf9b-270d92f98b5f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:16:53.589062 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f0e614-babd-4c14-bf9b-270d92f98b5f service placement] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:16:53.601803 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1406/2819] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:16:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:17:03.596262 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=32 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:17:10.777794 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa7a01-2fa9-43ad-bd5f-29c79f044ec0 service cinder] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:10.839827 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa7a01-2fa9-43ad-bd5f-29c79f044ec0 service cinder] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:10.844339 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe98a1-4463-4f31-b8dc-a2a961a15e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:10.845199 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe98a1-4463-4f31-b8dc-a2a961a15e67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:10.845481 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe98a1-4463-4f31-b8dc-a2a961a15e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:10.845756 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe98a1-4463-4f31-b8dc-a2a961a15e67 admin admin] PATH_INFO: `/v3/users/afa6f7afcd20405a820c03372bbf72d4` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:10.846932 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe98a1-4463-4f31-b8dc-a2a961a15e67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afa6f7afcd20405a820c03372bbf72d4)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:10.848950 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe98a1-4463-4f31-b8dc-a2a961a15e67 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:10.895813 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-a6fe98a1-4463-4f31-b8dc-a2a961a15e67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afa6f7afcd20405a820c03372bbf72d4'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:10.903400 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-a6fe98a1-4463-4f31-b8dc-a2a961a15e67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afa6f7afcd20405a820c03372bbf72d4'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:10.904107 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-a6fe98a1-4463-4f31-b8dc-a2a961a15e67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afa6f7afcd20405a820c03372bbf72d4'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:10.916305 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-a6fe98a1-4463-4f31-b8dc-a2a961a15e67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afa6f7afcd20405a820c03372bbf72d4'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:10.923756 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-a6fe98a1-4463-4f31-b8dc-a2a961a15e67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afa6f7afcd20405a820c03372bbf72d4'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:10.930407 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1414/2820] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:17:10 2022] DELETE /identity/v3/users/afa6f7afcd20405a820c03372bbf72d4 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:17:10.934872 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb91e04-43ea-4632-885c-d26b718e4a9c None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:10.935331 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb91e04-43ea-4632-885c-d26b718e4a9c None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:10.935464 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb91e04-43ea-4632-885c-d26b718e4a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:10.952224 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-9cb91e04-43ea-4632-885c-d26b718e4a9c None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:17:10.953427 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-9cb91e04-43ea-4632-885c-d26b718e4a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:17:11.012270 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1407/2821] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:17:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:17:11.021889 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe98a1-4463-4f31-b8dc-a2a961a15e67 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:11.023393 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-a6fe98a1-4463-4f31-b8dc-a2a961a15e67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:17:11.082661 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe98a1-4463-4f31-b8dc-a2a961a15e67 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:11.086386 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27146342-5d78-4962-9e83-31788519843b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:11.087027 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27146342-5d78-4962-9e83-31788519843b service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:11.087309 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27146342-5d78-4962-9e83-31788519843b service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:11.087623 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27146342-5d78-4962-9e83-31788519843b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:11.098084 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27146342-5d78-4962-9e83-31788519843b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:11.099560 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27146342-5d78-4962-9e83-31788519843b service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:11.109465 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1415/2822] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:17:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:17:11.387142 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb91e04-43ea-4632-885c-d26b718e4a9c None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:11.388649 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-9cb91e04-43ea-4632-885c-d26b718e4a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:17:11.401114 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb91e04-43ea-4632-885c-d26b718e4a9c None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:11.406060 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38381d8a-da7a-460e-af2a-fc946087cce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:11.407012 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38381d8a-da7a-460e-af2a-fc946087cce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:11.407203 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38381d8a-da7a-460e-af2a-fc946087cce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:11.407480 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38381d8a-da7a-460e-af2a-fc946087cce7 admin admin] PATH_INFO: `/v3/projects/22b34cdfa04149139f7aa2556e1577e4` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:11.408709 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38381d8a-da7a-460e-af2a-fc946087cce7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22b34cdfa04149139f7aa2556e1577e4)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:11.411258 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38381d8a-da7a-460e-af2a-fc946087cce7 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:11.457596 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-38381d8a-da7a-460e-af2a-fc946087cce7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22b34cdfa04149139f7aa2556e1577e4', 'request_id': 'req-38381d8a-da7a-460e-af2a-fc946087cce7'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:11.462999 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-38381d8a-da7a-460e-af2a-fc946087cce7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22b34cdfa04149139f7aa2556e1577e4', 'request_id': 'req-38381d8a-da7a-460e-af2a-fc946087cce7'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:11.470108 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-38381d8a-da7a-460e-af2a-fc946087cce7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22b34cdfa04149139f7aa2556e1577e4', 'request_id': 'req-38381d8a-da7a-460e-af2a-fc946087cce7'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:11.481793 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-38381d8a-da7a-460e-af2a-fc946087cce7 admin admin] The token cache is being invalidate because project 22b34cdfa04149139f7aa2556e1577e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:17:11.482077 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-38381d8a-da7a-460e-af2a-fc946087cce7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:11.482696 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-38381d8a-da7a-460e-af2a-fc946087cce7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:11.484237 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1408/2823] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:17:11 2022] DELETE /identity/v3/projects/22b34cdfa04149139f7aa2556e1577e4 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:17:11.488165 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27146342-5d78-4962-9e83-31788519843b service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:11.497563 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27146342-5d78-4962-9e83-31788519843b service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:11.515033 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:17:11.555049 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2287356d-801b-484a-b8bb-d8cf647f2275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:11.555950 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287356d-801b-484a-b8bb-d8cf647f2275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:11.556228 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287356d-801b-484a-b8bb-d8cf647f2275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:11.556497 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287356d-801b-484a-b8bb-d8cf647f2275 admin admin] PATH_INFO: `/v3/users/63437985f2b34466a7c5ed2be9c9fd12` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:11.557673 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2287356d-801b-484a-b8bb-d8cf647f2275 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63437985f2b34466a7c5ed2be9c9fd12)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:11.559634 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2287356d-801b-484a-b8bb-d8cf647f2275 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:11.606077 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-2287356d-801b-484a-b8bb-d8cf647f2275 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63437985f2b34466a7c5ed2be9c9fd12'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:11.613229 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-2287356d-801b-484a-b8bb-d8cf647f2275 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63437985f2b34466a7c5ed2be9c9fd12'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:11.613932 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-2287356d-801b-484a-b8bb-d8cf647f2275 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63437985f2b34466a7c5ed2be9c9fd12'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:11.626796 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-2287356d-801b-484a-b8bb-d8cf647f2275 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63437985f2b34466a7c5ed2be9c9fd12'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:11.634213 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-2287356d-801b-484a-b8bb-d8cf647f2275 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63437985f2b34466a7c5ed2be9c9fd12'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:11.640691 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1416/2824] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:17:11 2022] DELETE /identity/v3/users/63437985f2b34466a7c5ed2be9c9fd12 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:17:11.904021 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38381d8a-da7a-460e-af2a-fc946087cce7 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:11.905451 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-38381d8a-da7a-460e-af2a-fc946087cce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:17:11.920460 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38381d8a-da7a-460e-af2a-fc946087cce7 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:11.977705 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d84c2-886b-423c-97f4-0fdf92b8573d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:11.978555 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d84c2-886b-423c-97f4-0fdf92b8573d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:11.978841 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d84c2-886b-423c-97f4-0fdf92b8573d admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:11.979321 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d84c2-886b-423c-97f4-0fdf92b8573d admin admin] PATH_INFO: `/v3/projects/6e1a67c09b3348c4be9387497a9e533c` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:11.980522 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d84c2-886b-423c-97f4-0fdf92b8573d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e1a67c09b3348c4be9387497a9e533c)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:11.982459 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d84c2-886b-423c-97f4-0fdf92b8573d admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:12.013580 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:17:12.031872 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-516d84c2-886b-423c-97f4-0fdf92b8573d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e1a67c09b3348c4be9387497a9e533c', 'request_id': 'req-516d84c2-886b-423c-97f4-0fdf92b8573d'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:12.037389 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-516d84c2-886b-423c-97f4-0fdf92b8573d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e1a67c09b3348c4be9387497a9e533c', 'request_id': 'req-516d84c2-886b-423c-97f4-0fdf92b8573d'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:12.044522 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-516d84c2-886b-423c-97f4-0fdf92b8573d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e1a67c09b3348c4be9387497a9e533c', 'request_id': 'req-516d84c2-886b-423c-97f4-0fdf92b8573d'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:12.056061 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-516d84c2-886b-423c-97f4-0fdf92b8573d admin admin] The token cache is being invalidate because project 6e1a67c09b3348c4be9387497a9e533c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:17:12.056344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-516d84c2-886b-423c-97f4-0fdf92b8573d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:12.056957 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-516d84c2-886b-423c-97f4-0fdf92b8573d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:12.058462 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1409/2825] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:17:11 2022] DELETE /identity/v3/projects/6e1a67c09b3348c4be9387497a9e533c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:17:12.063518 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befefb2-d37c-4094-a172-85efb76cfad0 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:12.063985 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befefb2-d37c-4094-a172-85efb76cfad0 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:12.064151 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befefb2-d37c-4094-a172-85efb76cfad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:12.082625 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-1befefb2-d37c-4094-a172-85efb76cfad0 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:17:12.083858 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-1befefb2-d37c-4094-a172-85efb76cfad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:17:12.142639 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1417/2826] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:17:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:17:12.150570 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac0712-1434-473d-b423-30c622e6ac59 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:12.150859 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac0712-1434-473d-b423-30c622e6ac59 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:12.151140 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac0712-1434-473d-b423-30c622e6ac59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:12.169676 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-1dac0712-1434-473d-b423-30c622e6ac59 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:17:12.170879 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-1dac0712-1434-473d-b423-30c622e6ac59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:17:12.179246 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1410/2827] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:17:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:17:12.183261 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befefb2-d37c-4094-a172-85efb76cfad0 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:12.193541 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befefb2-d37c-4094-a172-85efb76cfad0 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:12.198102 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00cb32-b1a0-4c3d-a2a4-788913f4404f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:12.198744 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00cb32-b1a0-4c3d-a2a4-788913f4404f admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:12.199028 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00cb32-b1a0-4c3d-a2a4-788913f4404f admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:12.199307 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00cb32-b1a0-4c3d-a2a4-788913f4404f admin admin] PATH_INFO: `/v3/domains` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:12.200059 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00cb32-b1a0-4c3d-a2a4-788913f4404f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80110) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:17:12.200367 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00cb32-b1a0-4c3d-a2a4-788913f4404f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:12.201957 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00cb32-b1a0-4c3d-a2a4-788913f4404f admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:12.213245 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1418/2828] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 12:17:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:17:12.217284 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac0712-1434-473d-b423-30c622e6ac59 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:12.226482 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac0712-1434-473d-b423-30c622e6ac59 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:12.231068 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2754a95-a073-4b0d-b993-2bc266a301cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:12.231749 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2754a95-a073-4b0d-b993-2bc266a301cb admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:12.232038 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2754a95-a073-4b0d-b993-2bc266a301cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:12.232317 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2754a95-a073-4b0d-b993-2bc266a301cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:12.233002 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2754a95-a073-4b0d-b993-2bc266a301cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:12.234920 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2754a95-a073-4b0d-b993-2bc266a301cb admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:12.261671 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1411/2829] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 12:17:12 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:17:12.265736 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00cb32-b1a0-4c3d-a2a4-788913f4404f admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:12.275897 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00cb32-b1a0-4c3d-a2a4-788913f4404f admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:12.301637 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:17:12.335290 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39b0d5-0356-4fe6-9c90-3b82c220f51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:12.336010 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39b0d5-0356-4fe6-9c90-3b82c220f51b admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:12.336296 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39b0d5-0356-4fe6-9c90-3b82c220f51b admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:12.336571 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39b0d5-0356-4fe6-9c90-3b82c220f51b admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:12.337254 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b39b0d5-0356-4fe6-9c90-3b82c220f51b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:12.339158 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b39b0d5-0356-4fe6-9c90-3b82c220f51b admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:12.360730 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1419/2830] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 12:17:12 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:17:12.365316 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2754a95-a073-4b0d-b993-2bc266a301cb admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:12.376008 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2754a95-a073-4b0d-b993-2bc266a301cb admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:12.381689 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec0ff1a-30cf-4745-b6ce-197a3d245893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:12.382351 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0ff1a-30cf-4745-b6ce-197a3d245893 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:12.382641 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0ff1a-30cf-4745-b6ce-197a3d245893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:12.382921 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0ff1a-30cf-4745-b6ce-197a3d245893 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:12.383685 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec0ff1a-30cf-4745-b6ce-197a3d245893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:12.385278 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec0ff1a-30cf-4745-b6ce-197a3d245893 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:12.395970 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1412/2831] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:17:12.399791 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39b0d5-0356-4fe6-9c90-3b82c220f51b admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:12.410446 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39b0d5-0356-4fe6-9c90-3b82c220f51b admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:12.415054 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89efdc31-34fd-4f22-a1d7-962ceb1ae2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:12.415736 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89efdc31-34fd-4f22-a1d7-962ceb1ae2f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:12.416019 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89efdc31-34fd-4f22-a1d7-962ceb1ae2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:12.416296 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89efdc31-34fd-4f22-a1d7-962ceb1ae2f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:12.417015 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89efdc31-34fd-4f22-a1d7-962ceb1ae2f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:12.418588 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89efdc31-34fd-4f22-a1d7-962ceb1ae2f2 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:12.428927 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1420/2832] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:17:12.432892 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec0ff1a-30cf-4745-b6ce-197a3d245893 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:12.443182 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec0ff1a-30cf-4745-b6ce-197a3d245893 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:12.447816 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ffd3d9-3dcd-41b1-9325-b6a8b0fe6f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:12.448693 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffd3d9-3dcd-41b1-9325-b6a8b0fe6f4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:12.448981 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffd3d9-3dcd-41b1-9325-b6a8b0fe6f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:12.449262 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffd3d9-3dcd-41b1-9325-b6a8b0fe6f4b admin admin] PATH_INFO: `/v3/projects/ab03d2b8cdc54c1fb82d1b17527f881f/users/6ebdfe22a0954aceb1fa9739d11fe837/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:12.463672 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ffd3d9-3dcd-41b1-9325-b6a8b0fe6f4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab03d2b8cdc54c1fb82d1b17527f881f, user_id=6ebdfe22a0954aceb1fa9739d11fe837, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:12.466320 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ffd3d9-3dcd-41b1-9325-b6a8b0fe6f4b admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:12.479882 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1413/2833] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:17:12 2022] PUT /identity/v3/projects/ab03d2b8cdc54c1fb82d1b17527f881f/users/6ebdfe22a0954aceb1fa9739d11fe837/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:17:12.539945 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5d45f-fa2e-4dce-92af-0c30e507bf20 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:12.540234 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5d45f-fa2e-4dce-92af-0c30e507bf20 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:12.540560 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5d45f-fa2e-4dce-92af-0c30e507bf20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:12.566957 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-e6d5d45f-fa2e-4dce-92af-0c30e507bf20 None None] MFA Rules not processed for user `6ebdfe22a0954aceb1fa9739d11fe837`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:17:12.568111 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-e6d5d45f-fa2e-4dce-92af-0c30e507bf20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:17:12.630375 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1421/2834] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:17:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:17:12.634820 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ffd3d9-3dcd-41b1-9325-b6a8b0fe6f4b admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:12.695236 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ffd3d9-3dcd-41b1-9325-b6a8b0fe6f4b admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:12.699844 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b0bc5-88f9-4a3b-b269-217dcc13137d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:12.700494 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b0bc5-88f9-4a3b-b269-217dcc13137d admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:12.700778 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b0bc5-88f9-4a3b-b269-217dcc13137d admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:12.701052 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b0bc5-88f9-4a3b-b269-217dcc13137d admin admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:12.701738 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b0bc5-88f9-4a3b-b269-217dcc13137d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:12.703652 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b0bc5-88f9-4a3b-b269-217dcc13137d admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:12.728640 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1414/2835] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 12:17:12 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 12:17:12.732659 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5d45f-fa2e-4dce-92af-0c30e507bf20 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:12.744728 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5d45f-fa2e-4dce-92af-0c30e507bf20 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:12.803991 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68f40c-a62d-4ca8-b690-9dd0399a1c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:12.804650 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68f40c-a62d-4ca8-b690-9dd0399a1c42 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:12.804931 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68f40c-a62d-4ca8-b690-9dd0399a1c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:12.805204 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68f40c-a62d-4ca8-b690-9dd0399a1c42 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:12.805883 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f68f40c-a62d-4ca8-b690-9dd0399a1c42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:12.807902 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f68f40c-a62d-4ca8-b690-9dd0399a1c42 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:12.827238 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1422/2836] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 12:17:12 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:17:12.831289 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b0bc5-88f9-4a3b-b269-217dcc13137d admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:12.843045 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b0bc5-88f9-4a3b-b269-217dcc13137d admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:12.848268 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a05c03-04e9-45e8-b613-8c7f92d4ee1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:12.848916 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a05c03-04e9-45e8-b613-8c7f92d4ee1a admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:12.849201 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a05c03-04e9-45e8-b613-8c7f92d4ee1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:12.849470 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a05c03-04e9-45e8-b613-8c7f92d4ee1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:12.850181 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a05c03-04e9-45e8-b613-8c7f92d4ee1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:12.852140 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a05c03-04e9-45e8-b613-8c7f92d4ee1a admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:12.862377 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1415/2837] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:17:12.866410 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68f40c-a62d-4ca8-b690-9dd0399a1c42 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:12.876719 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68f40c-a62d-4ca8-b690-9dd0399a1c42 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:12.881370 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a9d45-7589-4457-b79d-29c930aaaee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:12.882016 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a9d45-7589-4457-b79d-29c930aaaee8 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:12.882300 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a9d45-7589-4457-b79d-29c930aaaee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:12.882579 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a9d45-7589-4457-b79d-29c930aaaee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:12.883297 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a9d45-7589-4457-b79d-29c930aaaee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:12.884917 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a9d45-7589-4457-b79d-29c930aaaee8 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:12.895259 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1423/2838] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:17:12.902669 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a05c03-04e9-45e8-b613-8c7f92d4ee1a admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:12.913300 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a05c03-04e9-45e8-b613-8c7f92d4ee1a admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:12.917895 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d45478-d4f8-496a-bfb4-f387934a8a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:12.918770 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d45478-d4f8-496a-bfb4-f387934a8a2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:12.919055 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d45478-d4f8-496a-bfb4-f387934a8a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:12.919355 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d45478-d4f8-496a-bfb4-f387934a8a2f admin admin] PATH_INFO: `/v3/projects/f3003c3458734b34a4079f9af86a2d98/users/6d7a9a77771a48d8a154a9a111717ecb/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:12.933609 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d45478-d4f8-496a-bfb4-f387934a8a2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3003c3458734b34a4079f9af86a2d98, user_id=6d7a9a77771a48d8a154a9a111717ecb, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:12.936302 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d45478-d4f8-496a-bfb4-f387934a8a2f admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:12.945057 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:17:12.950883 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1416/2839] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:17:12 2022] PUT /identity/v3/projects/f3003c3458734b34a4079f9af86a2d98/users/6d7a9a77771a48d8a154a9a111717ecb/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:17:12.961752 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb7cbd-1625-4a84-ba51-6b4fdfb91bc8 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:12.962050 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb7cbd-1625-4a84-ba51-6b4fdfb91bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:12.962328 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb7cbd-1625-4a84-ba51-6b4fdfb91bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:12.988900 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-12fb7cbd-1625-4a84-ba51-6b4fdfb91bc8 None None] MFA Rules not processed for user `6d7a9a77771a48d8a154a9a111717ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:17:12.990378 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-12fb7cbd-1625-4a84-ba51-6b4fdfb91bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:17:12.994685 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:17:13.060498 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1424/2840] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:17:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:17:13.065082 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d45478-d4f8-496a-bfb4-f387934a8a2f admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:13.126391 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d45478-d4f8-496a-bfb4-f387934a8a2f admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:13.130966 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272aa11-e2b2-43e0-ac67-c79347a61e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:13.131657 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272aa11-e2b2-43e0-ac67-c79347a61e84 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:13.131942 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272aa11-e2b2-43e0-ac67-c79347a61e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:13.132218 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272aa11-e2b2-43e0-ac67-c79347a61e84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:13.132904 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e272aa11-e2b2-43e0-ac67-c79347a61e84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:13.134802 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e272aa11-e2b2-43e0-ac67-c79347a61e84 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:13.160984 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1417/2841] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 12:17:13 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:17:13.165021 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb7cbd-1625-4a84-ba51-6b4fdfb91bc8 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:13.175632 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb7cbd-1625-4a84-ba51-6b4fdfb91bc8 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:13.231546 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9484d56-f41f-45cc-b061-671eee0f7e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:13.232203 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9484d56-f41f-45cc-b061-671eee0f7e07 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:13.232484 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9484d56-f41f-45cc-b061-671eee0f7e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:13.232756 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9484d56-f41f-45cc-b061-671eee0f7e07 admin admin] PATH_INFO: `/v3/users` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:13.233438 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9484d56-f41f-45cc-b061-671eee0f7e07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:13.235335 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9484d56-f41f-45cc-b061-671eee0f7e07 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:13.255244 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1425/2842] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 12:17:13 2022] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:17:13.259249 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272aa11-e2b2-43e0-ac67-c79347a61e84 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:13.269956 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272aa11-e2b2-43e0-ac67-c79347a61e84 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:13.274766 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb9794-6d4b-4bf9-9719-02a9dce880ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:13.275426 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb9794-6d4b-4bf9-9719-02a9dce880ea admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:13.275756 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb9794-6d4b-4bf9-9719-02a9dce880ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:13.276034 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb9794-6d4b-4bf9-9719-02a9dce880ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:13.277115 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb9794-6d4b-4bf9-9719-02a9dce880ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:13.278844 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb9794-6d4b-4bf9-9719-02a9dce880ea admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:13.289397 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1418/2843] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 12:17:13.293325 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9484d56-f41f-45cc-b061-671eee0f7e07 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:13.303237 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9484d56-f41f-45cc-b061-671eee0f7e07 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:13.307898 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3952e23a-53d0-41e4-9684-4d7987f1bfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:13.308761 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952e23a-53d0-41e4-9684-4d7987f1bfb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:13.309049 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952e23a-53d0-41e4-9684-4d7987f1bfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:13.309329 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952e23a-53d0-41e4-9684-4d7987f1bfb7 admin admin] PATH_INFO: `/v3/projects/a38f60b376264416a942b282fc241fb2/users/7224ac4426774c76ae076ec318dbad60/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:13.324941 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3952e23a-53d0-41e4-9684-4d7987f1bfb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a38f60b376264416a942b282fc241fb2, user_id=7224ac4426774c76ae076ec318dbad60, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:13.327621 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3952e23a-53d0-41e4-9684-4d7987f1bfb7 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:13.340333 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1426/2844] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:17:13 2022] PUT /identity/v3/projects/a38f60b376264416a942b282fc241fb2/users/7224ac4426774c76ae076ec318dbad60/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:17:13.344193 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb9794-6d4b-4bf9-9719-02a9dce880ea admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:13.354212 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb9794-6d4b-4bf9-9719-02a9dce880ea admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:13.409994 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016d3ec-d526-4cc6-92ab-349a94ae5b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:13.410601 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016d3ec-d526-4cc6-92ab-349a94ae5b44 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:13.410864 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016d3ec-d526-4cc6-92ab-349a94ae5b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:13.411135 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016d3ec-d526-4cc6-92ab-349a94ae5b44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:13.411885 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1016d3ec-d526-4cc6-92ab-349a94ae5b44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:13.413476 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1016d3ec-d526-4cc6-92ab-349a94ae5b44 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:13.423107 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1419/2845] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:17:13.427241 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3952e23a-53d0-41e4-9684-4d7987f1bfb7 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:13.437535 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3952e23a-53d0-41e4-9684-4d7987f1bfb7 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:13.442698 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1f1d1-0ec9-4455-bc35-8c704c7e585d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:13.443593 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1f1d1-0ec9-4455-bc35-8c704c7e585d admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:13.443880 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1f1d1-0ec9-4455-bc35-8c704c7e585d admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:13.444159 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1f1d1-0ec9-4455-bc35-8c704c7e585d admin admin] PATH_INFO: `/v3/projects/a38f60b376264416a942b282fc241fb2/users/7224ac4426774c76ae076ec318dbad60/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:13.446120 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1f1d1-0ec9-4455-bc35-8c704c7e585d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a38f60b376264416a942b282fc241fb2, user_id=7224ac4426774c76ae076ec318dbad60, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:13.448796 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1f1d1-0ec9-4455-bc35-8c704c7e585d admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:13.459429 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1427/2846] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:17:13 2022] PUT /identity/v3/projects/a38f60b376264416a942b282fc241fb2/users/7224ac4426774c76ae076ec318dbad60/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:17:13.470516 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d111f6-0dab-42af-bc04-02411cd8f696 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:13.470811 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d111f6-0dab-42af-bc04-02411cd8f696 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:13.471094 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d111f6-0dab-42af-bc04-02411cd8f696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:13.497607 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-79d111f6-0dab-42af-bc04-02411cd8f696 None None] MFA Rules not processed for user `7224ac4426774c76ae076ec318dbad60`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:17:13.498807 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-79d111f6-0dab-42af-bc04-02411cd8f696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:17:13.557961 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:17:13.568563 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1420/2847] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:17:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:17:13.579573 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1f1d1-0ec9-4455-bc35-8c704c7e585d admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:13.581337 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-e0b1f1d1-0ec9-4455-bc35-8c704c7e585d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:17:13.637978 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1f1d1-0ec9-4455-bc35-8c704c7e585d admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:13.641563 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5d9cb-3900-4328-aa7c-1857e27f91de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:13.642188 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5d9cb-3900-4328-aa7c-1857e27f91de service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:13.642493 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5d9cb-3900-4328-aa7c-1857e27f91de service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:13.642767 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5d9cb-3900-4328-aa7c-1857e27f91de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:13.652514 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:17:13.700437 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b5d9cb-3900-4328-aa7c-1857e27f91de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:13.701808 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b5d9cb-3900-4328-aa7c-1857e27f91de service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:13.710859 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1428/2848] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:17:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 03 12:17:15.174754 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d111f6-0dab-42af-bc04-02411cd8f696 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:15.176172 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-79d111f6-0dab-42af-bc04-02411cd8f696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:17:15.188116 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d111f6-0dab-42af-bc04-02411cd8f696 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:15.191632 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757e882-5f3e-4c6a-a229-b22de84fddc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:15.192264 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757e882-5f3e-4c6a-a229-b22de84fddc7 service cinder] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:15.192545 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757e882-5f3e-4c6a-a229-b22de84fddc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:15.192817 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757e882-5f3e-4c6a-a229-b22de84fddc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:15.248639 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757e882-5f3e-4c6a-a229-b22de84fddc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:15.250066 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757e882-5f3e-4c6a-a229-b22de84fddc7 service cinder] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:15.258832 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1421/2849] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:17:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:17:15.778835 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5d9cb-3900-4328-aa7c-1857e27f91de service cinder] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:15.787798 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5d9cb-3900-4328-aa7c-1857e27f91de service cinder] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:15.791379 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ec5ba-cedc-4997-a45a-4865ddc9b065 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:15.792045 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ec5ba-cedc-4997-a45a-4865ddc9b065 service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:15.792326 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ec5ba-cedc-4997-a45a-4865ddc9b065 service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:15.792602 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ec5ba-cedc-4997-a45a-4865ddc9b065 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:15.802158 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ec5ba-cedc-4997-a45a-4865ddc9b065 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:15.803680 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ec5ba-cedc-4997-a45a-4865ddc9b065 service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:15.813112 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1429/2850] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:17:15 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:17:19.637996 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757e882-5f3e-4c6a-a229-b22de84fddc7 service cinder] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:19.698985 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757e882-5f3e-4c6a-a229-b22de84fddc7 service cinder] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:19.703481 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4fc2ad-348c-4e1c-ba89-97c8d38eef5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:19.704368 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fc2ad-348c-4e1c-ba89-97c8d38eef5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:19.704651 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fc2ad-348c-4e1c-ba89-97c8d38eef5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:19.704925 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fc2ad-348c-4e1c-ba89-97c8d38eef5b admin admin] PATH_INFO: `/v3/users/6ebdfe22a0954aceb1fa9739d11fe837` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:19.706097 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4fc2ad-348c-4e1c-ba89-97c8d38eef5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ebdfe22a0954aceb1fa9739d11fe837)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:19.708583 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4fc2ad-348c-4e1c-ba89-97c8d38eef5b admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:19.752799 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-af4fc2ad-348c-4e1c-ba89-97c8d38eef5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ebdfe22a0954aceb1fa9739d11fe837'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:19.753438 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-af4fc2ad-348c-4e1c-ba89-97c8d38eef5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ebdfe22a0954aceb1fa9739d11fe837'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:19.764990 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-af4fc2ad-348c-4e1c-ba89-97c8d38eef5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ebdfe22a0954aceb1fa9739d11fe837'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:19.772211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-af4fc2ad-348c-4e1c-ba89-97c8d38eef5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ebdfe22a0954aceb1fa9739d11fe837'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:19.779537 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-af4fc2ad-348c-4e1c-ba89-97c8d38eef5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ebdfe22a0954aceb1fa9739d11fe837'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:19.786714 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1422/2851] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:17:19 2022] DELETE /identity/v3/users/6ebdfe22a0954aceb1fa9739d11fe837 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:17:19.791355 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f63b3-2ab3-48b3-9943-1af18bad6c38 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:19.791868 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f63b3-2ab3-48b3-9943-1af18bad6c38 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:19.791969 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f63b3-2ab3-48b3-9943-1af18bad6c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:19.809000 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-3b7f63b3-2ab3-48b3-9943-1af18bad6c38 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:17:19.810182 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-3b7f63b3-2ab3-48b3-9943-1af18bad6c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:17:19.867203 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1430/2852] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:17:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:17:19.876795 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4fc2ad-348c-4e1c-ba89-97c8d38eef5b admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:19.878208 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-af4fc2ad-348c-4e1c-ba89-97c8d38eef5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:17:19.892455 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:17:19.937888 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4fc2ad-348c-4e1c-ba89-97c8d38eef5b admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:19.942077 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9b12f-5cf8-4199-b7cd-38c7ba6901fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:19.942722 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9b12f-5cf8-4199-b7cd-38c7ba6901fc service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:19.943008 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9b12f-5cf8-4199-b7cd-38c7ba6901fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:19.943286 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9b12f-5cf8-4199-b7cd-38c7ba6901fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:19.952343 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d9b12f-5cf8-4199-b7cd-38c7ba6901fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:19.953816 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d9b12f-5cf8-4199-b7cd-38c7ba6901fc service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:19.963995 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1423/2853] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:17:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:17:20.223649 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f63b3-2ab3-48b3-9943-1af18bad6c38 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:20.225095 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-3b7f63b3-2ab3-48b3-9943-1af18bad6c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:17:20.237089 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f63b3-2ab3-48b3-9943-1af18bad6c38 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:20.241668 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef96dbf-825c-4ea0-b24b-91e67708fd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:20.242532 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef96dbf-825c-4ea0-b24b-91e67708fd87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:20.242816 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef96dbf-825c-4ea0-b24b-91e67708fd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:20.243093 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef96dbf-825c-4ea0-b24b-91e67708fd87 admin admin] PATH_INFO: `/v3/projects/ab03d2b8cdc54c1fb82d1b17527f881f` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:20.245513 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef96dbf-825c-4ea0-b24b-91e67708fd87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab03d2b8cdc54c1fb82d1b17527f881f)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:20.247558 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef96dbf-825c-4ea0-b24b-91e67708fd87 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:20.295714 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1ef96dbf-825c-4ea0-b24b-91e67708fd87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab03d2b8cdc54c1fb82d1b17527f881f', 'request_id': 'req-1ef96dbf-825c-4ea0-b24b-91e67708fd87'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:20.301750 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1ef96dbf-825c-4ea0-b24b-91e67708fd87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab03d2b8cdc54c1fb82d1b17527f881f', 'request_id': 'req-1ef96dbf-825c-4ea0-b24b-91e67708fd87'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:20.308392 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1ef96dbf-825c-4ea0-b24b-91e67708fd87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab03d2b8cdc54c1fb82d1b17527f881f', 'request_id': 'req-1ef96dbf-825c-4ea0-b24b-91e67708fd87'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:20.320350 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1ef96dbf-825c-4ea0-b24b-91e67708fd87 admin admin] The token cache is being invalidate because project ab03d2b8cdc54c1fb82d1b17527f881f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:17:20.320638 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1ef96dbf-825c-4ea0-b24b-91e67708fd87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:20.321252 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-1ef96dbf-825c-4ea0-b24b-91e67708fd87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:20.322764 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1431/2854] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:17:20 2022] DELETE /identity/v3/projects/ab03d2b8cdc54c1fb82d1b17527f881f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:17:20.326695 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9b12f-5cf8-4199-b7cd-38c7ba6901fc service neutron] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:20.336187 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9b12f-5cf8-4199-b7cd-38c7ba6901fc service neutron] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:20.392788 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf56be-7e13-4c55-ba30-09f16c6f3f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:20.393697 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf56be-7e13-4c55-ba30-09f16c6f3f52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:20.393982 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf56be-7e13-4c55-ba30-09f16c6f3f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:20.394268 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf56be-7e13-4c55-ba30-09f16c6f3f52 admin admin] PATH_INFO: `/v3/users/6d7a9a77771a48d8a154a9a111717ecb` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:20.395455 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccf56be-7e13-4c55-ba30-09f16c6f3f52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d7a9a77771a48d8a154a9a111717ecb)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:20.397418 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccf56be-7e13-4c55-ba30-09f16c6f3f52 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:20.444448 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-cccf56be-7e13-4c55-ba30-09f16c6f3f52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d7a9a77771a48d8a154a9a111717ecb'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:20.445057 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-cccf56be-7e13-4c55-ba30-09f16c6f3f52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d7a9a77771a48d8a154a9a111717ecb'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:20.456770 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-cccf56be-7e13-4c55-ba30-09f16c6f3f52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d7a9a77771a48d8a154a9a111717ecb'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:20.463521 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-cccf56be-7e13-4c55-ba30-09f16c6f3f52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d7a9a77771a48d8a154a9a111717ecb'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:20.472103 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-cccf56be-7e13-4c55-ba30-09f16c6f3f52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d7a9a77771a48d8a154a9a111717ecb'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:20.478129 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1424/2855] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:17:20 2022] DELETE /identity/v3/users/6d7a9a77771a48d8a154a9a111717ecb => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:17:20.741009 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef96dbf-825c-4ea0-b24b-91e67708fd87 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:20.742560 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-1ef96dbf-825c-4ea0-b24b-91e67708fd87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:17:20.755634 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef96dbf-825c-4ea0-b24b-91e67708fd87 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:20.774900 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:17:20.816496 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2fabe-9963-4deb-8731-8fd8dc2c25ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:20.817354 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2fabe-9963-4deb-8731-8fd8dc2c25ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:20.817639 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2fabe-9963-4deb-8731-8fd8dc2c25ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:20.817915 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2fabe-9963-4deb-8731-8fd8dc2c25ae admin admin] PATH_INFO: `/v3/projects/f3003c3458734b34a4079f9af86a2d98` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:20.819080 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe2fabe-9963-4deb-8731-8fd8dc2c25ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3003c3458734b34a4079f9af86a2d98)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:20.821057 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe2fabe-9963-4deb-8731-8fd8dc2c25ae admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:20.867229 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-afe2fabe-9963-4deb-8731-8fd8dc2c25ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3003c3458734b34a4079f9af86a2d98', 'request_id': 'req-afe2fabe-9963-4deb-8731-8fd8dc2c25ae'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:20.872746 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-afe2fabe-9963-4deb-8731-8fd8dc2c25ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3003c3458734b34a4079f9af86a2d98', 'request_id': 'req-afe2fabe-9963-4deb-8731-8fd8dc2c25ae'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:20.879461 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-afe2fabe-9963-4deb-8731-8fd8dc2c25ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3003c3458734b34a4079f9af86a2d98', 'request_id': 'req-afe2fabe-9963-4deb-8731-8fd8dc2c25ae'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:20.890504 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-afe2fabe-9963-4deb-8731-8fd8dc2c25ae admin admin] The token cache is being invalidate because project f3003c3458734b34a4079f9af86a2d98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:17:20.890791 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-afe2fabe-9963-4deb-8731-8fd8dc2c25ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:20.891444 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-afe2fabe-9963-4deb-8731-8fd8dc2c25ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:20.893044 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1432/2856] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:17:20 2022] DELETE /identity/v3/projects/f3003c3458734b34a4079f9af86a2d98 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 12:17:20.897205 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf56be-7e13-4c55-ba30-09f16c6f3f52 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:20.898643 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-cccf56be-7e13-4c55-ba30-09f16c6f3f52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:17:20.912171 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf56be-7e13-4c55-ba30-09f16c6f3f52 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:20.943997 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:17:20.969575 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2bc9e-44bc-452d-8c05-9eb792fe31eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:20.970443 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2bc9e-44bc-452d-8c05-9eb792fe31eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:20.970725 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2bc9e-44bc-452d-8c05-9eb792fe31eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:20.970998 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2bc9e-44bc-452d-8c05-9eb792fe31eb admin admin] PATH_INFO: `/v3/users/7224ac4426774c76ae076ec318dbad60` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:20.972696 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd2bc9e-44bc-452d-8c05-9eb792fe31eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7224ac4426774c76ae076ec318dbad60)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:20.974635 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd2bc9e-44bc-452d-8c05-9eb792fe31eb admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:21.018197 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-0fd2bc9e-44bc-452d-8c05-9eb792fe31eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7224ac4426774c76ae076ec318dbad60'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:21.019322 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-0fd2bc9e-44bc-452d-8c05-9eb792fe31eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7224ac4426774c76ae076ec318dbad60'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:21.031598 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-0fd2bc9e-44bc-452d-8c05-9eb792fe31eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7224ac4426774c76ae076ec318dbad60'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:21.039046 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-0fd2bc9e-44bc-452d-8c05-9eb792fe31eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7224ac4426774c76ae076ec318dbad60'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:21.046098 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-0fd2bc9e-44bc-452d-8c05-9eb792fe31eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7224ac4426774c76ae076ec318dbad60'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:21.052528 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1425/2857] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:17:20 2022] DELETE /identity/v3/users/7224ac4426774c76ae076ec318dbad60 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:17:21.319495 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2fabe-9963-4deb-8731-8fd8dc2c25ae admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:21.321021 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-afe2fabe-9963-4deb-8731-8fd8dc2c25ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:17:21.337483 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2fabe-9963-4deb-8731-8fd8dc2c25ae admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:21.395292 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7d96c-4c60-4653-be41-7e83ca42f6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:21.396174 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7d96c-4c60-4653-be41-7e83ca42f6f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:21.396460 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7d96c-4c60-4653-be41-7e83ca42f6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:21.396739 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7d96c-4c60-4653-be41-7e83ca42f6f5 admin admin] PATH_INFO: `/v3/projects/a38f60b376264416a942b282fc241fb2` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:21.397915 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf7d96c-4c60-4653-be41-7e83ca42f6f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a38f60b376264416a942b282fc241fb2)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:21.399857 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf7d96c-4c60-4653-be41-7e83ca42f6f5 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:21.445436 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-daf7d96c-4c60-4653-be41-7e83ca42f6f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a38f60b376264416a942b282fc241fb2', 'request_id': 'req-daf7d96c-4c60-4653-be41-7e83ca42f6f5'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:21.449363 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:17:21.451539 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-daf7d96c-4c60-4653-be41-7e83ca42f6f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a38f60b376264416a942b282fc241fb2', 'request_id': 'req-daf7d96c-4c60-4653-be41-7e83ca42f6f5'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:21.459382 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-daf7d96c-4c60-4653-be41-7e83ca42f6f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a38f60b376264416a942b282fc241fb2', 'request_id': 'req-daf7d96c-4c60-4653-be41-7e83ca42f6f5'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:21.470813 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-daf7d96c-4c60-4653-be41-7e83ca42f6f5 admin admin] The token cache is being invalidate because project a38f60b376264416a942b282fc241fb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:17:21.471100 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-daf7d96c-4c60-4653-be41-7e83ca42f6f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:21.471765 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-daf7d96c-4c60-4653-be41-7e83ca42f6f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:21.473347 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1433/2858] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:17:21 2022] DELETE /identity/v3/projects/a38f60b376264416a942b282fc241fb2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:17:21.478168 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be409f5-ed7b-45ab-a423-efcb2d67b60b None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:21.478487 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be409f5-ed7b-45ab-a423-efcb2d67b60b None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:21.478770 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be409f5-ed7b-45ab-a423-efcb2d67b60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:21.497132 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-8be409f5-ed7b-45ab-a423-efcb2d67b60b None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:17:21.498315 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-8be409f5-ed7b-45ab-a423-efcb2d67b60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:17:21.556654 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1426/2859] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:17:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:17:21.564339 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702c854-b26c-4a5c-8421-5cef16388b34 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:21.564580 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702c854-b26c-4a5c-8421-5cef16388b34 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:21.564854 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702c854-b26c-4a5c-8421-5cef16388b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:21.583996 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-3702c854-b26c-4a5c-8421-5cef16388b34 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:17:21.585309 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-3702c854-b26c-4a5c-8421-5cef16388b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:17:21.593618 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1434/2860] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:17:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:17:21.597969 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be409f5-ed7b-45ab-a423-efcb2d67b60b None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:21.607668 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be409f5-ed7b-45ab-a423-efcb2d67b60b None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:21.612195 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e966c3-0456-41cc-9602-b6d1047b11ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:21.612845 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e966c3-0456-41cc-9602-b6d1047b11ee admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:21.613133 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e966c3-0456-41cc-9602-b6d1047b11ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:21.613413 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e966c3-0456-41cc-9602-b6d1047b11ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:21.614140 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e966c3-0456-41cc-9602-b6d1047b11ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:17:21.614452 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e966c3-0456-41cc-9602-b6d1047b11ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:21.616088 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e966c3-0456-41cc-9602-b6d1047b11ee admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:21.627456 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1427/2861] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 12:17:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:17:21.632188 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3702c854-b26c-4a5c-8421-5cef16388b34 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:21.641628 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3702c854-b26c-4a5c-8421-5cef16388b34 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:21.646851 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e47aa-d8d4-48e1-b821-5beec0e1105b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:21.647486 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e47aa-d8d4-48e1-b821-5beec0e1105b admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:21.647819 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e47aa-d8d4-48e1-b821-5beec0e1105b admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:21.648091 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e47aa-d8d4-48e1-b821-5beec0e1105b admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:21.648764 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e47aa-d8d4-48e1-b821-5beec0e1105b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:21.650636 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e47aa-d8d4-48e1-b821-5beec0e1105b admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:21.676489 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1435/2862] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 12:17:21 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:17:21.680405 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e966c3-0456-41cc-9602-b6d1047b11ee admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:21.690459 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e966c3-0456-41cc-9602-b6d1047b11ee admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:21.729879 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:17:21.747179 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690461f9-5233-402f-abcf-9e4efb3945dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:21.747879 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690461f9-5233-402f-abcf-9e4efb3945dc admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:21.748155 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690461f9-5233-402f-abcf-9e4efb3945dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:21.748426 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690461f9-5233-402f-abcf-9e4efb3945dc admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:21.749102 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690461f9-5233-402f-abcf-9e4efb3945dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:21.751048 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690461f9-5233-402f-abcf-9e4efb3945dc admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:21.771421 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1428/2863] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 12:17:21 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:17:21.775450 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e47aa-d8d4-48e1-b821-5beec0e1105b admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:21.786368 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e47aa-d8d4-48e1-b821-5beec0e1105b admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:21.790971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e669bc-f7d5-4d1f-9348-371a50c83921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:21.791657 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e669bc-f7d5-4d1f-9348-371a50c83921 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:21.791944 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e669bc-f7d5-4d1f-9348-371a50c83921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:21.792224 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e669bc-f7d5-4d1f-9348-371a50c83921 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:21.792949 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e669bc-f7d5-4d1f-9348-371a50c83921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:21.794533 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e669bc-f7d5-4d1f-9348-371a50c83921 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:21.805313 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1436/2864] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:17:21.809120 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690461f9-5233-402f-abcf-9e4efb3945dc admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:21.819567 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690461f9-5233-402f-abcf-9e4efb3945dc admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:21.824133 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd8a9d-a70e-41c6-9093-719e575fd965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:21.824781 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd8a9d-a70e-41c6-9093-719e575fd965 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:21.825075 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd8a9d-a70e-41c6-9093-719e575fd965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:21.825348 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd8a9d-a70e-41c6-9093-719e575fd965 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:21.826069 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fd8a9d-a70e-41c6-9093-719e575fd965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:21.827799 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fd8a9d-a70e-41c6-9093-719e575fd965 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:21.838983 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1429/2865] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:17:21.842907 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e669bc-f7d5-4d1f-9348-371a50c83921 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:21.852827 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e669bc-f7d5-4d1f-9348-371a50c83921 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:21.857401 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9325d7d-791b-4390-a5b0-1632f0242317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:21.858256 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9325d7d-791b-4390-a5b0-1632f0242317 admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:21.858537 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9325d7d-791b-4390-a5b0-1632f0242317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:21.858810 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9325d7d-791b-4390-a5b0-1632f0242317 admin admin] PATH_INFO: `/v3/projects/06ec8ef24d924777ab96af55f9804907/users/8bddf2ca2cc44ad9bbb24e7ae0a699c9/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:21.873434 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9325d7d-791b-4390-a5b0-1632f0242317 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06ec8ef24d924777ab96af55f9804907, user_id=8bddf2ca2cc44ad9bbb24e7ae0a699c9, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:21.876092 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9325d7d-791b-4390-a5b0-1632f0242317 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:21.888935 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1437/2866] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:17:21 2022] PUT /identity/v3/projects/06ec8ef24d924777ab96af55f9804907/users/8bddf2ca2cc44ad9bbb24e7ae0a699c9/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 03 12:17:21.899352 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a073e-071a-4aaf-bd49-7d42d1533668 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:21.899870 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a073e-071a-4aaf-bd49-7d42d1533668 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:21.899973 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a073e-071a-4aaf-bd49-7d42d1533668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:21.927418 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-e78a073e-071a-4aaf-bd49-7d42d1533668 None None] MFA Rules not processed for user `8bddf2ca2cc44ad9bbb24e7ae0a699c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:17:21.928654 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-e78a073e-071a-4aaf-bd49-7d42d1533668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:17:21.990698 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1430/2867] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:17:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:17:22.000946 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9325d7d-791b-4390-a5b0-1632f0242317 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:22.002607 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-d9325d7d-791b-4390-a5b0-1632f0242317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:17:22.058895 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9325d7d-791b-4390-a5b0-1632f0242317 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:22.062449 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ffd19-a173-4495-9685-39f5eedb4e8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '978c834f137a4a6ab83a54af0239c137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:22.063074 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ffd19-a173-4495-9685-39f5eedb4e8b service cinder] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:22.063353 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ffd19-a173-4495-9685-39f5eedb4e8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:22.063659 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ffd19-a173-4495-9685-39f5eedb4e8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:22.072959 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4ffd19-a173-4495-9685-39f5eedb4e8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:22.074311 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4ffd19-a173-4495-9685-39f5eedb4e8b service cinder] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:22.083111 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1438/2868] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:17:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:17:31.863841 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a073e-071a-4aaf-bd49-7d42d1533668 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:31.927062 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a073e-071a-4aaf-bd49-7d42d1533668 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:31.931698 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b1a43-46f0-4d86-b152-75e172568f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:31.932561 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b1a43-46f0-4d86-b152-75e172568f76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:31.932840 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b1a43-46f0-4d86-b152-75e172568f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:31.933110 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b1a43-46f0-4d86-b152-75e172568f76 admin admin] PATH_INFO: `/v3/users/8bddf2ca2cc44ad9bbb24e7ae0a699c9` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:31.934276 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b1a43-46f0-4d86-b152-75e172568f76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bddf2ca2cc44ad9bbb24e7ae0a699c9)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:31.936236 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b1a43-46f0-4d86-b152-75e172568f76 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:31.981419 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-304b1a43-46f0-4d86-b152-75e172568f76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bddf2ca2cc44ad9bbb24e7ae0a699c9'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:31.982051 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-304b1a43-46f0-4d86-b152-75e172568f76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bddf2ca2cc44ad9bbb24e7ae0a699c9'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:31.986451 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:17:31.995972 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-304b1a43-46f0-4d86-b152-75e172568f76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bddf2ca2cc44ad9bbb24e7ae0a699c9'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:32.002840 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-304b1a43-46f0-4d86-b152-75e172568f76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bddf2ca2cc44ad9bbb24e7ae0a699c9'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:32.011105 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-304b1a43-46f0-4d86-b152-75e172568f76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bddf2ca2cc44ad9bbb24e7ae0a699c9'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:32.017109 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1431/2869] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:17:31 2022] DELETE /identity/v3/users/8bddf2ca2cc44ad9bbb24e7ae0a699c9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:17:32.022404 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2c7cb-ea5b-43d8-887e-594d6396e74b None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:32.022935 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2c7cb-ea5b-43d8-887e-594d6396e74b None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:32.023039 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2c7cb-ea5b-43d8-887e-594d6396e74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:32.040554 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-d8d2c7cb-ea5b-43d8-887e-594d6396e74b None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:17:32.041750 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-d8d2c7cb-ea5b-43d8-887e-594d6396e74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:17:32.099685 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1439/2870] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:17:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:17:32.109458 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b1a43-46f0-4d86-b152-75e172568f76 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:32.110981 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-304b1a43-46f0-4d86-b152-75e172568f76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:17:32.168152 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b1a43-46f0-4d86-b152-75e172568f76 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:32.171821 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154bfb16-6862-48a6-b922-d838f16a33e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:32.172468 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bfb16-6862-48a6-b922-d838f16a33e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:32.172777 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bfb16-6862-48a6-b922-d838f16a33e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:32.173052 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bfb16-6862-48a6-b922-d838f16a33e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:32.181989 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154bfb16-6862-48a6-b922-d838f16a33e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:32.183422 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154bfb16-6862-48a6-b922-d838f16a33e6 service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:32.193255 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1432/2871] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:17:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:17:32.461267 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2c7cb-ea5b-43d8-887e-594d6396e74b None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:32.462711 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-d8d2c7cb-ea5b-43d8-887e-594d6396e74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:17:32.475594 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2c7cb-ea5b-43d8-887e-594d6396e74b None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:32.480263 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0f878-b58f-4a77-b613-33225a4eb2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:32.481120 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0f878-b58f-4a77-b613-33225a4eb2d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:32.481404 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0f878-b58f-4a77-b613-33225a4eb2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:32.481678 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0f878-b58f-4a77-b613-33225a4eb2d7 admin admin] PATH_INFO: `/v3/projects/06ec8ef24d924777ab96af55f9804907` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:32.482865 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d0f878-b58f-4a77-b613-33225a4eb2d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06ec8ef24d924777ab96af55f9804907)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:32.484806 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d0f878-b58f-4a77-b613-33225a4eb2d7 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:32.502952 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:17:32.533750 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-b3d0f878-b58f-4a77-b613-33225a4eb2d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06ec8ef24d924777ab96af55f9804907', 'request_id': 'req-b3d0f878-b58f-4a77-b613-33225a4eb2d7'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:32.539483 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-b3d0f878-b58f-4a77-b613-33225a4eb2d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06ec8ef24d924777ab96af55f9804907', 'request_id': 'req-b3d0f878-b58f-4a77-b613-33225a4eb2d7'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:32.547671 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-b3d0f878-b58f-4a77-b613-33225a4eb2d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06ec8ef24d924777ab96af55f9804907', 'request_id': 'req-b3d0f878-b58f-4a77-b613-33225a4eb2d7'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:32.559211 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-b3d0f878-b58f-4a77-b613-33225a4eb2d7 admin admin] The token cache is being invalidate because project 06ec8ef24d924777ab96af55f9804907 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80110) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:17:32.559493 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-b3d0f878-b58f-4a77-b613-33225a4eb2d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:32.560131 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-b3d0f878-b58f-4a77-b613-33225a4eb2d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:17:32.561643 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1440/2872] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:17:32 2022] DELETE /identity/v3/projects/06ec8ef24d924777ab96af55f9804907 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:17:32.567161 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf24718-5063-422e-ba96-bcb0493211f2 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:32.567476 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf24718-5063-422e-ba96-bcb0493211f2 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:32.567779 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf24718-5063-422e-ba96-bcb0493211f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:32.584776 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-bbf24718-5063-422e-ba96-bcb0493211f2 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:17:32.585956 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-bbf24718-5063-422e-ba96-bcb0493211f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:17:32.644402 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1433/2873] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:17:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:17:32.652259 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90cdcd-24ef-4a08-96cb-32e4a4eefbf9 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:32.652570 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90cdcd-24ef-4a08-96cb-32e4a4eefbf9 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:32.652876 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90cdcd-24ef-4a08-96cb-32e4a4eefbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:32.671911 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-6e90cdcd-24ef-4a08-96cb-32e4a4eefbf9 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:17:32.673094 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-6e90cdcd-24ef-4a08-96cb-32e4a4eefbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:17:32.682016 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1441/2874] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:17:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:17:32.686155 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf24718-5063-422e-ba96-bcb0493211f2 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:32.695853 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf24718-5063-422e-ba96-bcb0493211f2 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:32.700501 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed422441-a4c1-4dea-81b9-3f76d428f409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:32.701148 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed422441-a4c1-4dea-81b9-3f76d428f409 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:32.701433 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed422441-a4c1-4dea-81b9-3f76d428f409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:32.701713 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed422441-a4c1-4dea-81b9-3f76d428f409 admin admin] PATH_INFO: `/v3/domains` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:32.702439 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed422441-a4c1-4dea-81b9-3f76d428f409 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80111) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 03 12:17:32.702746 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed422441-a4c1-4dea-81b9-3f76d428f409 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:32.704380 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed422441-a4c1-4dea-81b9-3f76d428f409 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:32.715795 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1434/2875] 10.222.0.15 () {58 vars in 1152 bytes} [Fri Jun 3 12:17:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 03 12:17:32.719818 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90cdcd-24ef-4a08-96cb-32e4a4eefbf9 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:32.729453 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90cdcd-24ef-4a08-96cb-32e4a4eefbf9 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:32.734089 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f6d49-5344-4343-8ed2-670f6e2692bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:32.734720 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f6d49-5344-4343-8ed2-670f6e2692bb admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:32.735006 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f6d49-5344-4343-8ed2-670f6e2692bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:32.735283 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f6d49-5344-4343-8ed2-670f6e2692bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:32.736000 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0f6d49-5344-4343-8ed2-670f6e2692bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:32.738536 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0f6d49-5344-4343-8ed2-670f6e2692bb admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:32.763907 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1442/2876] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 12:17:32 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:17:32.768100 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed422441-a4c1-4dea-81b9-3f76d428f409 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:32.778194 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed422441-a4c1-4dea-81b9-3f76d428f409 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:32.834490 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562a812-9aee-40d0-9c4b-d890c580da53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:32.835159 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562a812-9aee-40d0-9c4b-d890c580da53 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:32.835448 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562a812-9aee-40d0-9c4b-d890c580da53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:32.835752 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562a812-9aee-40d0-9c4b-d890c580da53 admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:32.836451 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1562a812-9aee-40d0-9c4b-d890c580da53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:32.838371 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1562a812-9aee-40d0-9c4b-d890c580da53 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:32.844934 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:17:32.859531 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1435/2877] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 12:17:32 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 03 12:17:32.864222 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f6d49-5344-4343-8ed2-670f6e2692bb admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:32.874362 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f6d49-5344-4343-8ed2-670f6e2692bb admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:32.878854 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7231b-1e24-4176-8e3d-faaf46d3eb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:32.879519 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7231b-1e24-4176-8e3d-faaf46d3eb7d admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:32.879806 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7231b-1e24-4176-8e3d-faaf46d3eb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:32.880084 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7231b-1e24-4176-8e3d-faaf46d3eb7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:32.880793 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b7231b-1e24-4176-8e3d-faaf46d3eb7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:32.882368 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b7231b-1e24-4176-8e3d-faaf46d3eb7d admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:32.892916 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1443/2878] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:17:32.897018 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562a812-9aee-40d0-9c4b-d890c580da53 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:32.907988 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562a812-9aee-40d0-9c4b-d890c580da53 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:32.913178 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aed4c4-ec02-41da-b100-f5de613f9779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:32.913835 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aed4c4-ec02-41da-b100-f5de613f9779 admin admin] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:32.914143 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aed4c4-ec02-41da-b100-f5de613f9779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:32.914408 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aed4c4-ec02-41da-b100-f5de613f9779 admin admin] PATH_INFO: `/v3/roles` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:32.915137 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aed4c4-ec02-41da-b100-f5de613f9779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:32.916774 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aed4c4-ec02-41da-b100-f5de613f9779 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:32.927212 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1436/2879] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:17:32.931205 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7231b-1e24-4176-8e3d-faaf46d3eb7d admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:32.941284 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7231b-1e24-4176-8e3d-faaf46d3eb7d admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:32.945818 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3bcdd-4551-42db-b106-1fc3093b4f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:32.946672 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3bcdd-4551-42db-b106-1fc3093b4f0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:32.946951 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3bcdd-4551-42db-b106-1fc3093b4f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:32.947220 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3bcdd-4551-42db-b106-1fc3093b4f0f admin admin] PATH_INFO: `/v3/projects/115a680fe4994f61b8328b7e4e266507/users/8269e583a4f043a59e34ebfbdb1661ec/roles/781e2d573ee94afaae05b3cc0bba8768` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:32.962508 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde3bcdd-4551-42db-b106-1fc3093b4f0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=115a680fe4994f61b8328b7e4e266507, user_id=8269e583a4f043a59e34ebfbdb1661ec, role_id=781e2d573ee94afaae05b3cc0bba8768)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:32.965168 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde3bcdd-4551-42db-b106-1fc3093b4f0f admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:32.977943 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1444/2880] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:17:32 2022] PUT /identity/v3/projects/115a680fe4994f61b8328b7e4e266507/users/8269e583a4f043a59e34ebfbdb1661ec/roles/781e2d573ee94afaae05b3cc0bba8768 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:17:32.982900 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482f113-02f6-41ef-aef3-a8e680f8ca91 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:32.983194 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482f113-02f6-41ef-aef3-a8e680f8ca91 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:32.983473 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482f113-02f6-41ef-aef3-a8e680f8ca91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:33.001960 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-a482f113-02f6-41ef-aef3-a8e680f8ca91 None None] MFA Rules not processed for user `0616a4eb01db4ae8ac6d10f710fd1630`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:17:33.003154 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-a482f113-02f6-41ef-aef3-a8e680f8ca91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:17:33.061273 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1437/2881] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:17:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 03 12:17:33.071022 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3bcdd-4551-42db-b106-1fc3093b4f0f admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:33.072912 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-fde3bcdd-4551-42db-b106-1fc3093b4f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:17:33.131231 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3bcdd-4551-42db-b106-1fc3093b4f0f admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:33.135017 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a185e-019a-4474-9204-12323e0ffddc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:33.135687 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a185e-019a-4474-9204-12323e0ffddc service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:33.135971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a185e-019a-4474-9204-12323e0ffddc service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:33.136246 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a185e-019a-4474-9204-12323e0ffddc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:33.145652 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a185e-019a-4474-9204-12323e0ffddc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:33.147191 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a185e-019a-4474-9204-12323e0ffddc service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:33.156747 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1445/2882] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:17:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:17:37.263234 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaaac5e-2381-4c6f-8ae8-375c5d744eb3 None None] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:37.263788 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaaac5e-2381-4c6f-8ae8-375c5d744eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:37.263925 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaaac5e-2381-4c6f-8ae8-375c5d744eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:37.303982 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.auth.core [None req-baaaac5e-2381-4c6f-8ae8-375c5d744eb3 None None] MFA Rules not processed for user `8269e583a4f043a59e34ebfbdb1661ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80111) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:17:37.306184 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-baaaac5e-2381-4c6f-8ae8-375c5d744eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:17:37.400344 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1438/2883] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:17:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:17:37.405122 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a185e-019a-4474-9204-12323e0ffddc service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:37.415180 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a185e-019a-4474-9204-12323e0ffddc service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:37.420115 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a63fc-7727-4e2a-951f-7f3601acde63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:37.420780 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a63fc-7727-4e2a-951f-7f3601acde63 admin admin] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:37.421066 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a63fc-7727-4e2a-951f-7f3601acde63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:37.421352 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a63fc-7727-4e2a-951f-7f3601acde63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:37.422087 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a63fc-7727-4e2a-951f-7f3601acde63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:37.424021 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a63fc-7727-4e2a-951f-7f3601acde63 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:37.451902 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1446/2884] 10.222.0.15 () {60 vars in 1152 bytes} [Fri Jun 3 12:17:37 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:17:37.455989 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaaac5e-2381-4c6f-8ae8-375c5d744eb3 None None] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:37.468335 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaaac5e-2381-4c6f-8ae8-375c5d744eb3 None None] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:37.527533 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5117c36-7001-4f82-92d3-8484b33e5eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:37.528314 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5117c36-7001-4f82-92d3-8484b33e5eb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:37.528676 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5117c36-7001-4f82-92d3-8484b33e5eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:37.528950 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5117c36-7001-4f82-92d3-8484b33e5eb4 admin admin] PATH_INFO: `/v3/users` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:37.529640 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5117c36-7001-4f82-92d3-8484b33e5eb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:37.531604 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5117c36-7001-4f82-92d3-8484b33e5eb4 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:37.546576 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:17:37.555865 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1439/2885] 10.222.0.15 () {60 vars in 1143 bytes} [Fri Jun 3 12:17:37 2022] POST /identity/v3/users => generated 298 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 03 12:17:37.560115 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a63fc-7727-4e2a-951f-7f3601acde63 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:37.571470 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a63fc-7727-4e2a-951f-7f3601acde63 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:37.576575 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6681a0-2b62-4073-b5d4-2c00941d62dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:37.577260 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6681a0-2b62-4073-b5d4-2c00941d62dd admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:37.577547 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6681a0-2b62-4073-b5d4-2c00941d62dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:37.577827 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6681a0-2b62-4073-b5d4-2c00941d62dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:37.578564 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6681a0-2b62-4073-b5d4-2c00941d62dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:37.581097 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6681a0-2b62-4073-b5d4-2c00941d62dd admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:37.592607 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1447/2886] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 03 12:17:37.596981 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5117c36-7001-4f82-92d3-8484b33e5eb4 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:37.607959 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5117c36-7001-4f82-92d3-8484b33e5eb4 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:37.613431 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5c5ac-5946-4c13-bbdd-0876ba304fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:37.614337 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5c5ac-5946-4c13-bbdd-0876ba304fb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:37.614747 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5c5ac-5946-4c13-bbdd-0876ba304fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:37.615032 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5c5ac-5946-4c13-bbdd-0876ba304fb8 admin admin] PATH_INFO: `/v3/projects/3fcc287ef42b4af1bd435ddebba74d93/users/3742d5ad7ad0436b9c0934637e09b663/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:37.633193 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac5c5ac-5946-4c13-bbdd-0876ba304fb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fcc287ef42b4af1bd435ddebba74d93, user_id=3742d5ad7ad0436b9c0934637e09b663, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:37.635900 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac5c5ac-5946-4c13-bbdd-0876ba304fb8 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:37.653211 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1440/2887] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:17:37 2022] PUT /identity/v3/projects/3fcc287ef42b4af1bd435ddebba74d93/users/3742d5ad7ad0436b9c0934637e09b663/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:17:37.657289 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6681a0-2b62-4073-b5d4-2c00941d62dd admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:37.667537 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6681a0-2b62-4073-b5d4-2c00941d62dd admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:37.676705 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:17:37.730098 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46665acb-f64f-49f5-a27a-a81758580d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:37.730769 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46665acb-f64f-49f5-a27a-a81758580d97 admin admin] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:37.731051 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46665acb-f64f-49f5-a27a-a81758580d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:37.731326 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46665acb-f64f-49f5-a27a-a81758580d97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:37.732083 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46665acb-f64f-49f5-a27a-a81758580d97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:37.733706 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46665acb-f64f-49f5-a27a-a81758580d97 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:37.747171 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1448/2888] 10.222.0.15 () {58 vars in 1121 bytes} [Fri Jun 3 12:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 03 12:17:37.751731 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5c5ac-5946-4c13-bbdd-0876ba304fb8 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:37.766821 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5c5ac-5946-4c13-bbdd-0876ba304fb8 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:37.772066 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75089078-4c59-4cbe-97ee-d49fc1b124f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:37.772964 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75089078-4c59-4cbe-97ee-d49fc1b124f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:37.773246 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75089078-4c59-4cbe-97ee-d49fc1b124f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:37.773516 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75089078-4c59-4cbe-97ee-d49fc1b124f7 admin admin] PATH_INFO: `/v3/projects/3fcc287ef42b4af1bd435ddebba74d93/users/3742d5ad7ad0436b9c0934637e09b663/roles/c486e164840b41a59fd118dece2ce572` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:37.775600 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75089078-4c59-4cbe-97ee-d49fc1b124f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fcc287ef42b4af1bd435ddebba74d93, user_id=3742d5ad7ad0436b9c0934637e09b663, role_id=c486e164840b41a59fd118dece2ce572)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:37.778496 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75089078-4c59-4cbe-97ee-d49fc1b124f7 admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:37.789288 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1441/2889] 10.222.0.15 () {60 vars in 1482 bytes} [Fri Jun 3 12:17:37 2022] PUT /identity/v3/projects/3fcc287ef42b4af1bd435ddebba74d93/users/3742d5ad7ad0436b9c0934637e09b663/roles/c486e164840b41a59fd118dece2ce572 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:17:42.034464 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1d186-2e43-4a8b-a1f8-edfd23166b99 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:42.034971 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1d186-2e43-4a8b-a1f8-edfd23166b99 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:42.035082 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1d186-2e43-4a8b-a1f8-edfd23166b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:42.062015 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-7bd1d186-2e43-4a8b-a1f8-edfd23166b99 None None] MFA Rules not processed for user `3742d5ad7ad0436b9c0934637e09b663`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:17:42.063162 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-7bd1d186-2e43-4a8b-a1f8-edfd23166b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:17:42.134220 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1449/2890] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:17:42 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:17:42.146512 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75089078-4c59-4cbe-97ee-d49fc1b124f7 admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:42.148273 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-75089078-4c59-4cbe-97ee-d49fc1b124f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:17:42.206934 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75089078-4c59-4cbe-97ee-d49fc1b124f7 admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:42.210489 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf4c23-68b4-4374-a921-394ff38bf30e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9aa048aec48b4755ac13eae997bff2fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:42.211133 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf4c23-68b4-4374-a921-394ff38bf30e service glance] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:42.211415 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf4c23-68b4-4374-a921-394ff38bf30e service glance] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:42.211717 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf4c23-68b4-4374-a921-394ff38bf30e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:42.275631 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf4c23-68b4-4374-a921-394ff38bf30e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:42.277492 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf4c23-68b4-4374-a921-394ff38bf30e service glance] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:42.286689 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1442/2891] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:17:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:17:42.393719 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca340d85-8f2f-4910-a884-9e9170b77ec2 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:42.394015 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca340d85-8f2f-4910-a884-9e9170b77ec2 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:42.394293 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca340d85-8f2f-4910-a884-9e9170b77ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:42.457282 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-ca340d85-8f2f-4910-a884-9e9170b77ec2 None None] MFA Rules not processed for user `a55cbe88e78e4f3a82b8703a3b1804e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:17:42.458487 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-ca340d85-8f2f-4910-a884-9e9170b77ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:17:42.519992 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=100 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:17:42.529785 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1450/2892] 10.222.0.15 () {58 vars in 1009 bytes} [Fri Jun 3 12:17:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:17:42.577746 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf4c23-68b4-4374-a921-394ff38bf30e service glance] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:42.579147 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-c2cf4c23-68b4-4374-a921-394ff38bf30e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:17:42.667099 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:17:42.678017 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf4c23-68b4-4374-a921-394ff38bf30e service glance] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:42.683362 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a12841-c160-4310-82b1-ccb367eb2075 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f52901fe535420bb0019272d4eafe72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:42.684047 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a12841-c160-4310-82b1-ccb367eb2075 service swift] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:42.684357 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a12841-c160-4310-82b1-ccb367eb2075 service swift] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:42.684633 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a12841-c160-4310-82b1-ccb367eb2075 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:42.692945 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a12841-c160-4310-82b1-ccb367eb2075 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:42.694530 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a12841-c160-4310-82b1-ccb367eb2075 service swift] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:42.703167 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1443/2893] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Jun 3 12:17:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 12:17:51.232056 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd70b7b-ac3f-44b0-b857-030a520c4133 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:51.232534 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd70b7b-ac3f-44b0-b857-030a520c4133 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:51.232663 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd70b7b-ac3f-44b0-b857-030a520c4133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:51.249752 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-2dd70b7b-ac3f-44b0-b857-030a520c4133 None None] MFA Rules not processed for user `8269e583a4f043a59e34ebfbdb1661ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:17:51.250930 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-2dd70b7b-ac3f-44b0-b857-030a520c4133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:17:51.257659 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1451/2894] 10.222.0.15 () {58 vars in 957 bytes} [Fri Jun 3 12:17:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:17:51.503018 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a12841-c160-4310-82b1-ccb367eb2075 service swift] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:51.557148 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a12841-c160-4310-82b1-ccb367eb2075 service swift] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:51.560609 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0d4ca-dedf-4807-8d8b-0f9d81127298 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:51.561241 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0d4ca-dedf-4807-8d8b-0f9d81127298 service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:51.561519 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0d4ca-dedf-4807-8d8b-0f9d81127298 service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:51.561790 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0d4ca-dedf-4807-8d8b-0f9d81127298 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:51.563543 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-16d0d4ca-dedf-4807-8d8b-0f9d81127298 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:17:51.573494 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d0d4ca-dedf-4807-8d8b-0f9d81127298 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:51.574917 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d0d4ca-dedf-4807-8d8b-0f9d81127298 service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:51.582999 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1444/2895] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:17:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:17:53.257891 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90692422-7918-4b78-b7e7-2bbb821bc042 None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:53.258417 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90692422-7918-4b78-b7e7-2bbb821bc042 None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:53.258886 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90692422-7918-4b78-b7e7-2bbb821bc042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:53.287407 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-90692422-7918-4b78-b7e7-2bbb821bc042 None None] MFA Rules not processed for user `a55cbe88e78e4f3a82b8703a3b1804e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:17:53.289731 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-90692422-7918-4b78-b7e7-2bbb821bc042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:17:53.297682 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1452/2896] 10.222.0.15 () {58 vars in 1009 bytes} [Fri Jun 3 12:17:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:17:53.310778 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0d4ca-dedf-4807-8d8b-0f9d81127298 service neutron] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:17:53.322923 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0d4ca-dedf-4807-8d8b-0f9d81127298 service neutron] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:17:53.327990 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d9222-c05d-4d6c-b2f5-a7422e713aeb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f52901fe535420bb0019272d4eafe72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:17:53.328736 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d9222-c05d-4d6c-b2f5-a7422e713aeb service swift] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:17:53.329107 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d9222-c05d-4d6c-b2f5-a7422e713aeb service swift] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:17:53.329457 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d9222-c05d-4d6c-b2f5-a7422e713aeb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:17:53.338855 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617d9222-c05d-4d6c-b2f5-a7422e713aeb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:17:53.340478 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617d9222-c05d-4d6c-b2f5-a7422e713aeb service swift] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:17:53.350248 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1445/2897] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Jun 3 12:17:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 12:18:03.278728 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=8 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:18:03.345824 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=39 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:18:24.377804 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90692422-7918-4b78-b7e7-2bbb821bc042 None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:18:24.387738 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90692422-7918-4b78-b7e7-2bbb821bc042 None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:18:24.391391 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d0167-073a-420a-a8c0-5967c7d6f030 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:18:24.392066 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d0167-073a-420a-a8c0-5967c7d6f030 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:18:24.392346 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d0167-073a-420a-a8c0-5967c7d6f030 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:18:24.392618 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d0167-073a-420a-a8c0-5967c7d6f030 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:18:24.402528 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d0167-073a-420a-a8c0-5967c7d6f030 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:18:24.403998 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d0167-073a-420a-a8c0-5967c7d6f030 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:18:24.413468 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1453/2898] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:18:24 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:18:34.409309 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=6 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:19:28.332738 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d9222-c05d-4d6c-b2f5-a7422e713aeb service swift] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:19:28.342436 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d9222-c05d-4d6c-b2f5-a7422e713aeb service swift] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:19:28.346722 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa00bb-2c1a-4493-813e-81ebbd317a29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:19:28.347362 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa00bb-2c1a-4493-813e-81ebbd317a29 service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:19:28.347679 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa00bb-2c1a-4493-813e-81ebbd317a29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:19:28.347957 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa00bb-2c1a-4493-813e-81ebbd317a29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:19:28.349755 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-7faa00bb-2c1a-4493-813e-81ebbd317a29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:19:28.423726 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa00bb-2c1a-4493-813e-81ebbd317a29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:19:28.425193 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa00bb-2c1a-4493-813e-81ebbd317a29 service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:19:28.437483 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1446/2899] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:19:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:19:29.711385 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d0167-073a-420a-a8c0-5967c7d6f030 service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:19:29.712802 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-b73d0167-073a-420a-a8c0-5967c7d6f030 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:19:29.723937 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d0167-073a-420a-a8c0-5967c7d6f030 service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:19:29.727464 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe351c07-dd7c-4231-8f9c-55bd09fa9675 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:19:29.728113 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe351c07-dd7c-4231-8f9c-55bd09fa9675 service neutron] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:19:29.728392 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe351c07-dd7c-4231-8f9c-55bd09fa9675 service neutron] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:19:29.728662 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe351c07-dd7c-4231-8f9c-55bd09fa9675 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:19:29.730332 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-fe351c07-dd7c-4231-8f9c-55bd09fa9675 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:19:29.743997 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe351c07-dd7c-4231-8f9c-55bd09fa9675 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:19:29.745469 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe351c07-dd7c-4231-8f9c-55bd09fa9675 service neutron] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:19:29.757596 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1454/2900] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:19:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:19:38.432367 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=34 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:19:39.752401 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=6 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:19:44.146402 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa00bb-2c1a-4493-813e-81ebbd317a29 service neutron] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:19:44.155404 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa00bb-2c1a-4493-813e-81ebbd317a29 service neutron] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:19:44.159765 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92dc50-5e92-4944-a654-92d088ab0cde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a78b4284099546cd9c126a5739380b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:19:44.160404 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92dc50-5e92-4944-a654-92d088ab0cde service neutron] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:19:44.160689 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92dc50-5e92-4944-a654-92d088ab0cde service neutron] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:19:44.160985 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92dc50-5e92-4944-a654-92d088ab0cde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:19:44.162822 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-0c92dc50-5e92-4944-a654-92d088ab0cde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:19:44.173025 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c92dc50-5e92-4944-a654-92d088ab0cde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:19:44.174453 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c92dc50-5e92-4944-a654-92d088ab0cde service neutron] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:19:44.182488 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1447/2901] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:19:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:19:54.178948 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=6 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:20:44.515230 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe351c07-dd7c-4231-8f9c-55bd09fa9675 service neutron] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:20:44.518536 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-fe351c07-dd7c-4231-8f9c-55bd09fa9675 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:20:44.538505 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe351c07-dd7c-4231-8f9c-55bd09fa9675 service neutron] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:20:44.549987 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f35f13-e2b7-4293-b078-42d218f7ff97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:20:44.552775 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f35f13-e2b7-4293-b078-42d218f7ff97 service nova] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:20:44.553324 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f35f13-e2b7-4293-b078-42d218f7ff97 service nova] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:20:44.554383 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f35f13-e2b7-4293-b078-42d218f7ff97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:20:44.558307 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-57f35f13-e2b7-4293-b078-42d218f7ff97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:20:44.579534 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f35f13-e2b7-4293-b078-42d218f7ff97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:20:44.582237 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f35f13-e2b7-4293-b078-42d218f7ff97 service nova] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:20:44.600035 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1455/2902] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:20:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:20:51.310192 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92dc50-5e92-4944-a654-92d088ab0cde service neutron] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:20:51.324847 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92dc50-5e92-4944-a654-92d088ab0cde service neutron] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:20:51.331170 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e1f0b-cc36-4d90-b021-14261732759f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247bfb7aebd45eeb97ba5933be44c6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:20:51.332448 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e1f0b-cc36-4d90-b021-14261732759f service nova] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:20:51.332727 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e1f0b-cc36-4d90-b021-14261732759f service nova] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:20:51.332996 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e1f0b-cc36-4d90-b021-14261732759f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:20:51.334793 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-de4e1f0b-cc36-4d90-b021-14261732759f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:20:51.349724 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e1f0b-cc36-4d90-b021-14261732759f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:20:51.351303 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e1f0b-cc36-4d90-b021-14261732759f service nova] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:20:51.362938 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1448/2903] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:20:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:20:52.282033 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a95d5-5a49-4677-8ea6-9488ab0d623a None None] REQUEST_METHOD: `POST` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:20:52.282506 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a95d5-5a49-4677-8ea6-9488ab0d623a None None] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:20:52.282619 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a95d5-5a49-4677-8ea6-9488ab0d623a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:20:52.301016 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.auth.core [None req-040a95d5-5a49-4677-8ea6-9488ab0d623a None None] MFA Rules not processed for user `a55cbe88e78e4f3a82b8703a3b1804e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80110) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 03 12:20:52.302307 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-040a95d5-5a49-4677-8ea6-9488ab0d623a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:20:52.309587 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1456/2904] 10.222.0.15 () {58 vars in 967 bytes} [Fri Jun 3 12:20:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 03 12:20:52.349089 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e1f0b-cc36-4d90-b021-14261732759f service nova] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:20:52.360379 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e1f0b-cc36-4d90-b021-14261732759f service nova] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:20:52.365843 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc968a-e61c-4429-a9bd-80542073cd8f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f52901fe535420bb0019272d4eafe72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:20:52.366480 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc968a-e61c-4429-a9bd-80542073cd8f service swift] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:20:52.366764 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc968a-e61c-4429-a9bd-80542073cd8f service swift] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:20:52.367040 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc968a-e61c-4429-a9bd-80542073cd8f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:20:52.375001 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dc968a-e61c-4429-a9bd-80542073cd8f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:20:52.376598 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dc968a-e61c-4429-a9bd-80542073cd8f service swift] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:20:52.385220 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1449/2905] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Jun 3 12:20:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 03 12:20:55.419732 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a95d5-5a49-4677-8ea6-9488ab0d623a None None] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:20:55.421358 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-040a95d5-5a49-4677-8ea6-9488ab0d623a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:20:55.506391 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a95d5-5a49-4677-8ea6-9488ab0d623a None None] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:20:55.512197 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23d38f-00b3-444c-b767-62dd2ded2de1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5a91437dd64e2491ce41b4d12d4835', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:20:55.513130 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23d38f-00b3-444c-b767-62dd2ded2de1 service placement] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:20:55.513481 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23d38f-00b3-444c-b767-62dd2ded2de1 service placement] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:20:55.513959 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23d38f-00b3-444c-b767-62dd2ded2de1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:20:55.515735 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-6f23d38f-00b3-444c-b767-62dd2ded2de1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:20:55.528150 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f23d38f-00b3-444c-b767-62dd2ded2de1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:20:55.529735 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f23d38f-00b3-444c-b767-62dd2ded2de1 service placement] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:20:55.542194 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1457/2906] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:20:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:20:58.504521 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc968a-e61c-4429-a9bd-80542073cd8f service swift] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:20:58.505974 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-68dc968a-e61c-4429-a9bd-80542073cd8f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:20:58.521892 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc968a-e61c-4429-a9bd-80542073cd8f service swift] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:20:58.527222 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f7408-3ef2-4c2a-b4ea-827d085483f3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5a91437dd64e2491ce41b4d12d4835', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:20:58.528242 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f7408-3ef2-4c2a-b4ea-827d085483f3 service placement] REQUEST_METHOD: `GET` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:20:58.528529 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f7408-3ef2-4c2a-b4ea-827d085483f3 service placement] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:20:58.528810 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f7408-3ef2-4c2a-b4ea-827d085483f3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:20:58.530623 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-056f7408-3ef2-4c2a-b4ea-827d085483f3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:20:58.544066 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f7408-3ef2-4c2a-b4ea-827d085483f3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:20:58.545965 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f7408-3ef2-4c2a-b4ea-827d085483f3 service placement] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:20:58.558019 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1450/2907] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:20:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:20:58.573688 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23d38f-00b3-444c-b767-62dd2ded2de1 service placement] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:20:58.651875 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23d38f-00b3-444c-b767-62dd2ded2de1 service placement] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:20:58.656632 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd81676-9867-453b-a8d1-4c004f9fc381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:20:58.657521 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd81676-9867-453b-a8d1-4c004f9fc381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:20:58.657799 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd81676-9867-453b-a8d1-4c004f9fc381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:20:58.658068 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd81676-9867-453b-a8d1-4c004f9fc381 admin admin] PATH_INFO: `/v3/users/8269e583a4f043a59e34ebfbdb1661ec` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:20:58.659274 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd81676-9867-453b-a8d1-4c004f9fc381 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8269e583a4f043a59e34ebfbdb1661ec)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:20:58.661210 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd81676-9867-453b-a8d1-4c004f9fc381 admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:20:58.705561 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-dbd81676-9867-453b-a8d1-4c004f9fc381 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8269e583a4f043a59e34ebfbdb1661ec'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:20:58.714241 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-dbd81676-9867-453b-a8d1-4c004f9fc381 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8269e583a4f043a59e34ebfbdb1661ec'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:20:58.714933 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-dbd81676-9867-453b-a8d1-4c004f9fc381 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8269e583a4f043a59e34ebfbdb1661ec'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:20:58.725660 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:20:58.726829 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-dbd81676-9867-453b-a8d1-4c004f9fc381 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8269e583a4f043a59e34ebfbdb1661ec'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:20:58.734734 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-dbd81676-9867-453b-a8d1-4c004f9fc381 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8269e583a4f043a59e34ebfbdb1661ec'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:20:58.740777 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1458/2908] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:20:58 2022] DELETE /identity/v3/users/8269e583a4f043a59e34ebfbdb1661ec => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:20:58.920412 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f7408-3ef2-4c2a-b4ea-827d085483f3 service placement] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:20:58.942543 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f7408-3ef2-4c2a-b4ea-827d085483f3 service placement] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:20:58.998835 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe06ea-b543-4a77-8003-9f5ffbcec23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:20:58.999750 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe06ea-b543-4a77-8003-9f5ffbcec23b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:20:59.000030 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe06ea-b543-4a77-8003-9f5ffbcec23b admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:20:59.000299 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe06ea-b543-4a77-8003-9f5ffbcec23b admin admin] PATH_INFO: `/v3/projects/115a680fe4994f61b8328b7e4e266507` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:20:59.001461 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe06ea-b543-4a77-8003-9f5ffbcec23b admin admin] RBAC: Authorizing `identity:delete_project(project_id=115a680fe4994f61b8328b7e4e266507)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:20:59.004029 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe06ea-b543-4a77-8003-9f5ffbcec23b admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:20:59.047641 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-63fe06ea-b543-4a77-8003-9f5ffbcec23b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '115a680fe4994f61b8328b7e4e266507', 'request_id': 'req-63fe06ea-b543-4a77-8003-9f5ffbcec23b'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:20:59.053541 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-63fe06ea-b543-4a77-8003-9f5ffbcec23b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '115a680fe4994f61b8328b7e4e266507', 'request_id': 'req-63fe06ea-b543-4a77-8003-9f5ffbcec23b'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:20:59.060467 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-63fe06ea-b543-4a77-8003-9f5ffbcec23b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '115a680fe4994f61b8328b7e4e266507', 'request_id': 'req-63fe06ea-b543-4a77-8003-9f5ffbcec23b'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:20:59.072136 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-63fe06ea-b543-4a77-8003-9f5ffbcec23b admin admin] The token cache is being invalidate because project 115a680fe4994f61b8328b7e4e266507 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:20:59.072426 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-63fe06ea-b543-4a77-8003-9f5ffbcec23b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:20:59.073057 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-63fe06ea-b543-4a77-8003-9f5ffbcec23b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:20:59.074581 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1451/2909] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:20:58 2022] DELETE /identity/v3/projects/115a680fe4994f61b8328b7e4e266507 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:20:59.078673 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd81676-9867-453b-a8d1-4c004f9fc381 admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:20:59.080148 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-dbd81676-9867-453b-a8d1-4c004f9fc381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:20:59.093053 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd81676-9867-453b-a8d1-4c004f9fc381 admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:20:59.152233 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b4ccf2-aa04-467e-b872-0fee82a5b9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:20:59.152233 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4ccf2-aa04-467e-b872-0fee82a5b9ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:20:59.152233 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4ccf2-aa04-467e-b872-0fee82a5b9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:20:59.152233 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4ccf2-aa04-467e-b872-0fee82a5b9ce admin admin] PATH_INFO: `/v3/users/3742d5ad7ad0436b9c0934637e09b663` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:20:59.153112 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b4ccf2-aa04-467e-b872-0fee82a5b9ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=3742d5ad7ad0436b9c0934637e09b663)` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:20:59.155033 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b4ccf2-aa04-467e-b872-0fee82a5b9ce admin admin] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:20:59.206337 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-80b4ccf2-aa04-467e-b872-0fee82a5b9ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3742d5ad7ad0436b9c0934637e09b663'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:20:59.213538 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-80b4ccf2-aa04-467e-b872-0fee82a5b9ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3742d5ad7ad0436b9c0934637e09b663'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:20:59.214212 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-80b4ccf2-aa04-467e-b872-0fee82a5b9ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3742d5ad7ad0436b9c0934637e09b663'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:20:59.227412 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-80b4ccf2-aa04-467e-b872-0fee82a5b9ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3742d5ad7ad0436b9c0934637e09b663'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:20:59.236797 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.notifications [None req-80b4ccf2-aa04-467e-b872-0fee82a5b9ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3742d5ad7ad0436b9c0934637e09b663'} {{(pid=80110) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:20:59.243387 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1459/2910] 10.222.0.15 () {58 vars in 1223 bytes} [Fri Jun 3 12:20:59 2022] DELETE /identity/v3/users/3742d5ad7ad0436b9c0934637e09b663 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:20:59.415445 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe06ea-b543-4a77-8003-9f5ffbcec23b admin admin] Authenticating user token {{(pid=80111) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:20:59.416927 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.fernet_utils [None req-63fe06ea-b543-4a77-8003-9f5ffbcec23b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80111) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:20:59.430322 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe06ea-b543-4a77-8003-9f5ffbcec23b admin admin] Validating token access rules against request {{(pid=80111) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:20:59.478124 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:20:59.490052 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65b377-97df-4765-a5c7-577fae165cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0616a4eb01db4ae8ac6d10f710fd1630', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db62e59d8164100b9d96eb446461cfc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80111) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:20:59.490921 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65b377-97df-4765-a5c7-577fae165cae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:20:59.491204 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65b377-97df-4765-a5c7-577fae165cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:20:59.491478 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65b377-97df-4765-a5c7-577fae165cae admin admin] PATH_INFO: `/v3/projects/3fcc287ef42b4af1bd435ddebba74d93` {{(pid=80111) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:20:59.492776 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa65b377-97df-4765-a5c7-577fae165cae admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fcc287ef42b4af1bd435ddebba74d93)` {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:20:59.494685 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa65b377-97df-4765-a5c7-577fae165cae admin admin] RBAC: Authorization granted {{(pid=80111) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:20:59.541135 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-aa65b377-97df-4765-a5c7-577fae165cae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fcc287ef42b4af1bd435ddebba74d93', 'request_id': 'req-aa65b377-97df-4765-a5c7-577fae165cae'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:20:59.546832 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-aa65b377-97df-4765-a5c7-577fae165cae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fcc287ef42b4af1bd435ddebba74d93', 'request_id': 'req-aa65b377-97df-4765-a5c7-577fae165cae'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:20:59.553968 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-aa65b377-97df-4765-a5c7-577fae165cae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fcc287ef42b4af1bd435ddebba74d93', 'request_id': 'req-aa65b377-97df-4765-a5c7-577fae165cae'} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:20:59.564998 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-aa65b377-97df-4765-a5c7-577fae165cae admin admin] The token cache is being invalidate because project 3fcc287ef42b4af1bd435ddebba74d93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80111) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 03 12:20:59.565280 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-aa65b377-97df-4765-a5c7-577fae165cae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:20:59.565895 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG keystone.notifications [None req-aa65b377-97df-4765-a5c7-577fae165cae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80111) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 03 12:20:59.567430 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: [pid: 80111|app: 0|req: 1452/2911] 10.222.0.15 () {58 vars in 1232 bytes} [Fri Jun 3 12:20:59 2022] DELETE /identity/v3/projects/3fcc287ef42b4af1bd435ddebba74d93 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 03 12:21:09.239830 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=56,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:21:09.562041 dv-cinder-844572-1-iscsi devstack@keystone.service[80111]: DEBUG dbcounter [-] [80111] Writing DB stats keystone:SELECT=28,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:22:00.377617 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b4ccf2-aa04-467e-b872-0fee82a5b9ce admin admin] Authenticating user token {{(pid=80110) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 03 12:22:00.379122 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-80b4ccf2-aa04-467e-b872-0fee82a5b9ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:22:00.520840 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b4ccf2-aa04-467e-b872-0fee82a5b9ce admin admin] Validating token access rules against request {{(pid=80110) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 03 12:22:00.578791 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9eef12-95cd-4a8e-8ff4-49f7fae1f0d8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5a91437dd64e2491ce41b4d12d4835', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff223ee05524cf4bf3591fc5a39559e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80110) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 03 12:22:00.579445 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9eef12-95cd-4a8e-8ff4-49f7fae1f0d8 service placement] REQUEST_METHOD: `GET` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 03 12:22:00.579759 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9eef12-95cd-4a8e-8ff4-49f7fae1f0d8 service placement] SCRIPT_NAME: `/identity` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 03 12:22:00.580039 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9eef12-95cd-4a8e-8ff4-49f7fae1f0d8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80110) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 03 12:22:00.582381 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.fernet_utils [None req-6b9eef12-95cd-4a8e-8ff4-49f7fae1f0d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80110) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 03 12:22:00.593856 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9eef12-95cd-4a8e-8ff4-49f7fae1f0d8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 03 12:22:00.595453 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9eef12-95cd-4a8e-8ff4-49f7fae1f0d8 service placement] RBAC: Authorization granted {{(pid=80110) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 03 12:22:00.606086 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: [pid: 80110|app: 0|req: 1460/2912] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Jun 3 12:22:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 03 12:22:10.601728 dv-cinder-844572-1-iscsi devstack@keystone.service[80110]: DEBUG dbcounter [-] [80110] Writing DB stats keystone:SELECT=89 {{(pid=80110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}